2024-05-08T23:56:19.004 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T23:56:19.005 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867 --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} --name pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/orig.config.yaml 2024-05-08T23:56:19.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T23:56:19.161 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867 branch: wip-pdonnell-testing-20240508.183908-debug description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698867' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240508.183908-debug ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds - SLOW_OPS - slow request sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.183908-debug sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1722 sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.183908-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWhdUXY19xtNbxreI4My4MKxoLIa3Rc7/wCp4aVW6B9w0U4Z+E/3oYbow7cJsvia9afu4fQWYo/EZRvxZA06fQ= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCYtquccB9FiW6UBPvstRR6RSIkZa9nURn1vlowsG+iahapR8sbE4S1ye9qlVkv9QEA2EmGveIleZl0GWs1s5CQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_22:06:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T23:56:19.161 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa; will attempt to use it 2024-05-08T23:56:19.162 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks 2024-05-08T23:56:19.162 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T23:56:19.163 INFO:teuthology.task.internal:Checking packages... 2024-05-08T23:56:19.191 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c9da4049f638c0f84bdd9b4e33c42e86046ac554' 2024-05-08T23:56:19.191 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:56:19.191 INFO:teuthology.packaging:ref: None 2024-05-08T23:56:19.191 INFO:teuthology.packaging:tag: None 2024-05-08T23:56:19.191 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.183908-debug 2024-05-08T23:56:19.192 INFO:teuthology.packaging:sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-08T23:56:19.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240508.183908-debug 2024-05-08T23:56:19.420 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3594.gc9da4049 2024-05-08T23:56:19.421 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T23:56:19.429 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T23:56:19.429 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T23:56:19.467 INFO:teuthology.task.internal:Saving configuration 2024-05-08T23:56:19.490 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T23:56:19.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T23:56:19.556 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:51:17.256630', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWhdUXY19xtNbxreI4My4MKxoLIa3Rc7/wCp4aVW6B9w0U4Z+E/3oYbow7cJsvia9afu4fQWYo/EZRvxZA06fQ='} 2024-05-08T23:56:19.576 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:51:17.255441', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCYtquccB9FiW6UBPvstRR6RSIkZa9nURn1vlowsG+iahapR8sbE4S1ye9qlVkv9QEA2EmGveIleZl0GWs1s5CQ='} 2024-05-08T23:56:19.576 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T23:56:19.583 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-08T23:56:19.583 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-05-08T23:56:19.583 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T23:56:19.675 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d39904ee0>, signals=[15]) 2024-05-08T23:56:19.676 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T23:56:19.681 INFO:teuthology.task.internal:Opening connections... 2024-05-08T23:56:19.681 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T23:56:19.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:56:19.775 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-05-08T23:56:19.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:56:19.858 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T23:56:19.865 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-05-08T23:56:19.885 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-05-08T23:56:19.885 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-05-08T23:56:19.946 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T23:56:19.947 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-05-08T23:56:19.947 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:56:19.947 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T23:56:19.947 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T23:56:19.947 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-05-08T23:56:19.969 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-05-08T23:56:19.987 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-05-08T23:56:19.988 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-05-08T23:56:20.045 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-05-08T23:56:20.045 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-05-08T23:56:20.045 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-05-08T23:56:20.045 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-05-08T23:56:20.045 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T23:56:20.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T23:56:20.046 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-05-08T23:56:20.068 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T23:56:20.078 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T23:56:20.113 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T23:56:20.113 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:56:20.115 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:56:20.132 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T23:56:20.143 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T23:56:20.143 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:56:20.174 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:56:20.281 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T23:56:20.351 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T23:56:20.373 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T23:56:20.373 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-05-08T23:56:20.373 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-08T23:56:20.375 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:56:20.377 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:56:20.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:56:20.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-08T23:56:20.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:56:20.401 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-08T23:56:20.550 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T23:56:20.550 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T23:56:20.550 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-05-08T23:56:20.568 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-437.el9.x86_64 2024-05-08T23:56:20.568 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T23:56:20.568 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T23:56:20.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum upgrade -y linux-firmware 2024-05-08T23:56:20.571 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T23:56:20.571 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T23:56:20.571 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-05-08T23:56:20.589 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-437.el9.x86_64 2024-05-08T23:56:20.589 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T23:56:20.589 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T23:56:20.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum upgrade -y linux-firmware 2024-05-08T23:56:23.340 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.1 MB 00:01 2024-05-08T23:56:23.493 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.1 MB 00:01 2024-05-08T23:56:27.090 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 19 MB 00:02 2024-05-08T23:56:27.636 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-05-08T23:56:32.553 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-05-08T23:56:33.224 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.2 MB 00:02 2024-05-08T23:56:34.253 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-08T23:56:34.758 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 16 kB 00:00 2024-05-08T23:56:35.399 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-05-08T23:56:36.778 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T23:56:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 6.7 kB/s | 1.7 kB 00:00 2024-05-08T23:56:41.917 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-05-08T23:56:42.869 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-05-08T23:56:42.870 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-05-08T23:56:42.870 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-05-08T23:56:42.973 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-08T23:56:42.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T23:56:43.117 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T23:56:43.117 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T23:56:43.119 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-05-08T23:56:44.023 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-05-08T23:56:44.024 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-05-08T23:56:44.024 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-05-08T23:56:44.150 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-08T23:56:44.150 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T23:56:44.378 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T23:56:44.378 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T23:56:44.381 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-05-08T23:56:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08 23:56:58 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T23:56:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2024-05-08 23:56:58-- 2024-05-08T23:56:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 15s 2024-05-08T23:56:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 341M in 15s (23.0 MB/s) 2024-05-08T23:56:58.341 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-08T23:56:58.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T23:57:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying... ######################################## 2024-05-08T23:57:00.632 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing... ######################################## 2024-05-08T23:57:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:Updating / installing... 2024-05-08T23:57:08.658 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T23:57:09.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-08 23:57:09 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T23:57:09.877 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2024-05-08 23:57:09-- 2024-05-08T23:57:09.877 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 25s 2024-05-08T23:57:09.877 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 341M in 25s (13.7 MB/s) 2024-05-08T23:57:09.880 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-08T23:57:09.880 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T23:57:11.977 INFO:teuthology.orchestra.run.smithi153.stdout:Verifying... ######################################## 2024-05-08T23:57:12.110 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing... ######################################## 2024-05-08T23:57:12.239 INFO:teuthology.orchestra.run.smithi153.stdout:Updating / installing... 2024-05-08T23:57:20.194 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T23:57:47.879 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T23:57:47.879 DEBUG:teuthology.orchestra.run.smithi114:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T23:57:47.974 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T23:57:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T23:57:47.976 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T23:57:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T23:57:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T23:57:47.979 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T23:57:47.980 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T23:57:47.981 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T23:57:47.982 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T23:57:47.983 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T23:57:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T23:57:47.985 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T23:57:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T23:57:47.987 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T23:57:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T23:57:47.989 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T23:57:47.990 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T23:57:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T23:57:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T23:57:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T23:57:47.994 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T23:57:47.995 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T23:57:47.996 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T23:57:47.997 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T23:57:47.998 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T23:57:47.999 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T23:57:48.000 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T23:57:48.001 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T23:57:48.002 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T23:57:48.003 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T23:57:48.004 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T23:57:48.005 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T23:57:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T23:57:48.007 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T23:57:48.008 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T23:57:48.009 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T23:57:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T23:57:48.011 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T23:57:48.012 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T23:57:48.013 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T23:57:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T23:57:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T23:57:48.016 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T23:57:48.017 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T23:57:48.018 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T23:57:48.019 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T23:57:48.020 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T23:57:48.021 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T23:57:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T23:57:48.023 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T23:57:48.024 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T23:57:48.025 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T23:57:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T23:57:48.027 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T23:57:48.028 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T23:57:48.029 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T23:57:48.030 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T23:57:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T23:57:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T23:57:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T23:57:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T23:57:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T23:57:48.036 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T23:57:48.037 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T23:57:48.038 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T23:57:48.039 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T23:57:48.040 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T23:57:48.041 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T23:57:48.042 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T23:57:48.043 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T23:57:48.044 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T23:57:48.045 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T23:57:48.046 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T23:57:48.047 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T23:57:48.047 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T23:57:48.047 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T23:57:48.047 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T23:57:48.047 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T23:57:48.047 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T23:57:48.048 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T23:57:48.049 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T23:57:48.050 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T23:57:48.051 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T23:57:48.052 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T23:57:48.052 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T23:57:48.052 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T23:57:48.052 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T23:57:48.053 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T23:57:48.054 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T23:57:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T23:57:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T23:57:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T23:57:48.058 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T23:57:48.059 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T23:57:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T23:57:48.061 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T23:57:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T23:57:48.063 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T23:57:48.064 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T23:57:48.065 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T23:57:48.066 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T23:57:48.067 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T23:57:48.068 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T23:57:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T23:57:48.070 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T23:57:48.071 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T23:57:48.072 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T23:57:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T23:57:48.074 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T23:57:48.075 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T23:57:48.076 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T23:57:48.077 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T23:57:48.078 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T23:57:48.079 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T23:57:48.080 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T23:57:48.081 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T23:57:48.082 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T23:57:48.083 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T23:57:48.084 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T23:57:48.085 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T23:57:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T23:57:48.087 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T23:57:48.088 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T23:57:48.089 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T23:57:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T23:57:48.091 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T23:57:48.092 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T23:57:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T23:57:48.094 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T23:57:48.095 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T23:57:48.096 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T23:57:48.097 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T23:57:48.098 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T23:57:48.099 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T23:57:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T23:57:48.101 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T23:57:48.102 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T23:57:48.103 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T23:57:48.104 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T23:57:48.105 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T23:57:48.106 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T23:57:48.107 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T23:57:48.108 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T23:57:48.110 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T23:57:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T23:57:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T23:57:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T23:57:48.114 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T23:57:48.115 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T23:57:48.116 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T23:57:48.117 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T23:57:48.118 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T23:57:48.119 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T23:57:48.120 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T23:57:48.121 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T23:57:48.122 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T23:57:48.123 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T23:57:48.124 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T23:57:48.125 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T23:57:48.126 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T23:57:48.127 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T23:57:48.128 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T23:57:48.129 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T23:57:48.130 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T23:57:48.131 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T23:57:48.132 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T23:57:48.133 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T23:57:48.134 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T23:57:48.135 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T23:57:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T23:57:48.137 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T23:57:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T23:57:48.139 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T23:57:48.140 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T23:57:48.141 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T23:57:48.142 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T23:57:48.143 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T23:57:48.144 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T23:57:48.145 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T23:57:48.149 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:48.150 DEBUG:teuthology.orchestra.run.smithi114:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout:for file in vmlinuz System.map config; do 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout: fi 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout:done 2024-05-08T23:57:48.173 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:48.174 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-05-08T23:57:48.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.06 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 68.el9 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Group : Unspecified 2024-05-08T23:57:48.258 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 8264254 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : builder@centos.org 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2024-05-08T23:57:48.259 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T23:57:48.260 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T23:57:48.260 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T23:57:48.260 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:48.261 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T23:57:48.870 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-05-08T23:57:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T23:57:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-05-08T23:57:50.243 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-05-08T23:57:50.275 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.D7AVHj3HcF 2024-05-08T23:57:50.275 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D7AVHj3HcF 2024-05-08T23:57:50.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.D7AVHj3HcF 2024-05-08T23:57:50.473 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.D7AVHj3HcF is 6KB 2024-05-08T23:57:50.521 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.D7AVHj3HcF 2024-05-08T23:57:50.536 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T23:57:50.596 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T23:57:50.597 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T23:57:50.597 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T23:57:50.597 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T23:57:50.598 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:50.746 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-05-08T23:57:57.143 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T23:57:57.144 DEBUG:teuthology.orchestra.run.smithi153:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T23:57:57.216 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T23:57:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T23:57:57.218 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T23:57:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T23:57:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T23:57:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T23:57:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T23:57:57.223 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T23:57:57.224 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T23:57:57.225 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T23:57:57.226 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T23:57:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T23:57:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T23:57:57.229 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T23:57:57.230 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T23:57:57.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T23:57:57.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T23:57:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T23:57:57.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T23:57:57.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T23:57:57.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T23:57:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T23:57:57.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T23:57:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T23:57:57.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T23:57:57.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T23:57:57.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T23:57:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T23:57:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T23:57:57.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T23:57:57.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T23:57:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T23:57:57.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T23:57:57.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T23:57:57.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T23:57:57.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T23:57:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T23:57:57.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T23:57:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T23:57:57.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T23:57:57.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T23:57:57.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T23:57:57.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T23:57:57.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T23:57:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T23:57:57.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T23:57:57.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T23:57:57.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T23:57:57.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T23:57:57.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T23:57:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T23:57:57.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T23:57:57.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T23:57:57.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T23:57:57.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T23:57:57.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T23:57:57.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T23:57:57.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T23:57:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T23:57:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T23:57:57.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T23:57:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T23:57:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T23:57:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T23:57:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T23:57:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T23:57:57.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T23:57:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T23:57:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T23:57:57.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T23:57:57.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T23:57:57.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T23:57:57.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T23:57:57.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T23:57:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T23:57:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T23:57:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T23:57:57.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T23:57:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T23:57:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T23:57:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T23:57:57.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T23:57:57.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T23:57:57.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T23:57:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T23:57:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T23:57:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T23:57:57.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T23:57:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T23:57:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T23:57:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T23:57:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T23:57:57.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T23:57:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T23:57:57.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T23:57:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T23:57:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T23:57:57.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T23:57:57.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T23:57:57.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T23:57:57.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T23:57:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T23:57:57.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T23:57:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T23:57:57.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T23:57:57.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T23:57:57.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T23:57:57.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T23:57:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T23:57:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T23:57:57.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T23:57:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T23:57:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T23:57:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T23:57:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T23:57:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T23:57:57.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T23:57:57.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T23:57:57.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T23:57:57.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T23:57:57.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T23:57:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T23:57:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T23:57:57.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T23:57:57.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T23:57:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T23:57:57.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T23:57:57.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T23:57:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T23:57:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T23:57:57.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T23:57:57.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T23:57:57.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T23:57:57.355 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.356 DEBUG:teuthology.orchestra.run.smithi153:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T23:57:57.378 INFO:teuthology.orchestra.run.smithi153.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T23:57:57.378 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T23:57:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T23:57:57.378 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:for file in vmlinuz System.map config; do 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: fi 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-05-08T23:57:57.379 INFO:teuthology.orchestra.run.smithi153.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T23:57:57.380 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T23:57:57.380 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.380 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-05-08T23:57:57.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 68.el9 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8264254 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T23:57:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-08T23:57:57.459 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T23:57:57.460 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T23:57:57.460 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:57.460 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T23:57:58.011 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-05-08T23:57:59.299 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T23:57:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-05-08T23:57:59.329 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-05-08T23:57:59.346 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.F4HEhFiFt9 2024-05-08T23:57:59.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.F4HEhFiFt9 2024-05-08T23:57:59.433 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.F4HEhFiFt9 2024-05-08T23:57:59.535 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.F4HEhFiFt9 is 6KB 2024-05-08T23:57:59.556 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.F4HEhFiFt9 2024-05-08T23:57:59.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T23:57:59.639 INFO:teuthology.orchestra.run.smithi153.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T23:57:59.639 INFO:teuthology.orchestra.run.smithi153.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T23:57:59.639 INFO:teuthology.orchestra.run.smithi153.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T23:57:59.639 INFO:teuthology.orchestra.run.smithi153.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T23:57:59.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T23:57:59.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-05-08T23:58:20.766 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-08T23:58:20.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T23:58:20.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:58:29.810 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-08T23:58:29.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-08T23:58:29.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:58:55.267 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-05-08T23:59:04.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T23:59:04.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:59:04.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-05-08T23:59:13.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-08T23:59:13.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:59:22.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-05-08T23:59:31.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-05-08T23:59:34.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T23:59:34.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:59:35.991 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-05-08T23:59:36.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T23:59:36.655 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T23:59:36.656 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-05-08T23:59:36.698 INFO:teuthology.orchestra.run.smithi114.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T23:59:36.698 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T23:59:36.698 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T23:59:36.698 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T23:59:37.699 DEBUG:teuthology.parallel:result is None 2024-05-08T23:59:43.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-08T23:59:43.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:59:47.080 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-05-08T23:59:47.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-08T23:59:47.626 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T23:59:47.626 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-05-08T23:59:47.665 INFO:teuthology.orchestra.run.smithi153.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T23:59:47.665 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T23:59:47.665 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T23:59:47.665 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T23:59:48.666 DEBUG:teuthology.parallel:result is None 2024-05-08T23:59:48.666 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T23:59:48.674 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T23:59:48.674 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:59:48.680 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:59:48.726 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T23:59:48.737 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T23:59:48.775 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T23:59:48.775 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:59:48.779 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:59:48.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T23:59:48.863 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T23:59:48.864 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:59:48.870 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:59:48.976 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:59:49.038 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:59:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:59:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:59:49.122 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T23:59:49.129 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T23:59:49.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:59:49.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:59:49.205 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T23:59:49.214 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T23:59:49.215 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:59:49.219 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:59:49.257 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:59:49.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:59:49.440 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:59:49.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:59:49.591 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T23:59:49.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:59:49.662 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:59:49.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:59:49.804 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:59:49.877 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:59:49.956 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-08T23:59:49.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:59:50.040 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-05-08T23:59:50.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-05-08T23:59:50.141 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:59:50.196 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:59:50.632 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T23:59:50.640 INFO:teuthology.task.internal:Starting timer... 2024-05-08T23:59:50.640 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T23:59:50.679 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T23:59:50.735 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T23:59:50.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-05-08T23:59:50.936 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-05-08T23:59:50.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-05-08T23:59:51.062 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-05-08T23:59:51.066 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T23:59:51.066 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-05-08T23:59:51.145 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-05-08T23:59:51.145 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-05-08T23:59:51.198 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-05-08T23:59:51.199 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-05-08T23:59:51.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T23:59:51.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:59:51.322 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T23:59:51.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:59:51.397 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T23:59:51.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:59:51.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:59:51.621 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T23:59:51.631 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T23:59:51.637 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T23:59:51.773 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T23:59:51.789 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T23:59:51.791 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T00:05:27.549 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-05-09T00:05:27.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-09T00:05:27.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:05:27.660 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-05-09T00:05:27.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-09T00:05:27.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-09T00:05:27.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:05:27.920 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-05-09T00:05:28.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-09T00:05:28.076 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T00:05:28.167 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T00:05:28.167 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T00:05:28.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:05:28.175 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T00:05:28.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:05:28.261 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T00:05:28.271 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T00:05:28.305 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T00:05:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T00:05:28.374 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-05-09T00:05:28.389 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-05-09T00:05:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-05-09T00:05:28.422 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-05-09T00:05:28.446 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T00:05:28.462 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T00:05:28.487 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T00:05:28.502 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T00:05:28.623 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:05:28.631 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:05:28.631 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-05-09T00:05:28.631 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.632 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.632 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.632 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.644 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:05:28.653 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:05:28.653 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-05-09T00:05:28.654 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.654 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.654 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.654 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:05:28.655 INFO:teuthology.run_tasks:Running task install... 2024-05-09T00:05:28.688 DEBUG:teuthology.task.install:project ceph 2024-05-09T00:05:28.688 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}} 2024-05-09T00:05:28.688 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'} 2024-05-09T00:05:28.688 INFO:teuthology.task.install:Using flavor: default 2024-05-09T00:05:28.696 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T00:05:28.696 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T00:05:28.696 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T00:05:28.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:05:28.699 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T00:05:28.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:05:28.855 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T00:05:28.855 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T00:05:28.963 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T00:05:28.963 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T00:05:29.043 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T00:05:29.043 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:05:29.044 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T00:05:29.133 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T00:05:29.133 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T00:05:29.135 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T00:05:29.136 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:05:29.136 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T00:05:29.225 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T00:05:29.225 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T00:05:29.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T00:05:29.356 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T00:05:29.375 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T00:05:29.453 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-05-09T00:05:29.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-05-09T00:05:29.467 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T00:05:29.548 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-05-09T00:05:29.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-05-09T00:05:29.784 INFO:teuthology.orchestra.run.smithi153.stdout:54 files removed 2024-05-09T00:05:29.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T00:05:29.868 INFO:teuthology.orchestra.run.smithi114.stdout:54 files removed 2024-05-09T00:05:29.907 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T00:05:30.762 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 168 kB/s | 84 kB 00:00 2024-05-09T00:05:30.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 154 kB/s | 84 kB 00:00 2024-05-09T00:05:31.263 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-05-09T00:05:31.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-05-09T00:05:31.738 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-09T00:05:31.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-09T00:05:33.420 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.1 MB 00:01 2024-05-09T00:05:34.203 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.1 MB 00:02 2024-05-09T00:05:36.179 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-09T00:05:37.138 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 19 MB 00:02 2024-05-09T00:05:41.605 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-05-09T00:05:42.142 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.2 MB 00:01 2024-05-09T00:05:43.481 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-05-09T00:05:44.723 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-05-09T00:05:45.447 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-09T00:05:45.892 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-09T00:05:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-05-09T00:05:52.083 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-09T00:05:54.128 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:05:54.129 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:05:54.146 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T00:05:54.147 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T00:05:54.148 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T00:05:54.150 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T00:05:54.152 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T00:05:54.155 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T00:05:54.156 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T00:05:54.225 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-05-09T00:05:54.240 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-05-09T00:05:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-05-09T00:05:54.240 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T00:05:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 764 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T00:05:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 161 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 322 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 300 k 2024-05-09T00:05:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T00:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T00:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T00:05:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T00:05:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T00:05:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T00:05:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T00:05:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T00:05:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T00:05:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:05:54.253 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-05-09T00:05:54.254 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-05-09T00:05:54.254 INFO:teuthology.orchestra.run.smithi153.stdout:Install 148 Packages 2024-05-09T00:05:54.254 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 8 Packages 2024-05-09T00:05:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:05:54.254 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 219 M 2024-05-09T00:05:54.254 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-05-09T00:05:54.610 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:05:54.613 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:05:54.632 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T00:05:54.633 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T00:05:54.635 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T00:05:54.636 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T00:05:54.638 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T00:05:54.642 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T00:05:54.643 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T00:05:54.713 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T00:05:54.740 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 764 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T00:05:54.741 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 161 k 2024-05-09T00:05:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 322 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 300 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T00:05:54.743 INFO:teuthology.orchestra.run.smithi114.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T00:05:54.744 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T00:05:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T00:05:54.746 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T00:05:54.747 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T00:05:54.748 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T00:05:54.749 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T00:05:54.750 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2024-05-09T00:05:54.751 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout:Install 148 Packages 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 8 Packages 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 219 M 2024-05-09T00:05:54.752 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-05-09T00:05:55.317 INFO:teuthology.orchestra.run.smithi153.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-05-09T00:05:55.534 INFO:teuthology.orchestra.run.smithi153.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 3.9 MB/s | 863 kB 00:00 2024-05-09T00:05:55.593 INFO:teuthology.orchestra.run.smithi153.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 2.5 MB/s | 147 kB 00:00 2024-05-09T00:05:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-09T00:05:55.976 INFO:teuthology.orchestra.run.smithi153.stdout:(4/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 5.9 MB/s | 2.3 MB 00:00 2024-05-09T00:05:56.226 INFO:teuthology.orchestra.run.smithi153.stdout:(5/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 4.7 MB/s | 5.4 MB 00:01 2024-05-09T00:05:56.302 INFO:teuthology.orchestra.run.smithi153.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-05-09T00:05:56.319 INFO:teuthology.orchestra.run.smithi114.stdout:(2/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 5.3 MB/s | 5.4 MB 00:01 2024-05-09T00:05:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 1.6 MB/s | 147 kB 00:00 2024-05-09T00:05:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:(4/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 6.0 MB/s | 2.3 MB 00:00 2024-05-09T00:05:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:(5/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 715 kB/s | 863 kB 00:01 2024-05-09T00:05:56.852 INFO:teuthology.orchestra.run.smithi153.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 7.8 MB/s | 4.9 MB 00:00 2024-05-09T00:05:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 7.9 MB/s | 1.5 MB 00:00 2024-05-09T00:05:58.127 INFO:teuthology.orchestra.run.smithi153.stdout:(8/156): ceph-radosgw-19.0.0-3594.gc9da4049.el9 7.9 MB/s | 10 MB 00:01 2024-05-09T00:05:58.361 INFO:teuthology.orchestra.run.smithi153.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 108 kB/s | 25 kB 00:00 2024-05-09T00:05:59.453 INFO:teuthology.orchestra.run.smithi153.stdout:(10/156): ceph-common-19.0.0-3594.gc9da4049.el9 4.5 MB/s | 20 MB 00:04 2024-05-09T00:05:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:(7/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x86 7.0 MB/s | 18 MB 00:02 2024-05-09T00:05:59.720 INFO:teuthology.orchestra.run.smithi153.stdout:(11/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 5.2 MB/s | 18 MB 00:03 2024-05-09T00:05:59.753 INFO:teuthology.orchestra.run.smithi153.stdout:(12/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 748 kB/s | 224 kB 00:00 2024-05-09T00:05:59.778 INFO:teuthology.orchestra.run.smithi153.stdout:(13/156): cephfs-shell-19.0.0-3594.gc9da4049.el 472 kB/s | 27 kB 00:00 2024-05-09T00:05:59.812 INFO:teuthology.orchestra.run.smithi153.stdout:(14/156): libcephfs-devel-19.0.0-3594.gc9da4049 551 kB/s | 32 kB 00:00 2024-05-09T00:05:59.962 INFO:teuthology.orchestra.run.smithi153.stdout:(15/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 4.0 MB/s | 756 kB 00:00 2024-05-09T00:05:59.988 INFO:teuthology.orchestra.run.smithi153.stdout:(16/156): libcephsqlite-19.0.0-3594.gc9da4049.e 904 kB/s | 158 kB 00:00 2024-05-09T00:06:00.038 INFO:teuthology.orchestra.run.smithi153.stdout:(17/156): librados-devel-19.0.0-3594.gc9da4049. 1.7 MB/s | 127 kB 00:00 2024-05-09T00:06:00.172 INFO:teuthology.orchestra.run.smithi153.stdout:(18/156): libradosstriper1-19.0.0-3594.gc9da404 2.7 MB/s | 497 kB 00:00 2024-05-09T00:06:00.272 INFO:teuthology.orchestra.run.smithi153.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 456 kB/s | 45 kB 00:00 2024-05-09T00:06:00.372 INFO:teuthology.orchestra.run.smithi153.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 1.3 MB/s | 135 kB 00:00 2024-05-09T00:06:00.456 INFO:teuthology.orchestra.run.smithi153.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.9 MB/s | 161 kB 00:00 2024-05-09T00:06:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:(8/156): ceph-radosgw-19.0.0-3594.gc9da4049.el9 10 MB/s | 10 MB 00:00 2024-05-09T00:06:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 384 kB/s | 25 kB 00:00 2024-05-09T00:06:00.597 INFO:teuthology.orchestra.run.smithi153.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 2.2 MB/s | 322 kB 00:00 2024-05-09T00:06:00.706 INFO:teuthology.orchestra.run.smithi153.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.7 MB/s | 300 kB 00:00 2024-05-09T00:06:00.815 INFO:teuthology.orchestra.run.smithi153.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 924 kB/s | 99 kB 00:00 2024-05-09T00:06:00.924 INFO:teuthology.orchestra.run.smithi153.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 798 kB/s | 86 kB 00:00 2024-05-09T00:06:01.049 INFO:teuthology.orchestra.run.smithi153.stdout:(26/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 5.1 MB/s | 5.2 MB 00:01 2024-05-09T00:06:01.124 INFO:teuthology.orchestra.run.smithi153.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.2 MB/s | 169 kB 00:00 2024-05-09T00:06:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:(10/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x8 1.1 MB/s | 4.9 MB 00:04 2024-05-09T00:06:01.199 INFO:teuthology.orchestra.run.smithi153.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 461 kB/s | 34 kB 00:00 2024-05-09T00:06:01.283 INFO:teuthology.orchestra.run.smithi153.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.7 MB/s | 142 kB 00:00 2024-05-09T00:06:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 1.0 MB/s | 224 kB 00:00 2024-05-09T00:06:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 233 kB/s | 27 kB 00:00 2024-05-09T00:06:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 234 kB/s | 32 kB 00:00 2024-05-09T00:06:01.783 INFO:teuthology.orchestra.run.smithi153.stdout:(30/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 3.5 MB/s | 3.0 MB 00:00 2024-05-09T00:06:02.134 INFO:teuthology.orchestra.run.smithi153.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 4.2 MB/s | 3.5 MB 00:00 2024-05-09T00:06:02.226 INFO:teuthology.orchestra.run.smithi153.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 3.0 MB/s | 274 kB 00:00 2024-05-09T00:06:02.338 INFO:teuthology.orchestra.run.smithi114.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 1.0 MB/s | 756 kB 00:00 2024-05-09T00:06:02.455 INFO:teuthology.orchestra.run.smithi114.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 1.3 MB/s | 158 kB 00:00 2024-05-09T00:06:02.572 INFO:teuthology.orchestra.run.smithi114.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.1 MB/s | 127 kB 00:00 2024-05-09T00:06:02.701 INFO:teuthology.orchestra.run.smithi153.stdout:(33/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 10 MB/s | 43 MB 00:04 2024-05-09T00:06:02.726 INFO:teuthology.orchestra.run.smithi153.stdout:(34/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 99 kB/s | 49 kB 00:00 2024-05-09T00:06:02.768 INFO:teuthology.orchestra.run.smithi153.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3594.gc 251 kB/s | 16 kB 00:00 2024-05-09T00:06:02.818 INFO:teuthology.orchestra.run.smithi153.stdout:(36/156): ceph-volume-19.0.0-3594.gc9da4049.el9 2.9 MB/s | 273 kB 00:00 2024-05-09T00:06:02.831 INFO:teuthology.orchestra.run.smithi114.stdout:(17/156): libradosstriper1-19.0.0-3594.gc9da404 1.9 MB/s | 497 kB 00:00 2024-05-09T00:06:02.877 INFO:teuthology.orchestra.run.smithi153.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 317 kB/s | 18 kB 00:00 2024-05-09T00:06:02.919 INFO:teuthology.orchestra.run.smithi153.stdout:(38/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 5.0 MB/s | 764 kB 00:00 2024-05-09T00:06:03.053 INFO:teuthology.orchestra.run.smithi153.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 460 kB/s | 80 kB 00:00 2024-05-09T00:06:03.176 INFO:teuthology.orchestra.run.smithi153.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-09T00:06:03.228 INFO:teuthology.orchestra.run.smithi153.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-05-09T00:06:03.270 INFO:teuthology.orchestra.run.smithi153.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-09T00:06:03.421 INFO:teuthology.orchestra.run.smithi153.stdout:(43/156): ceph-mgr-diskprediction-local-19.0.0- 4.5 MB/s | 7.4 MB 00:01 2024-05-09T00:06:03.454 INFO:teuthology.orchestra.run.smithi153.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 583 kB/s | 106 kB 00:00 2024-05-09T00:06:03.513 INFO:teuthology.orchestra.run.smithi153.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-05-09T00:06:03.529 INFO:teuthology.orchestra.run.smithi153.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-05-09T00:06:03.580 INFO:teuthology.orchestra.run.smithi153.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-09T00:06:03.647 INFO:teuthology.orchestra.run.smithi153.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 601 kB/s | 135 kB 00:00 2024-05-09T00:06:04.273 INFO:teuthology.orchestra.run.smithi114.stdout:(18/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 12 MB/s | 43 MB 00:03 2024-05-09T00:06:04.323 INFO:teuthology.orchestra.run.smithi114.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 924 kB/s | 45 kB 00:00 2024-05-09T00:06:04.390 INFO:teuthology.orchestra.run.smithi114.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 2.0 MB/s | 135 kB 00:00 2024-05-09T00:06:04.440 INFO:teuthology.orchestra.run.smithi114.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 3.2 MB/s | 161 kB 00:00 2024-05-09T00:06:04.497 INFO:teuthology.orchestra.run.smithi153.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 126 kB/s | 107 kB 00:00 2024-05-09T00:06:04.499 INFO:teuthology.orchestra.run.smithi114.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 5.4 MB/s | 322 kB 00:00 2024-05-09T00:06:04.558 INFO:teuthology.orchestra.run.smithi114.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 5.1 MB/s | 300 kB 00:00 2024-05-09T00:06:04.564 INFO:teuthology.orchestra.run.smithi153.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 667 kB/s | 689 kB 00:01 2024-05-09T00:06:04.608 INFO:teuthology.orchestra.run.smithi114.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 2.0 MB/s | 99 kB 00:00 2024-05-09T00:06:04.622 INFO:teuthology.orchestra.run.smithi153.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 905 kB/s | 943 kB 00:01 2024-05-09T00:06:04.658 INFO:teuthology.orchestra.run.smithi114.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.7 MB/s | 86 kB 00:00 2024-05-09T00:06:04.884 INFO:teuthology.orchestra.run.smithi114.stdout:(26/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 14 MB/s | 3.0 MB 00:00 2024-05-09T00:06:04.992 INFO:teuthology.orchestra.run.smithi114.stdout:(27/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 2.4 MB/s | 5.2 MB 00:02 2024-05-09T00:06:05.026 INFO:teuthology.orchestra.run.smithi114.stdout:(28/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 1.2 MB/s | 169 kB 00:00 2024-05-09T00:06:05.060 INFO:teuthology.orchestra.run.smithi114.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3594.g 520 kB/s | 34 kB 00:00 2024-05-09T00:06:05.093 INFO:teuthology.orchestra.run.smithi114.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 2.1 MB/s | 142 kB 00:00 2024-05-09T00:06:05.148 INFO:teuthology.orchestra.run.smithi153.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 33 kB/s | 21 kB 00:00 2024-05-09T00:06:05.323 INFO:teuthology.orchestra.run.smithi153.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 47 kB/s | 33 kB 00:00 2024-05-09T00:06:05.482 INFO:teuthology.orchestra.run.smithi153.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 342 kB/s | 313 kB 00:00 2024-05-09T00:06:05.569 INFO:teuthology.orchestra.run.smithi114.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-05-09T00:06:05.627 INFO:teuthology.orchestra.run.smithi114.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 4.7 MB/s | 274 kB 00:00 2024-05-09T00:06:05.677 INFO:teuthology.orchestra.run.smithi114.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 1.0 MB/s | 49 kB 00:00 2024-05-09T00:06:05.728 INFO:teuthology.orchestra.run.smithi114.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 335 kB/s | 16 kB 00:00 2024-05-09T00:06:05.786 INFO:teuthology.orchestra.run.smithi114.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 4.6 MB/s | 273 kB 00:00 2024-05-09T00:06:05.879 INFO:teuthology.orchestra.run.smithi114.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 8.2 MB/s | 764 kB 00:00 2024-05-09T00:06:05.965 INFO:teuthology.orchestra.run.smithi153.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 28 kB/s | 18 kB 00:00 2024-05-09T00:06:06.090 INFO:teuthology.orchestra.run.smithi153.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 18 kB/s | 11 kB 00:00 2024-05-09T00:06:06.146 INFO:teuthology.orchestra.run.smithi114.stdout:(37/156): ceph-common-19.0.0-3594.gc9da4049.el9 1.8 MB/s | 20 MB 00:10 2024-05-09T00:06:06.171 INFO:teuthology.orchestra.run.smithi114.stdout:(38/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 63 kB/s | 18 kB 00:00 2024-05-09T00:06:06.238 INFO:teuthology.orchestra.run.smithi114.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 887 kB/s | 80 kB 00:00 2024-05-09T00:06:06.296 INFO:teuthology.orchestra.run.smithi114.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-05-09T00:06:06.338 INFO:teuthology.orchestra.run.smithi114.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-05-09T00:06:06.447 INFO:teuthology.orchestra.run.smithi114.stdout:(42/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 2.6 MB/s | 3.5 MB 00:01 2024-05-09T00:06:06.489 INFO:teuthology.orchestra.run.smithi114.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-09T00:06:06.531 INFO:teuthology.orchestra.run.smithi114.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-05-09T00:06:06.558 INFO:teuthology.orchestra.run.smithi153.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-05-09T00:06:06.581 INFO:teuthology.orchestra.run.smithi114.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-05-09T00:06:06.631 INFO:teuthology.orchestra.run.smithi114.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-05-09T00:06:06.657 INFO:teuthology.orchestra.run.smithi114.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-09T00:06:06.707 INFO:teuthology.orchestra.run.smithi114.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-05-09T00:06:06.800 INFO:teuthology.orchestra.run.smithi153.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 64 kB/s | 45 kB 00:00 2024-05-09T00:06:06.849 INFO:teuthology.orchestra.run.smithi114.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 759 kB/s | 107 kB 00:00 2024-05-09T00:06:06.908 INFO:teuthology.orchestra.run.smithi114.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 374 kB/s | 21 kB 00:00 2024-05-09T00:06:06.908 INFO:teuthology.orchestra.run.smithi153.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 170 kB/s | 160 kB 00:00 2024-05-09T00:06:06.958 INFO:teuthology.orchestra.run.smithi114.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-05-09T00:06:07.016 INFO:teuthology.orchestra.run.smithi114.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-09T00:06:07.058 INFO:teuthology.orchestra.run.smithi114.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-05-09T00:06:07.083 INFO:teuthology.orchestra.run.smithi114.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 262 kB/s | 33 kB 00:00 2024-05-09T00:06:07.142 INFO:teuthology.orchestra.run.smithi114.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 193 kB/s | 11 kB 00:00 2024-05-09T00:06:07.167 INFO:teuthology.orchestra.run.smithi114.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 220 kB/s | 18 kB 00:00 2024-05-09T00:06:07.201 INFO:teuthology.orchestra.run.smithi114.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-09T00:06:07.227 INFO:teuthology.orchestra.run.smithi114.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 781 kB/s | 45 kB 00:00 2024-05-09T00:06:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-05-09T00:06:07.394 INFO:teuthology.orchestra.run.smithi114.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 3.4 MB/s | 582 kB 00:00 2024-05-09T00:06:07.419 INFO:teuthology.orchestra.run.smithi114.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 440 kB/s | 25 kB 00:00 2024-05-09T00:06:07.452 INFO:teuthology.orchestra.run.smithi114.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-05-09T00:06:07.503 INFO:teuthology.orchestra.run.smithi114.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-05-09T00:06:07.550 INFO:teuthology.orchestra.run.smithi153.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 40 kB/s | 25 kB 00:00 2024-05-09T00:06:07.561 INFO:teuthology.orchestra.run.smithi114.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-09T00:06:07.587 INFO:teuthology.orchestra.run.smithi114.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 425 kB/s | 35 kB 00:00 2024-05-09T00:06:07.662 INFO:teuthology.orchestra.run.smithi114.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.6 MB/s | 3.0 MB 00:00 2024-05-09T00:06:07.675 INFO:teuthology.orchestra.run.smithi153.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 594 kB/s | 662 kB 00:01 2024-05-09T00:06:07.867 INFO:teuthology.orchestra.run.smithi153.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 586 kB/s | 582 kB 00:00 2024-05-09T00:06:07.946 INFO:teuthology.orchestra.run.smithi114.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-05-09T00:06:08.137 INFO:teuthology.orchestra.run.smithi114.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 4.7 MB/s | 911 kB 00:00 2024-05-09T00:06:08.196 INFO:teuthology.orchestra.run.smithi114.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-05-09T00:06:08.355 INFO:teuthology.orchestra.run.smithi114.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 6.0 MB/s | 4.7 MB 00:00 2024-05-09T00:06:08.409 INFO:teuthology.orchestra.run.smithi153.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 55 kB/s | 47 kB 00:00 2024-05-09T00:06:08.572 INFO:teuthology.orchestra.run.smithi114.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-05-09T00:06:08.614 INFO:teuthology.orchestra.run.smithi114.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-05-09T00:06:08.647 INFO:teuthology.orchestra.run.smithi114.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-05-09T00:06:08.734 INFO:teuthology.orchestra.run.smithi153.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 277 kB/s | 292 kB 00:01 2024-05-09T00:06:08.739 INFO:teuthology.orchestra.run.smithi114.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-09T00:06:08.826 INFO:teuthology.orchestra.run.smithi153.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 212 kB/s | 188 kB 00:00 2024-05-09T00:06:08.856 INFO:teuthology.orchestra.run.smithi114.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-09T00:06:08.907 INFO:teuthology.orchestra.run.smithi114.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 521 kB/s | 26 kB 00:00 2024-05-09T00:06:08.965 INFO:teuthology.orchestra.run.smithi114.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 333 kB/s | 19 kB 00:00 2024-05-09T00:06:09.032 INFO:teuthology.orchestra.run.smithi114.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-05-09T00:06:09.082 INFO:teuthology.orchestra.run.smithi114.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 706 kB/s | 35 kB 00:00 2024-05-09T00:06:09.084 INFO:teuthology.orchestra.run.smithi153.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 52 kB/s | 35 kB 00:00 2024-05-09T00:06:09.233 INFO:teuthology.orchestra.run.smithi114.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-05-09T00:06:09.300 INFO:teuthology.orchestra.run.smithi114.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-09T00:06:09.375 INFO:teuthology.orchestra.run.smithi114.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-05-09T00:06:09.434 INFO:teuthology.orchestra.run.smithi114.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-09T00:06:09.551 INFO:teuthology.orchestra.run.smithi114.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.4 MB/s | 6.0 MB 00:00 2024-05-09T00:06:09.576 INFO:teuthology.orchestra.run.smithi114.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 299 kB/s | 42 kB 00:00 2024-05-09T00:06:09.618 INFO:teuthology.orchestra.run.smithi114.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-09T00:06:09.651 INFO:teuthology.orchestra.run.smithi114.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-09T00:06:09.702 INFO:teuthology.orchestra.run.smithi114.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-05-09T00:06:09.727 INFO:teuthology.orchestra.run.smithi114.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 685 kB/s | 51 kB 00:00 2024-05-09T00:06:09.761 INFO:teuthology.orchestra.run.smithi114.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 930 kB/s | 54 kB 00:00 2024-05-09T00:06:09.819 INFO:teuthology.orchestra.run.smithi114.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 724 kB/s | 42 kB 00:00 2024-05-09T00:06:09.878 INFO:teuthology.orchestra.run.smithi114.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 768 kB/s | 44 kB 00:00 2024-05-09T00:06:09.945 INFO:teuthology.orchestra.run.smithi114.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-09T00:06:10.035 INFO:teuthology.orchestra.run.smithi153.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.6 MB/s | 4.7 MB 00:01 2024-05-09T00:06:10.078 INFO:teuthology.orchestra.run.smithi114.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.1 MB/s | 5.1 MB 00:00 2024-05-09T00:06:10.104 INFO:teuthology.orchestra.run.smithi114.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 227 kB/s | 36 kB 00:00 2024-05-09T00:06:10.137 INFO:teuthology.orchestra.run.smithi114.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-05-09T00:06:10.196 INFO:teuthology.orchestra.run.smithi114.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-05-09T00:06:10.221 INFO:teuthology.orchestra.run.smithi114.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 699 kB/s | 58 kB 00:00 2024-05-09T00:06:10.255 INFO:teuthology.orchestra.run.smithi114.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-09T00:06:10.280 INFO:teuthology.orchestra.run.smithi114.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-09T00:06:10.293 INFO:teuthology.orchestra.run.smithi153.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-05-09T00:06:10.364 INFO:teuthology.orchestra.run.smithi114.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 414 kB/s | 45 kB 00:00 2024-05-09T00:06:10.389 INFO:teuthology.orchestra.run.smithi114.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-05-09T00:06:10.419 INFO:teuthology.orchestra.run.smithi153.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2024-05-09T00:06:10.498 INFO:teuthology.orchestra.run.smithi114.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.4 MB/s | 863 kB 00:00 2024-05-09T00:06:10.573 INFO:teuthology.orchestra.run.smithi114.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.9 MB/s | 548 kB 00:00 2024-05-09T00:06:10.615 INFO:teuthology.orchestra.run.smithi114.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-05-09T00:06:10.657 INFO:teuthology.orchestra.run.smithi114.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.9 MB/s | 309 kB 00:00 2024-05-09T00:06:10.699 INFO:teuthology.orchestra.run.smithi114.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 631 kB/s | 26 kB 00:00 2024-05-09T00:06:10.741 INFO:teuthology.orchestra.run.smithi114.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-05-09T00:06:10.792 INFO:teuthology.orchestra.run.smithi114.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-09T00:06:10.858 INFO:teuthology.orchestra.run.smithi114.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-09T00:06:10.959 INFO:teuthology.orchestra.run.smithi114.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-09T00:06:11.026 INFO:teuthology.orchestra.run.smithi114.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-05-09T00:06:11.076 INFO:teuthology.orchestra.run.smithi114.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-05-09T00:06:11.101 INFO:teuthology.orchestra.run.smithi114.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 583 kB/s | 43 kB 00:00 2024-05-09T00:06:11.127 INFO:teuthology.orchestra.run.smithi114.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 650 kB/s | 32 kB 00:00 2024-05-09T00:06:11.143 INFO:teuthology.orchestra.run.smithi114.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 365 kB/s | 15 kB 00:00 2024-05-09T00:06:11.160 INFO:teuthology.orchestra.run.smithi153.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 811 kB/s | 911 kB 00:01 2024-05-09T00:06:11.179 INFO:teuthology.orchestra.run.smithi114.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-05-09T00:06:11.194 INFO:teuthology.orchestra.run.smithi153.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 159 kB/s | 133 kB 00:00 2024-05-09T00:06:11.219 INFO:teuthology.orchestra.run.smithi114.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-09T00:06:11.253 INFO:teuthology.orchestra.run.smithi114.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-05-09T00:06:11.278 INFO:teuthology.orchestra.run.smithi114.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 611 kB/s | 35 kB 00:00 2024-05-09T00:06:11.311 INFO:teuthology.orchestra.run.smithi114.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-05-09T00:06:11.353 INFO:teuthology.orchestra.run.smithi114.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-09T00:06:11.395 INFO:teuthology.orchestra.run.smithi114.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 262 kB/s | 11 kB 00:00 2024-05-09T00:06:11.429 INFO:teuthology.orchestra.run.smithi114.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 544 kB/s | 18 kB 00:00 2024-05-09T00:06:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 402 kB/s | 23 kB 00:00 2024-05-09T00:06:11.555 INFO:teuthology.orchestra.run.smithi114.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-05-09T00:06:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2024-05-09T00:06:11.786 INFO:teuthology.orchestra.run.smithi153.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.2 MB/s | 5.8 MB 00:01 2024-05-09T00:06:11.798 INFO:teuthology.orchestra.run.smithi114.stdout:(128/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.9 MB/s | 16 MB 00:02 2024-05-09T00:06:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 81 kB/s | 20 kB 00:00 2024-05-09T00:06:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-05-09T00:06:11.906 INFO:teuthology.orchestra.run.smithi114.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 429 kB/s | 46 kB 00:00 2024-05-09T00:06:11.931 INFO:teuthology.orchestra.run.smithi114.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 730 kB/s | 79 kB 00:00 2024-05-09T00:06:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-05-09T00:06:11.969 INFO:teuthology.orchestra.run.smithi153.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 113 kB/s | 87 kB 00:00 2024-05-09T00:06:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 332 kB/s | 16 kB 00:00 2024-05-09T00:06:12.008 INFO:teuthology.orchestra.run.smithi114.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-09T00:06:12.033 INFO:teuthology.orchestra.run.smithi114.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 570 kB/s | 28 kB 00:00 2024-05-09T00:06:12.058 INFO:teuthology.orchestra.run.smithi114.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2024-05-09T00:06:12.091 INFO:teuthology.orchestra.run.smithi114.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-05-09T00:06:12.117 INFO:teuthology.orchestra.run.smithi114.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-09T00:06:12.142 INFO:teuthology.orchestra.run.smithi114.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 720 kB/s | 36 kB 00:00 2024-05-09T00:06:12.167 INFO:teuthology.orchestra.run.smithi114.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-09T00:06:12.193 INFO:teuthology.orchestra.run.smithi114.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-05-09T00:06:12.218 INFO:teuthology.orchestra.run.smithi114.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-05-09T00:06:12.252 INFO:teuthology.orchestra.run.smithi114.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-09T00:06:12.277 INFO:teuthology.orchestra.run.smithi114.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-05-09T00:06:12.310 INFO:teuthology.orchestra.run.smithi114.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-05-09T00:06:12.328 INFO:teuthology.orchestra.run.smithi153.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 886 kB/s | 1.0 MB 00:01 2024-05-09T00:06:12.335 INFO:teuthology.orchestra.run.smithi114.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-09T00:06:12.428 INFO:teuthology.orchestra.run.smithi114.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-09T00:06:12.586 INFO:teuthology.orchestra.run.smithi114.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-05-09T00:06:12.662 INFO:teuthology.orchestra.run.smithi114.stdout:(150/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 9.5 MB/s | 3.1 MB 00:00 2024-05-09T00:06:12.720 INFO:teuthology.orchestra.run.smithi114.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 729 kB/s | 42 kB 00:00 2024-05-09T00:06:12.787 INFO:teuthology.orchestra.run.smithi114.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 9.1 MB/s | 1.8 MB 00:00 2024-05-09T00:06:12.837 INFO:teuthology.orchestra.run.smithi114.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.1 MB/s | 248 kB 00:00 2024-05-09T00:06:12.929 INFO:teuthology.orchestra.run.smithi114.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 9.6 MB/s | 1.3 MB 00:00 2024-05-09T00:06:13.046 INFO:teuthology.orchestra.run.smithi114.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-09T00:06:13.053 INFO:teuthology.orchestra.run.smithi153.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 226 kB/s | 244 kB 00:01 2024-05-09T00:06:13.279 INFO:teuthology.orchestra.run.smithi153.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-05-09T00:06:13.312 INFO:teuthology.orchestra.run.smithi153.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 272 kB/s | 248 kB 00:00 2024-05-09T00:06:13.438 INFO:teuthology.orchestra.run.smithi114.stdout:(156/156): librados2-19.0.0-3594.gc9da4049.el9. 3.0 MB/s | 3.3 MB 00:01 2024-05-09T00:06:13.445 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:06:13.445 INFO:teuthology.orchestra.run.smithi114.stdout:Total 12 MB/s | 219 MB 00:18 2024-05-09T00:06:13.846 INFO:teuthology.orchestra.run.smithi153.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 32 kB/s | 26 kB 00:00 2024-05-09T00:06:13.863 INFO:teuthology.orchestra.run.smithi153.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 33 kB/s | 19 kB 00:00 2024-05-09T00:06:14.221 INFO:teuthology.orchestra.run.smithi153.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 189 kB/s | 172 kB 00:00 2024-05-09T00:06:14.555 INFO:teuthology.orchestra.run.smithi153.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 49 kB/s | 35 kB 00:00 2024-05-09T00:06:15.113 INFO:teuthology.orchestra.run.smithi153.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 282 kB/s | 250 kB 00:00 2024-05-09T00:06:15.364 INFO:teuthology.orchestra.run.smithi153.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.4 MB/s | 5.1 MB 00:01 2024-05-09T00:06:15.464 INFO:teuthology.orchestra.run.smithi153.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 245 kB/s | 222 kB 00:00 2024-05-09T00:06:15.914 INFO:teuthology.orchestra.run.smithi153.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 97 kB/s | 77 kB 00:00 2024-05-09T00:06:16.114 INFO:teuthology.orchestra.run.smithi153.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 62 kB/s | 42 kB 00:00 2024-05-09T00:06:16.356 INFO:teuthology.orchestra.run.smithi153.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 302 kB/s | 269 kB 00:00 2024-05-09T00:06:16.479 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-05-09T00:06:16.717 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-05-09T00:06:16.717 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-05-09T00:06:16.731 INFO:teuthology.orchestra.run.smithi153.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 195 kB/s | 159 kB 00:00 2024-05-09T00:06:17.056 INFO:teuthology.orchestra.run.smithi153.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 73 kB/s | 51 kB 00:00 2024-05-09T00:06:17.082 INFO:teuthology.orchestra.run.smithi153.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 288 kB/s | 279 kB 00:00 2024-05-09T00:06:17.424 INFO:teuthology.orchestra.run.smithi153.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 78 kB/s | 54 kB 00:00 2024-05-09T00:06:17.774 INFO:teuthology.orchestra.run.smithi153.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 60 kB/s | 42 kB 00:00 2024-05-09T00:06:18.116 INFO:teuthology.orchestra.run.smithi153.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 64 kB/s | 44 kB 00:00 2024-05-09T00:06:18.656 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-05-09T00:06:18.656 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-05-09T00:06:18.708 INFO:teuthology.orchestra.run.smithi153.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 237 kB/s | 221 kB 00:00 2024-05-09T00:06:18.917 INFO:teuthology.orchestra.run.smithi153.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.7 MB/s | 16 MB 00:01 2024-05-09T00:06:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 43 kB/s | 36 kB 00:00 2024-05-09T00:06:19.658 INFO:teuthology.orchestra.run.smithi153.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 50 kB/s | 47 kB 00:00 2024-05-09T00:06:19.759 INFO:teuthology.orchestra.run.smithi153.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 72 kB/s | 58 kB 00:00 2024-05-09T00:06:19.884 INFO:teuthology.orchestra.run.smithi153.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 316 kB/s | 305 kB 00:00 2024-05-09T00:06:20.501 INFO:teuthology.orchestra.run.smithi153.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 111 kB/s | 94 kB 00:00 2024-05-09T00:06:20.543 INFO:teuthology.orchestra.run.smithi153.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 81 kB/s | 64 kB 00:00 2024-05-09T00:06:20.568 INFO:teuthology.orchestra.run.smithi153.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 66 kB/s | 45 kB 00:00 2024-05-09T00:06:20.594 INFO:teuthology.orchestra.run.smithi153.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 246 kB/s | 22 kB 00:00 2024-05-09T00:06:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-05-09T00:06:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2024-05-09T00:06:21.386 INFO:teuthology.orchestra.run.smithi153.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 390 kB/s | 309 kB 00:00 2024-05-09T00:06:21.420 INFO:teuthology.orchestra.run.smithi153.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 645 kB/s | 548 kB 00:00 2024-05-09T00:06:21.445 INFO:teuthology.orchestra.run.smithi153.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 451 kB/s | 26 kB 00:00 2024-05-09T00:06:21.470 INFO:teuthology.orchestra.run.smithi153.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2024-05-09T00:06:21.495 INFO:teuthology.orchestra.run.smithi153.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-09T00:06:21.762 INFO:teuthology.orchestra.run.smithi153.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-05-09T00:06:21.896 INFO:teuthology.orchestra.run.smithi153.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 356 kB/s | 151 kB 00:00 2024-05-09T00:06:21.987 INFO:teuthology.orchestra.run.smithi153.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-05-09T00:06:22.030 INFO:teuthology.orchestra.run.smithi153.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 327 kB/s | 43 kB 00:00 2024-05-09T00:06:22.055 INFO:teuthology.orchestra.run.smithi153.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 478 kB/s | 32 kB 00:00 2024-05-09T00:06:22.097 INFO:teuthology.orchestra.run.smithi153.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 227 kB/s | 15 kB 00:00 2024-05-09T00:06:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.0 MB/s | 172 kB 00:00 2024-05-09T00:06:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:(118/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 848 kB/s | 303 kB 00:00 2024-05-09T00:06:22.723 INFO:teuthology.orchestra.run.smithi153.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-05-09T00:06:22.756 INFO:teuthology.orchestra.run.smithi153.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 545 kB/s | 358 kB 00:00 2024-05-09T00:06:22.782 INFO:teuthology.orchestra.run.smithi153.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 177 kB/s | 35 kB 00:00 2024-05-09T00:06:22.916 INFO:teuthology.orchestra.run.smithi153.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-09T00:06:22.949 INFO:teuthology.orchestra.run.smithi153.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 329 kB/s | 11 kB 00:00 2024-05-09T00:06:22.991 INFO:teuthology.orchestra.run.smithi153.stdout:(124/156): python3-google-auth-2.29.0-1.el9.noa 771 kB/s | 206 kB 00:00 2024-05-09T00:06:23.008 INFO:teuthology.orchestra.run.smithi153.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-05-09T00:06:23.050 INFO:teuthology.orchestra.run.smithi153.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 402 kB/s | 23 kB 00:00 2024-05-09T00:06:23.075 INFO:teuthology.orchestra.run.smithi153.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 293 kB/s | 19 kB 00:00 2024-05-09T00:06:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 397 kB/s | 20 kB 00:00 2024-05-09T00:06:23.184 INFO:teuthology.orchestra.run.smithi153.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 562 kB/s | 46 kB 00:00 2024-05-09T00:06:23.293 INFO:teuthology.orchestra.run.smithi153.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 734 kB/s | 79 kB 00:00 2024-05-09T00:06:23.368 INFO:teuthology.orchestra.run.smithi153.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 779 kB/s | 58 kB 00:00 2024-05-09T00:06:23.560 INFO:teuthology.orchestra.run.smithi153.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 2.1 MB/s | 1.0 MB 00:00 2024-05-09T00:06:23.602 INFO:teuthology.orchestra.run.smithi153.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 402 kB/s | 16 kB 00:00 2024-05-09T00:06:23.652 INFO:teuthology.orchestra.run.smithi153.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 962 kB/s | 272 kB 00:00 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi153.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-09T00:06:23.719 INFO:teuthology.orchestra.run.smithi153.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 428 kB/s | 28 kB 00:00 2024-05-09T00:06:23.745 INFO:teuthology.orchestra.run.smithi153.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 465 kB/s | 31 kB 00:00 2024-05-09T00:06:23.812 INFO:teuthology.orchestra.run.smithi153.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 899 kB/s | 59 kB 00:00 2024-05-09T00:06:23.854 INFO:teuthology.orchestra.run.smithi153.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 879 kB/s | 36 kB 00:00 2024-05-09T00:06:23.912 INFO:teuthology.orchestra.run.smithi153.stdout:(140/156): python3-typing-extensions-4.4.0-2.el 890 kB/s | 51 kB 00:00 2024-05-09T00:06:23.937 INFO:teuthology.orchestra.run.smithi153.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 869 kB/s | 188 kB 00:00 2024-05-09T00:06:23.996 INFO:teuthology.orchestra.run.smithi153.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-09T00:06:24.105 INFO:teuthology.orchestra.run.smithi153.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-05-09T00:06:24.147 INFO:teuthology.orchestra.run.smithi153.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 490 kB/s | 20 kB 00:00 2024-05-09T00:06:24.197 INFO:teuthology.orchestra.run.smithi153.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.1 MB/s | 427 kB 00:00 2024-05-09T00:06:24.281 INFO:teuthology.orchestra.run.smithi153.stdout:(146/156): python3-grpcio-1.46.7-10.el9.x86_64. 1.4 MB/s | 2.0 MB 00:01 2024-05-09T00:06:24.348 INFO:teuthology.orchestra.run.smithi153.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 960 kB/s | 192 kB 00:00 2024-05-09T00:06:24.715 INFO:teuthology.orchestra.run.smithi153.stdout:(148/156): librados2-19.0.0-3594.gc9da4049.el9. 7.7 MB/s | 3.3 MB 00:00 2024-05-09T00:06:24.815 INFO:teuthology.orchestra.run.smithi153.stdout:(149/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-05-09T00:06:24.923 INFO:teuthology.orchestra.run.smithi153.stdout:(150/156): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-05-09T00:06:25.057 INFO:teuthology.orchestra.run.smithi153.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 315 kB/s | 42 kB 00:00 2024-05-09T00:06:25.088 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-05-09T00:06:25.124 INFO:teuthology.orchestra.run.smithi153.stdout:(152/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.7 MB/s | 2.3 MB 00:00 2024-05-09T00:06:25.177 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T00:06:25.191 INFO:teuthology.orchestra.run.smithi153.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 1.8 MB/s | 248 kB 00:00 2024-05-09T00:06:25.236 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T00:06:25.274 INFO:teuthology.orchestra.run.smithi153.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-05-09T00:06:25.320 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T00:06:25.324 INFO:teuthology.orchestra.run.smithi153.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 6.7 MB/s | 1.3 MB 00:00 2024-05-09T00:06:25.367 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T00:06:25.396 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T00:06:25.469 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T00:06:25.500 INFO:teuthology.orchestra.run.smithi153.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-05-09T00:06:25.511 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:06:25.511 INFO:teuthology.orchestra.run.smithi153.stdout:Total 7.0 MB/s | 219 MB 00:31 2024-05-09T00:06:25.866 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T00:06:25.970 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:06:26.150 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:06:26.185 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:06:26.314 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:06:26.345 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:06:26.556 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T00:06:26.625 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T00:06:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:06:26.822 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:06:26.851 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:06:26.936 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:06:26.969 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:06:27.039 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:06:27.329 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:06:27.508 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:06:27.721 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:06:27.805 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:06:27.951 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:06:28.053 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:06:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-05-09T00:06:28.567 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:06:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-05-09T00:06:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-05-09T00:06:28.871 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T00:06:28.909 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T00:06:28.963 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T00:06:29.070 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T00:06:29.113 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T00:06:29.173 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T00:06:29.215 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T00:06:29.248 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T00:06:29.357 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T00:06:29.426 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T00:06:29.458 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T00:06:29.511 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T00:06:29.609 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T00:06:29.679 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T00:06:29.728 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T00:06:29.761 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T00:06:29.875 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T00:06:29.933 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T00:06:30.040 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T00:06:30.213 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T00:06:30.292 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T00:06:30.673 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-05-09T00:06:30.674 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-05-09T00:06:31.049 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T00:06:31.155 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T00:06:31.192 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T00:06:31.237 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T00:06:31.277 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T00:06:31.336 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T00:06:31.522 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T00:06:31.603 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T00:06:31.716 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T00:06:31.796 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T00:06:31.880 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T00:06:31.920 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T00:06:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T00:06:32.023 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T00:06:32.068 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T00:06:32.128 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T00:06:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T00:06:32.384 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T00:06:32.441 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T00:06:32.478 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T00:06:32.522 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T00:06:32.654 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T00:06:32.694 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T00:06:32.747 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T00:06:32.784 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T00:06:32.819 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T00:06:32.956 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T00:06:33.135 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T00:06:33.183 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T00:06:33.236 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T00:06:33.291 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T00:06:33.346 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T00:06:33.403 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T00:06:33.444 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T00:06:33.489 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T00:06:33.530 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T00:06:33.595 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T00:06:33.637 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T00:06:33.753 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T00:06:33.808 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T00:06:33.852 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T00:06:33.903 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T00:06:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T00:06:34.109 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T00:06:35.032 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T00:06:35.091 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T00:06:35.124 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T00:06:35.246 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T00:06:35.310 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T00:06:35.405 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T00:06:35.459 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T00:06:35.694 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T00:06:35.723 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T00:06:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T00:06:36.590 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T00:06:36.729 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T00:06:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-05-09T00:06:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T00:06:37.269 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T00:06:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T00:06:37.425 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T00:06:37.458 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T00:06:37.538 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T00:06:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T00:06:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:06:38.232 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T00:06:38.329 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T00:06:38.357 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:06:38.365 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T00:06:38.391 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:06:38.400 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T00:06:38.526 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:06:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:06:38.783 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T00:06:38.790 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T00:06:38.825 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:06:38.853 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T00:06:38.878 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:06:38.946 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:06:38.981 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T00:06:39.028 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:06:39.036 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T00:06:39.072 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:06:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:06:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:06:39.282 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:06:39.565 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:06:39.580 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T00:06:39.606 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:06:39.694 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:06:39.721 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T00:06:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:06:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:06:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:06:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:06:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:06:40.649 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:06:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T00:06:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T00:06:40.927 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T00:06:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T00:06:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T00:06:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T00:06:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T00:06:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T00:06:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T00:06:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T00:06:41.444 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T00:06:41.492 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T00:06:41.604 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T00:06:41.639 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T00:06:41.687 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T00:06:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T00:06:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T00:06:41.916 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T00:06:42.011 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T00:06:42.183 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T00:06:42.245 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T00:06:42.324 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:06:42.367 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:06:42.918 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T00:06:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:06:43.033 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T00:06:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:06:43.094 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T00:06:43.141 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T00:06:43.198 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T00:06:43.221 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:06:43.221 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T00:06:43.221 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T00:06:43.221 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:06:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T00:06:43.264 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:06:43.455 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T00:06:43.520 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T00:06:43.665 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T00:06:43.740 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T00:06:43.824 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T00:06:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T00:06:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T00:06:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T00:06:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T00:06:44.091 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T00:06:44.164 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T00:06:44.362 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T00:06:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T00:06:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T00:06:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T00:06:44.689 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T00:06:44.737 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T00:06:44.784 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T00:06:44.819 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T00:06:44.852 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T00:06:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T00:06:45.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T00:06:45.192 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T00:06:45.229 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T00:06:45.274 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T00:06:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T00:06:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T00:06:45.434 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T00:06:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T00:06:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T00:06:45.608 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T00:06:45.656 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T00:06:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T00:06:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T00:06:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T00:06:45.975 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T00:06:46.123 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T00:06:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T00:06:47.126 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T00:06:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T00:06:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T00:06:47.338 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T00:06:47.412 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T00:06:47.573 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T00:06:47.813 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T00:06:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T00:06:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T00:06:48.201 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T00:06:49.014 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T00:06:49.155 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T00:06:50.703 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T00:06:50.804 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T00:06:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T00:06:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T00:06:51.261 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T00:06:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:06:51.421 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:06:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T00:06:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T00:06:52.076 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T00:06:52.111 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:06:52.203 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:06:52.229 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T00:06:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:06:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:06:55.609 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:06:55.622 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:06:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-05-09T00:06:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-05-09T00:06:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-05-09T00:06:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-05-09T00:06:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-05-09T00:06:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2024-05-09T00:06:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-05-09T00:06:55.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:06:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:06:55.819 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:06:55.819 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T00:06:55.819 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T00:06:55.819 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:06:55.855 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:06:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:06:55.901 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:06:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:06:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T00:06:55.902 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:06:57.631 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:06:57.735 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:06:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:06:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T00:06:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:06:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:06:57.736 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:06:57.990 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:06:58.068 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:06:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:06:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T00:06:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:06:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:06:58.068 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:06:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:06:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:06:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:06:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T00:06:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:06:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:06:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:06:58.791 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T00:06:58.850 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T00:06:58.915 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T00:06:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T00:06:59.211 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T00:06:59.295 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T00:06:59.397 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T00:06:59.556 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T00:06:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T00:06:59.644 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T00:06:59.670 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T00:07:00.306 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:07:00.340 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:07:00.428 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T00:07:00.541 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T00:07:00.575 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:07:01.886 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:07:01.928 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:07:03.027 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:07:03.053 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:07:03.207 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:07:03.389 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T00:07:03.421 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:07:03.488 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:07:03.488 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:03.488 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T00:07:03.489 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:07:03.489 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:07:03.489 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:03.608 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:07:03.645 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:07:03.918 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T00:07:03.986 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T00:07:05.083 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T00:07:05.117 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:07:05.185 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:07:05.185 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:05.185 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T00:07:05.185 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:07:05.185 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:07:05.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:05.234 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:07:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:07:05.300 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:05.300 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T00:07:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:05.359 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:07:05.431 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:07:05.432 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:05.432 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T00:07:05.432 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:07:05.432 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:07:05.432 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:05.813 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:07:05.882 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:07:05.882 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:05.882 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T00:07:05.882 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:07:05.883 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:07:05.883 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:09.132 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:07:09.132 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-05-09T00:07:09.132 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-05-09T00:07:09.133 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-05-09T00:07:09.133 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-05-09T00:07:09.133 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-05-09T00:07:09.133 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-05-09T00:07:09.133 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-05-09T00:07:09.133 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:09.373 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:07:09.422 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:07:09.422 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:09.423 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T00:07:09.423 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:10.516 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T00:07:10.565 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T00:07:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T00:07:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T00:07:10.693 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T00:07:10.950 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T00:07:11.003 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T00:07:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T00:07:11.066 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T00:07:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:07:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T00:07:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:07:11.189 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:11.189 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T00:07:11.189 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:07:11.189 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:07:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:07:11.509 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:07:11.509 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:11.509 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T00:07:11.509 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:07:11.510 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:07:11.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:12.018 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:07:12.063 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:07:12.088 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:07:12.088 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:12.088 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T00:07:12.088 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:07:12.088 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:07:12.088 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:12.114 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:07:12.168 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:07:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T00:07:12.281 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T00:07:12.355 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T00:07:12.587 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T00:07:12.655 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T00:07:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T00:07:12.850 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T00:07:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T00:07:13.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T00:07:13.120 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T00:07:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T00:07:13.534 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T00:07:13.646 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T00:07:13.703 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T00:07:13.798 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:07:13.821 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T00:07:13.841 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:07:13.856 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T00:07:13.893 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T00:07:13.893 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:07:13.896 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T00:07:14.003 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:07:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T00:07:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:07:14.062 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T00:07:14.063 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:07:14.189 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:07:14.228 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T00:07:14.260 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:07:14.260 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:07:14.599 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:07:14.599 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:07:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:07:14.884 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:07:15.155 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:07:15.155 INFO:teuthology.orchestra.run.smithi114.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-09T00:07:15.156 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:15.363 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:07:15.411 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:07:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:07:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:07:16.718 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:07:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T00:07:16.938 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:07:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:07:17.038 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:17.038 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T00:07:17.038 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:07:17.038 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:07:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:07:17.135 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:07:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T00:07:17.312 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T00:07:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T00:07:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:07:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:07:18.496 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:18.497 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T00:07:18.497 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:07:18.497 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:07:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:18.559 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:07:18.654 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:07:18.654 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:18.654 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T00:07:18.654 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:18.726 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:07:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:07:18.803 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:18.803 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T00:07:18.803 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:07:18.803 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:07:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:19.210 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:07:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:07:19.289 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:07:19.289 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T00:07:19.289 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:07:19.290 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:07:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T00:07:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T00:07:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T00:07:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T00:07:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T00:07:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T00:07:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T00:07:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T00:07:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T00:07:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T00:07:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T00:07:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T00:07:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T00:07:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T00:07:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T00:07:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T00:07:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T00:07:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T00:07:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T00:07:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T00:07:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T00:07:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T00:07:23.251 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T00:07:23.252 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.254 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T00:07:23.255 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T00:07:23.256 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T00:07:23.257 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T00:07:23.258 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T00:07:23.258 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T00:07:23.258 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T00:07:23.258 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T00:07:23.258 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T00:07:23.258 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.261 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.261 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.261 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T00:07:23.261 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T00:07:23.262 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T00:07:23.263 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T00:07:23.264 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T00:07:23.265 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T00:07:23.266 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T00:07:23.267 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T00:07:23.267 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T00:07:23.267 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:23.267 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-05-09T00:07:23.908 DEBUG:teuthology.parallel:result is None 2024-05-09T00:07:23.957 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T00:07:23.998 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T00:07:24.044 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T00:07:24.081 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T00:07:24.117 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T00:07:24.365 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T00:07:24.420 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T00:07:24.449 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T00:07:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T00:07:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T00:07:25.452 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:07:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:07:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:07:26.972 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T00:07:27.079 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T00:07:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T00:07:27.255 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T00:07:27.298 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T00:07:27.335 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T00:07:27.335 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:07:27.462 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:07:27.510 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T00:07:27.510 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:07:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:07:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T00:07:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:07:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:07:28.057 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:07:28.057 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:07:28.202 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:07:28.343 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:07:28.599 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:07:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-09T00:07:28.599 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:07:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T00:07:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T00:07:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T00:07:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T00:07:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T00:07:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T00:07:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T00:07:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T00:07:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T00:07:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T00:07:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T00:07:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T00:07:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T00:07:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T00:07:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T00:07:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T00:07:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T00:07:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T00:07:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T00:07:36.271 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-05-09T00:07:36.272 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.274 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.275 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T00:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T00:07:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T00:07:36.278 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T00:07:36.279 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T00:07:36.280 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T00:07:36.281 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:07:36.282 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:36.283 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-05-09T00:07:36.901 DEBUG:teuthology.parallel:result is None 2024-05-09T00:07:36.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:07:37.047 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T00:07:37.115 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T00:07:37.116 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T00:07:37.116 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T00:07:37.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:07:37.333 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T00:07:37.392 INFO:teuthology.orchestra.run.smithi153.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T00:07:37.393 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T00:07:37.393 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T00:07:37.395 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T00:07:37.395 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:37.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T00:07:37.491 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:37.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T00:07:37.563 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T00:07:37.563 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:37.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T00:07:37.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T00:07:37.735 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:37.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T00:07:37.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T00:07:37.908 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T00:07:37.909 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:37.909 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T00:07:37.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T00:07:38.127 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:38.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T00:07:38.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T00:07:38.298 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T00:07:38.299 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:38.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T00:07:38.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T00:07:38.468 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:38.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T00:07:38.529 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T00:07:38.635 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T00:07:38.733 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T00:07:38.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-05-09T00:07:38.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-05-09T00:07:38.821 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T00:07:38.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T00:07:38.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T00:07:38.906 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T00:07:38.907 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T00:07:38.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T00:07:38.997 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T00:07:38.997 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T00:07:38.998 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T00:07:38.998 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:38.998 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T00:07:39.049 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T00:07:39.268 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T00:07:39.356 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:39.356 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T00:07:39.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T00:07:39.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T00:07:39.643 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T00:07:39.643 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T00:07:39.643 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867', 'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698867', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.183908-debug'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1722, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.183908-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWhdUXY19xtNbxreI4My4MKxoLIa3Rc7/wCp4aVW6B9w0U4Z+E/3oYbow7cJsvia9afu4fQWYo/EZRvxZA06fQ=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCYtquccB9FiW6UBPvstRR6RSIkZa9nURn1vlowsG+iahapR8sbE4S1ye9qlVkv9QEA2EmGveIleZl0GWs1s5CQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_22:06:20', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T00:07:39.644 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T00:07:39.651 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T00:07:39.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T00:07:39.708 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T00:07:39.804 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:39.804 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:07:39.857 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:07:39.857 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-09 00:07:15.591267160 +0000 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-09 00:05:00.334601241 +0000 2024-05-09T00:07:39.948 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-09 00:05:00.334601241 +0000 2024-05-09T00:07:39.949 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-05-09 00:05:00.334601241 +0000 2024-05-09T00:07:39.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:07:40.026 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-09T00:07:40.026 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-09T00:07:40.026 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.00037937 s, 1.3 MB/s 2024-05-09T00:07:40.029 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:07:40.084 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-05-09T00:07:40.132 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:07:40.132 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:40.132 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-09T00:07:40.132 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:40.132 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:40.132 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-09 00:07:15.592267139 +0000 2024-05-09T00:07:40.133 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-09 00:05:00.933588374 +0000 2024-05-09T00:07:40.133 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-09 00:05:00.933588374 +0000 2024-05-09T00:07:40.133 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-05-09 00:05:00.933588374 +0000 2024-05-09T00:07:40.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:07:40.203 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-09T00:07:40.203 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-09T00:07:40.203 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000343789 s, 1.5 MB/s 2024-05-09T00:07:40.206 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:07:40.258 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-05-09T00:07:40.304 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:07:40.304 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:40.304 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-05-09T00:07:40.304 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:40.304 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:40.305 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-09 00:07:15.592267139 +0000 2024-05-09T00:07:40.305 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-09 00:05:01.496576281 +0000 2024-05-09T00:07:40.305 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-09 00:05:01.496576281 +0000 2024-05-09T00:07:40.305 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-05-09 00:05:01.496576281 +0000 2024-05-09T00:07:40.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:07:40.380 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-09T00:07:40.380 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-09T00:07:40.381 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000342518 s, 1.5 MB/s 2024-05-09T00:07:40.384 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:07:40.441 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-05-09T00:07:40.486 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:07:40.486 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:40.486 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-09T00:07:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-09 00:07:15.593267117 +0000 2024-05-09T00:07:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-09 00:05:02.123562814 +0000 2024-05-09T00:07:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-09 00:05:02.123562814 +0000 2024-05-09T00:07:40.487 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-05-09 00:05:02.123562814 +0000 2024-05-09T00:07:40.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:07:40.609 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-09T00:07:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-09T00:07:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000383947 s, 1.3 MB/s 2024-05-09T00:07:40.613 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:07:40.666 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T00:07:40.666 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:40.667 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:07:40.716 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:07:40.717 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-05-09T00:07:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:07:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-09 00:07:29.011545100 +0000 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-09 00:04:59.371306770 +0000 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-09 00:04:59.371306770 +0000 2024-05-09T00:07:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-09 00:04:59.371306770 +0000 2024-05-09T00:07:40.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:07:40.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-09T00:07:40.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-09T00:07:40.921 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00043297 s, 1.2 MB/s 2024-05-09T00:07:40.924 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:07:40.978 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 649 Links: 1 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-09 00:07:29.012545082 +0000 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-09 00:04:59.954296589 +0000 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-09 00:04:59.954296589 +0000 2024-05-09T00:07:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-09 00:04:59.954296589 +0000 2024-05-09T00:07:41.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:07:41.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-09T00:07:41.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-09T00:07:41.103 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000308379 s, 1.7 MB/s 2024-05-09T00:07:41.106 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:07:41.161 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-05-09T00:07:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:07:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:41.210 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 666 Links: 1 2024-05-09T00:07:41.210 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:41.210 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:41.210 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-09 00:07:29.012545082 +0000 2024-05-09T00:07:41.211 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-09 00:05:00.536286428 +0000 2024-05-09T00:07:41.211 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-09 00:05:00.536286428 +0000 2024-05-09T00:07:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-09 00:05:00.536286428 +0000 2024-05-09T00:07:41.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:07:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-09T00:07:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-09T00:07:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000351391 s, 1.5 MB/s 2024-05-09T00:07:41.291 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:07:41.345 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 686 Links: 1 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-09 00:07:29.013545065 +0000 2024-05-09T00:07:41.389 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-09 00:05:01.149275726 +0000 2024-05-09T00:07:41.390 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-09 00:05:01.149275726 +0000 2024-05-09T00:07:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-09 00:05:01.149275726 +0000 2024-05-09T00:07:41.390 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:07:41.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-09T00:07:41.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-09T00:07:41.514 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000342882 s, 1.5 MB/s 2024-05-09T00:07:41.518 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:07:41.571 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T00:07:41.571 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T00:07:41.571 INFO:tasks.ceph:Generating config... 2024-05-09T00:07:41.572 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-09T00:07:41.572 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-09T00:07:41.573 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T00:07:41.573 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T00:07:41.573 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-09T00:07:41.573 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-09T00:07:41.573 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-09T00:07:41.573 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T00:07:41.574 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T00:07:41.575 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T00:07:41.575 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T00:07:41.575 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T00:07:41.575 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-09T00:07:41.575 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T00:07:41.575 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T00:07:41.576 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-09T00:07:41.577 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T00:07:41.577 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-09T00:07:41.577 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T00:07:41.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T00:07:41.790 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T00:07:41.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T00:07:42.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T00:07:42.083 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]')] 2024-05-09T00:07:42.083 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-09T00:07:42.084 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:42.084 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T00:07:42.137 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:42.312 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:42.312 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid 3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae 2024-05-09T00:07:42.312 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = quincy 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:fsid 3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2024-05-09T00:07:42.318215+0000 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:created 2024-05-09T00:07:42.318215+0000 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 17 (quincy) 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-05-09T00:07:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T00:07:42.326 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T00:07:42.379 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae... 2024-05-09T00:07:42.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T00:07:42.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T00:07:42.517 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-05-09T00:07:42.517 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-05-09T00:07:42.517 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T00:07:42.517 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-05-09T00:07:42.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T00:07:42.519 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae 2024-05-09T00:07:42.520 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-05-09T00:07:42.521 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-05-09T00:07:42.522 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: filestore flush min = 0 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: mon client directed command retry = 5 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject delay max = 1 2024-05-09T00:07:42.523 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject delay probability = 0.005 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject delay type = client mds 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject socket failures = 2500 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: osd blocked scrub grace period = 3600 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: osd max markdown count = 1000 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-05-09T00:07:42.524 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-05-09T00:07:42.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: mon down mkfs grace = 300 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-05-09T00:07:42.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: client_shutdown_timeout = 120 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-05-09T00:07:42.527 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-05-09T00:07:42.528 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: mds bal fragment size max = 10000 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: mds bal merge size = 5 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: mds bal split bits = 3 2024-05-09T00:07:42.529 INFO:teuthology.orchestra.run.smithi114.stdout: mds bal split size = 100 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: mon client directed command retry = 5 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject delay max = 1 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject delay probability = 0.005 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject delay type = client mds osd 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: ms inject socket failures = 2500 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-05-09T00:07:42.530 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-05-09T00:07:42.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-05-09T00:07:42.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-05-09T00:07:42.533 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.114,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-05-09T00:07:42.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.535 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-05-09T00:07:42.536 INFO:teuthology.orchestra.run.smithi153.stdout: filestore flush min = 0 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon client directed command retry = 5 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject delay max = 1 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject delay probability = 0.005 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject delay type = client mds 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject socket failures = 2500 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd blocked scrub grace period = 3600 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd max markdown count = 1000 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-05-09T00:07:42.537 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-05-09T00:07:42.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-05-09T00:07:42.539 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: client_shutdown_timeout = 120 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-05-09T00:07:42.540 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: mds bal fragment size max = 10000 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: mds bal merge size = 5 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: mds bal split bits = 3 2024-05-09T00:07:42.541 INFO:teuthology.orchestra.run.smithi153.stdout: mds bal split size = 100 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: mon client directed command retry = 5 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject delay max = 1 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject delay probability = 0.005 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject delay type = client mds osd 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject socket failures = 2500 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-05-09T00:07:42.542 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-05-09T00:07:42.562 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T00:07:42.562 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T00:07:42.772 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T00:07:42.772 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:42.772 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T00:07:42.823 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:42.823 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T00:07:42.875 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:07:42.875 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:42.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T00:07:42.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T00:07:42.996 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:07:42.997 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:43.093 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:07:43.093 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:43.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T00:07:43.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T00:07:43.214 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:07:43.215 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:43.313 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T00:07:43.313 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T00:07:43.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T00:07:43.536 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T00:07:43.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T00:07:43.790 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T00:07:43.808 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T00:07:43.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T00:07:44.049 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T00:07:44.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T00:07:44.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T00:07:44.358 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T00:07:44.374 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-09T00:07:44.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T00:07:44.694 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T00:07:44.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T00:07:44.786 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T00:07:44.989 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T00:07:45.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-09T00:07:45.080 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T00:07:45.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T00:07:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T00:07:45.323 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T00:07:45.514 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-09T00:07:45.563 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T00:07:45.564 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T00:07:45.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T00:07:45.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T00:07:45.652 INFO:tasks.ceph:role: osd.0 2024-05-09T00:07:45.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:07:45.652 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T00:07:45.739 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:07:45.739 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:07:45.739 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:07:45.739 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:07:45.740 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:07:45.740 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:07:45.740 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:07:45.740 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:07:45.740 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:07:45.740 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:07:46.164 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-09T00:07:46.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-09T00:07:46.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T00:07:46.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T00:07:46.421 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T00:07:46.497 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T00:07:46.497 INFO:tasks.ceph:role: osd.1 2024-05-09T00:07:46.497 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:07:46.498 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:07:46.577 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:07:46.578 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:07:46.578 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:07:46.932 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-09T00:07:46.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-09T00:07:46.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T00:07:47.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T00:07:47.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T00:07:47.201 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T00:07:47.202 INFO:tasks.ceph:role: osd.2 2024-05-09T00:07:47.202 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:07:47.202 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:07:47.278 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:07:47.279 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:07:47.660 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-09T00:07:47.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-09T00:07:47.667 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T00:07:47.782 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T00:07:47.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T00:07:47.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T00:07:47.913 INFO:tasks.ceph:role: osd.3 2024-05-09T00:07:47.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:07:47.913 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:07:47.992 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:07:47.993 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:07:47.993 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:07:48.401 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-09T00:07:48.407 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-09T00:07:48.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T00:07:48.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T00:07:48.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:48.859+0000 7f4f37a63640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T00:07:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:48.860+0000 7f4f37a63640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T00:07:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:48.860+0000 7f4f37a63640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T00:07:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:48.860+0000 7f4f37a63640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T00:07:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:48.860+0000 7f4f37a63640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T00:07:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:48.863+0000 7f4f37a63640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T00:07:52.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T00:07:52.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:52.376+0000 7f5d25e9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T00:07:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:52.376+0000 7f5d25e9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T00:07:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:52.376+0000 7f5d25e9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T00:07:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:52.376+0000 7f5d25e9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T00:07:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:52.376+0000 7f5d25e9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T00:07:52.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:52.379+0000 7f5d25e9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T00:07:55.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T00:07:55.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:55.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:55.648+0000 7fbf8b418640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T00:07:55.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:55.649+0000 7fbf8b418640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T00:07:55.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:55.649+0000 7fbf8b418640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T00:07:55.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:55.649+0000 7fbf8b418640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T00:07:55.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:55.649+0000 7fbf8b418640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T00:07:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:55.651+0000 7fbf8b418640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T00:07:58.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T00:07:58.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:07:59.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:59.149+0000 7fe9bf40c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T00:07:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:59.149+0000 7fe9bf40c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T00:07:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:59.149+0000 7fe9bf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T00:07:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:59.149+0000 7fe9bf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T00:07:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:59.149+0000 7fe9bf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T00:07:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:07:59.151+0000 7fe9bf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T00:08:02.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T00:08:02.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T00:08:02.281 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T00:08:02.281 INFO:tasks.ceph:role: osd.4 2024-05-09T00:08:02.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:08:02.281 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:08:02.368 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:08:02.780 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-09T00:08:02.786 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-09T00:08:02.786 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T00:08:02.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T00:08:03.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T00:08:03.126 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T00:08:03.126 INFO:tasks.ceph:role: osd.5 2024-05-09T00:08:03.126 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:08:03.126 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T00:08:03.204 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:08:03.205 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:08:03.583 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-09T00:08:03.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-09T00:08:03.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T00:08:03.708 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T00:08:03.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T00:08:03.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T00:08:03.842 INFO:tasks.ceph:role: osd.6 2024-05-09T00:08:03.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:08:03.843 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T00:08:03.912 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:08:03.913 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:08:03.914 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:08:03.914 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:08:04.304 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-09T00:08:04.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-09T00:08:04.309 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T00:08:04.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T00:08:04.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T00:08:04.592 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T00:08:04.592 INFO:tasks.ceph:role: osd.7 2024-05-09T00:08:04.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:08:04.592 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T00:08:04.661 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T00:08:05.079 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-09T00:08:05.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-09T00:08:05.086 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T00:08:05.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T00:08:05.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:08:05.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:05.528+0000 7f1064c0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T00:08:05.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:05.529+0000 7f1064c0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T00:08:05.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:05.529+0000 7f1064c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T00:08:05.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:05.529+0000 7f1064c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T00:08:05.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:05.529+0000 7f1064c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T00:08:05.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:05.532+0000 7f1064c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T00:08:08.508 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T00:08:08.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:08:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:08.803+0000 7fa642010640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T00:08:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:08.803+0000 7fa642010640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T00:08:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:08.804+0000 7fa642010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T00:08:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:08.804+0000 7fa642010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T00:08:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:08.804+0000 7fa642010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T00:08:08.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:08.806+0000 7fa642010640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T00:08:09.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:08:09.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:08:11.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T00:08:11.849 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:08:12.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:12.055+0000 7fa8bf214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T00:08:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:12.056+0000 7fa8bf214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T00:08:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:12.056+0000 7fa8bf214640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T00:08:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:12.056+0000 7fa8bf214640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T00:08:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:12.056+0000 7fa8bf214640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T00:08:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:12.058+0000 7fa8bf214640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T00:08:15.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T00:08:15.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:08:15.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:15.289+0000 7f0bb2f3b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T00:08:15.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:15.290+0000 7f0bb2f3b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T00:08:15.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:15.290+0000 7f0bb2f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T00:08:15.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:15.290+0000 7f0bb2f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T00:08:15.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:15.290+0000 7f0bb2f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T00:08:15.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:15.292+0000 7f0bb2f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T00:08:18.265 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T00:08:18.350 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T00:08:18.350 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T00:08:18.439 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T00:08:18.519 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-09T00:08:18.604 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T00:08:18.687 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.687 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T00:08:18.760 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T00:08:18.891 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:18.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T00:08:18.978 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:18.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T00:08:19.068 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T00:08:19.155 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-09T00:08:19.236 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.237 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T00:08:19.313 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T00:08:19.435 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T00:08:19.512 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T00:08:19.642 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:19.642 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T00:08:19.697 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:19.697 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-09T00:08:19.754 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T00:08:19.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T00:08:19.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T00:08:19.838 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-05-09T00:08:19.838 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDPEzxmcQlPIBAA6BwXZXa/9D0mWkNtns2lNQ== 2024-05-09T00:08:19.838 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-05-09T00:08:19.838 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDQEzxmOmdNAxAAEfBDGJGE+uP36Vw+faf9SQ== 2024-05-09T00:08:19.838 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDQEzxm9bmzFRAAIrtEqXheLeESGu+VUAUjxQ== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDUEzxmJepUMxAAWvnm4lniyXl27FBHAdOpyg== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDYEzxm07GEFhAAWx5F+t9dmY5DK9+rk1Lc8A== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDbEzxmonOxJhAArDkqok6BhLi1H8X23UYt9w== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDfEzxmBRHqCBAAkeWHyiDtSXlWWSpy3Z/bdA== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDPEzxmTNJuLxAARgkBmPkmrPkORhbfyTO/cQ== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDQEzxmRYW1KRAA/UpenDf07hjim1GewUU41w== 2024-05-09T00:08:19.839 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDQEzxmc1ZOOxAAlNw5j3x+vCxboc/Q+3y3kw== 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDlEzxmDTWfHxAAcDHVmRQarS1MVHjIcZqxng== 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDoEzxmYfT8LxAANGmqJqjh6HCTwH2LZ5gI4Q== 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDsEzxmPTBlAxAAv7Suoqcg9Qt7ZEyXs39hHA== 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDvEzxmQIBhERAAHNledRQBRgIxy5wq1blGIQ== 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDREzxmlqpeEBAA12gbJE09Xh/SNuEpuHp0ag== 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-05-09T00:08:19.840 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDREzxmjiYDHxAAW3LmNi8vMhxpAEbRZ0VvJA== 2024-05-09T00:08:19.843 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-05-09T00:08:19.843 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDPEzxmcQlPIBAA6BwXZXa/9D0mWkNtns2lNQ== 2024-05-09T00:08:19.843 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-05-09T00:08:19.843 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDQEzxmOmdNAxAAEfBDGJGE+uP36Vw+faf9SQ== 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDQEzxm9bmzFRAAIrtEqXheLeESGu+VUAUjxQ== 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDUEzxmJepUMxAAWvnm4lniyXl27FBHAdOpyg== 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDYEzxm07GEFhAAWx5F+t9dmY5DK9+rk1Lc8A== 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDbEzxmonOxJhAArDkqok6BhLi1H8X23UYt9w== 2024-05-09T00:08:19.844 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDfEzxmBRHqCBAAkeWHyiDtSXlWWSpy3Z/bdA== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDPEzxmTNJuLxAARgkBmPkmrPkORhbfyTO/cQ== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDQEzxmRYW1KRAA/UpenDf07hjim1GewUU41w== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDQEzxmc1ZOOxAAlNw5j3x+vCxboc/Q+3y3kw== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDlEzxmDTWfHxAAcDHVmRQarS1MVHjIcZqxng== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDoEzxmYfT8LxAANGmqJqjh6HCTwH2LZ5gI4Q== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDsEzxmPTBlAxAAv7Suoqcg9Qt7ZEyXs39hHA== 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-05-09T00:08:19.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDvEzxmQIBhERAAHNledRQBRgIxy5wq1blGIQ== 2024-05-09T00:08:19.846 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-05-09T00:08:19.846 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDREzxmlqpeEBAA12gbJE09Xh/SNuEpuHp0ag== 2024-05-09T00:08:19.846 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-05-09T00:08:19.846 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDREzxmjiYDHxAAW3LmNi8vMhxpAEbRZ0VvJA== 2024-05-09T00:08:19.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T00:08:19.891 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T00:08:20.106 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:20.110 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:20.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:20.327 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:20.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:20.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:20.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:20.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:20.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:20.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:21.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:21.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:21.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T00:08:21.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T00:08:21.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:21.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:21.835 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:21.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T00:08:22.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.059 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.698 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T00:08:22.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T00:08:22.919 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T00:08:23.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T00:08:23.133 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T00:08:23.346 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T00:08:23.346 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T00:08:23.431 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T00:08:23.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T00:08:23.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T00:08:23.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T00:08:24.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T00:08:24.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T00:08:24.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T00:08:24.430 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T00:08:24.511 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:08:24.518 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T00:08:24.571 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T00:08:24.572 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T00:08:24.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T00:08:24.578 INFO:tasks.ceph.mon.a:Started 2024-05-09T00:08:24.578 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T00:08:24.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T00:08:24.583 INFO:tasks.ceph.mon.b:Started 2024-05-09T00:08:24.583 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T00:08:24.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T00:08:24.588 INFO:tasks.ceph.mon.c:Started 2024-05-09T00:08:24.589 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T00:08:24.589 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T00:08:24.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T00:08:24.594 INFO:tasks.ceph.mgr.y:Started 2024-05-09T00:08:24.594 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T00:08:24.594 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T00:08:24.600 INFO:tasks.ceph.mgr.x:Started 2024-05-09T00:08:24.600 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T00:08:24.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T00:08:24.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.844+0000 7f26fde00640 1 Processor -- start 2024-05-09T00:08:24.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.844+0000 7f26fde00640 1 -- start start 2024-05-09T00:08:24.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.845+0000 7f26fde00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26fde00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f8074040 con 0x7f26f81585c0 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26fde00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f26f8073df0 con 0x7f26f8073800 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26fde00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26f80c5f40 con 0x7f26f80c4a70 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26efe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:42182/0 (socket says 172.21.15.114:42182) 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 learned_addr learned my addr 172.21.15.114:0/1750866947 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 msgr2=0x7f26f8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 msgr2=0x7f26f8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:08:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26efe00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 msgr2=0x7f26f80c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T00:08:24.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26efe00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 msgr2=0x7f26f80c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T00:08:24.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26efe00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:08:24.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:08:24.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:24.846+0000 7f26efe00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:08:25.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.047+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.047+0000 7f26efe00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 msgr2=0x7f26f8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 msgr2=0x7f26f8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26efe00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 msgr2=0x7f26f80c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T00:08:25.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26efe00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 msgr2=0x7f26f80c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T00:08:25.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26efe00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:08:25.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.048+0000 7f26efe00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:08:25.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.117+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149874136 0 0) 0x7f26f8074040 con 0x7f26f81585c0 2024-05-09T00:08:25.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.117+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26dc005730 con 0x7f26f81585c0 2024-05-09T00:08:25.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.118+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844669372 0 0) 0x7f26dc005730 con 0x7f26f81585c0 2024-05-09T00:08:25.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.118+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 msgr2=0x7f26f80c63d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:08:25.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.118+0000 7f26f6000640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26f80c63d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.118+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 msgr2=0x7f26f8072720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:08:25.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.118+0000 7f26f6000640 1 --2- 172.21.15.114:0/1750866947 >> v2:172.21.15.153:3300/0 conn(0x7f26f8073800 0x7f26f8072720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.118+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f80c58f0 con 0x7f26f81585c0 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f26f0001a70 con 0x7f26f81585c0 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 >> v1:172.21.15.114:6789/0 conn(0x7f26f81585c0 legacy=0x7f26f8154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26dc006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26dc006a10 0x7f26dc006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26dc0074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8073df0 con 0x7f26dc005cb0 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26f80c5f40 con 0x7f26dc006a10 2024-05-09T00:08:25.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc00de80 con 0x7f26f80c4a70 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.119+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26dc006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f7400640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26dc0074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 msgr2=0x7f26dc0074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26dc0074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26dc006a10 msgr2=0x7f26dc006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26dc006a10 0x7f26dc006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f6a00640 1 -- 172.21.15.114:0/1750866947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc005730 con 0x7f26dc005cb0 2024-05-09T00:08:25.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.121+0000 7f26f7400640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f80c4a70 0x7f26dc0074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:25.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.123+0000 7f26f6a00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26dc006120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009940 tx=0x7f26dc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bbef034ba54923 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.125+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8038070 con 0x7f26dc005cb0 2024-05-09T00:08:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.125+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e8033410 con 0x7f26dc005cb0 2024-05-09T00:08:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.125+0000 7f26f6000640 1 -- 172.21.15.114:0/1750866947 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e800f040 con 0x7f26dc005cb0 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.126+0000 7f26fde00640 1 -- 172.21.15.114:0/1750866947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 msgr2=0x7f26dc006120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.126+0000 7f26fde00640 1 --2- 172.21.15.114:0/1750866947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26dc006120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009940 tx=0x7f26dc007a40 comp rx=0 tx=0).stop 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.126+0000 7f26f7400640 1 -- 172.21.15.114:0/1750866947 reap_dead start 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.127+0000 7f26fde00640 1 -- 172.21.15.114:0/1750866947 shutdown_connections 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.127+0000 7f26fde00640 1 -- 172.21.15.114:0/1750866947 >> 172.21.15.114:0/1750866947 conn(0x7f26f806c680 msgr2=0x7f26f806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.127+0000 7f26fde00640 1 -- 172.21.15.114:0/1750866947 shutdown_connections 2024-05-09T00:08:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.127+0000 7f26fde00640 1 -- 172.21.15.114:0/1750866947 wait complete. 2024-05-09T00:08:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.130+0000 7f26fde00640 1 Processor -- start 2024-05-09T00:08:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.131+0000 7f26fde00640 1 -- start start 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.132+0000 7f26fde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26f8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.132+0000 7f26fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f81f5e90 0x7f26f81efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.132+0000 7f26fde00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f81f02f0 0x7f26f8145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.132+0000 7f26fde00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8074320 con 0x7f26dc005cb0 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.132+0000 7f26fde00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26f80c4e80 con 0x7f26f81f02f0 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.132+0000 7f26fde00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26f81f6720 con 0x7f26f81f5e90 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26f8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26f8153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50628/0 (socket says 172.21.15.114:50628) 2024-05-09T00:08:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 -- 172.21.15.114:0/64627780 learned_addr learned my addr 172.21.15.114:0/64627780 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:25.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26efe00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f81f5e90 0x7f26f81efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f7400640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f81f02f0 0x7f26f8145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 -- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f81f5e90 msgr2=0x7f26f81efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f81f5e90 0x7f26f81efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 -- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f81f02f0 msgr2=0x7f26f8145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f81f02f0 0x7f26f8145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.133+0000 7f26f6a00640 1 -- 172.21.15.114:0/64627780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f8143f80 con 0x7f26dc005cb0 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.134+0000 7f26f6a00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26f8153290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036040 tx=0x7f26e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.134+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8042070 con 0x7f26dc005cb0 2024-05-09T00:08:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.134+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e803d890 con 0x7f26dc005cb0 2024-05-09T00:08:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.134+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f8142700 con 0x7f26dc005cb0 2024-05-09T00:08:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.134+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8038040 con 0x7f26dc005cb0 2024-05-09T00:08:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.134+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f80ad6a0 con 0x7f26dc005cb0 2024-05-09T00:08:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.135+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f26e8045070 con 0x7f26dc005cb0 2024-05-09T00:08:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.135+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f26e8047950 con 0x7f26dc005cb0 2024-05-09T00:08:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.136+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f81590e0 con 0x7f26dc005cb0 2024-05-09T00:08:25.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.141+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f26f81590e0 con 0x7f26dc005cb0 2024-05-09T00:08:25.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.231+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f26f8077430 con 0x7f26dc005cb0 2024-05-09T00:08:25.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.234+0000 7f26ef400640 1 -- 172.21.15.114:0/64627780 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f26e8047450 con 0x7f26dc005cb0 2024-05-09T00:08:25.230 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 msgr2=0x7f26f8153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26f8153290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036040 tx=0x7f26e8004730 comp rx=0 tx=0).stop 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 shutdown_connections 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f81f02f0 0x7f26f8145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f81f5e90 0x7f26f81efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 --2- 172.21.15.114:0/64627780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26dc005cb0 0x7f26f8153290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.235+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 >> 172.21.15.114:0/64627780 conn(0x7f26f806c680 msgr2=0x7f26f81589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.236+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 shutdown_connections 2024-05-09T00:08:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:25.236+0000 7f26fde00640 1 -- 172.21.15.114:0/64627780 wait complete. 2024-05-09T00:08:25.259 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T00:08:25.259 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T00:08:25.259 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:25.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T00:08:25.275 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:25.280+0000 7f2a2213f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:08:25.282 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:25.286+0000 7f1963b17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:08:25.325 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:25.325 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T00:08:25.435 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:25.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T00:08:25.464 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:25.468+0000 7f1963b17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:08:25.466 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:25.471+0000 7f2a2213f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:08:25.529 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:08:25.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T00:08:25.529 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:25.533+0000 7f1963b17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:08:25.533 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:25.538+0000 7f2a2213f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:08:25.642 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:25.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T00:08:25.719 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:25.719 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T00:08:25.837 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:25.840+0000 7f1963b17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:08:25.838 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:25.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T00:08:25.839 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:25.843+0000 7f2a2213f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:08:25.890 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:25.894+0000 7f1963b17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:08:25.896 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:25.901+0000 7f2a2213f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:08:25.908 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:08:25.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T00:08:26.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new b42b6afe-9a52-431c-b60f-3ef463fd909c 0 2024-05-09T00:08:26.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.320+0000 7fd7e9a00640 1 Processor -- start 2024-05-09T00:08:26.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.321+0000 7fd7e9a00640 1 -- start start 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.322+0000 7fd7e9a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd7e40c8530 0x7fd7e4158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.322+0000 7fd7e9a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.322+0000 7fd7e9a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e40c82d0 con 0x7fd7e415c4d0 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.322+0000 7fd7e9a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e415bb00 con 0x7fd7e40c8530 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.322+0000 7fd7e9a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e40c9500 con 0x7fd7e4158f70 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7e3400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd7e415c4d0 0x7fd7e40c6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47304/0 (socket says 172.21.15.153:47304) 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7e3400640 1 -- 172.21.15.153:0/4081576779 learned_addr learned my addr 172.21.15.153:0/4081576779 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:57184/0 (socket says 172.21.15.153:57184) 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7e2a00640 1 --2- 172.21.15.153:0/4081576779 >> v2:172.21.15.114:3300/0 conn(0x7fd7e40c8530 0x7fd7e4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7e2000640 1 -- 172.21.15.153:0/4081576779 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189268658 0 0) 0x7fd7e40c82d0 con 0x7fd7e415c4d0 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7e2000640 1 -- 172.21.15.153:0/4081576779 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7c8003520 con 0x7fd7e415c4d0 2024-05-09T00:08:26.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7dbe00640 1 -- 172.21.15.153:0/4081576779 >> v2:172.21.15.114:3300/0 conn(0x7fd7e40c8530 msgr2=0x7fd7e4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7dbe00640 1 --2- 172.21.15.153:0/4081576779 >> v2:172.21.15.114:3300/0 conn(0x7fd7e40c8530 0x7fd7e4158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7dbe00640 1 -- 172.21.15.153:0/4081576779 >> v1:172.21.15.153:6789/0 conn(0x7fd7e415c4d0 legacy=0x7fd7e40c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.323+0000 7fd7dbe00640 1 -- 172.21.15.153:0/4081576779 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e40c97e0 con 0x7fd7e4158f70 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.324+0000 7fd7dbe00640 1 --2- 172.21.15.153:0/4081576779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415bf90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0097a0 tx=0x7fd7cc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f85eac264121cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.325+0000 7fd7e2000640 1 -- 172.21.15.153:0/4081576779 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc037070 con 0x7fd7e4158f70 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.325+0000 7fd7e2000640 1 -- 172.21.15.153:0/4081576779 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc02ae50 con 0x7fd7e4158f70 2024-05-09T00:08:26.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.325+0000 7fd7e2000640 1 -- 172.21.15.153:0/4081576779 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc032660 con 0x7fd7e4158f70 2024-05-09T00:08:26.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.325+0000 7fd7e9a00640 1 -- 172.21.15.153:0/4081576779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 msgr2=0x7fd7e415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.325+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/4081576779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415bf90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0097a0 tx=0x7fd7cc02a100 comp rx=0 tx=0).stop 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.326+0000 7fd7e9a00640 1 -- 172.21.15.153:0/4081576779 shutdown_connections 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.326+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/4081576779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415bf90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.326+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/4081576779 >> v2:172.21.15.114:3300/0 conn(0x7fd7e40c8530 0x7fd7e4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.326+0000 7fd7e9a00640 1 -- 172.21.15.153:0/4081576779 >> 172.21.15.153:0/4081576779 conn(0x7fd7e40c9d40 msgr2=0x7fd7e40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.326+0000 7fd7e9a00640 1 -- 172.21.15.153:0/4081576779 shutdown_connections 2024-05-09T00:08:26.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.326+0000 7fd7e9a00640 1 -- 172.21.15.153:0/4081576779 wait complete. 2024-05-09T00:08:26.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.328+0000 7fd7e9a00640 1 Processor -- start 2024-05-09T00:08:26.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.328+0000 7fd7e9a00640 1 -- start start 2024-05-09T00:08:26.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.329+0000 7fd7e9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e40c8530 0x7fd7e4154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.329+0000 7fd7e9a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e415c4d0 0x7fd7e41f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e9a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e4068cb0 con 0x7fd7e40c8530 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e4068b30 con 0x7fd7e415c4d0 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e9a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e40c7e60 con 0x7fd7e4158f70 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e415c4d0 0x7fd7e41f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:57186/0 (socket says 172.21.15.153:57186) 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 -- 172.21.15.153:0/3515187046 learned_addr learned my addr 172.21.15.153:0/3515187046 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e2a00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e40c8530 0x7fd7e4154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 -- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e415c4d0 msgr2=0x7fd7e41f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e415c4d0 0x7fd7e41f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 -- 172.21.15.153:0/3515187046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e40c8530 msgr2=0x7fd7e4154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e40c8530 0x7fd7e4154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7dbe00640 1 -- 172.21.15.153:0/3515187046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e41edf30 con 0x7fd7e4158f70 2024-05-09T00:08:26.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.330+0000 7fd7e2a00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e40c8530 0x7fd7e4154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.331+0000 7fd7dbe00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc000c00 tx=0x7fd7cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.331+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc041070 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.331+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc03c460 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.331+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc037040 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.331+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e41e4870 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.331+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e41e5050 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.332+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7cc044070 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.332+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fd7cc046c30 con 0x7fd7e4158f70 2024-05-09T00:08:26.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.333+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e4077430 con 0x7fd7e4158f70 2024-05-09T00:08:26.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.335+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd7cc046450 con 0x7fd7e4158f70 2024-05-09T00:08:26.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.433+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b42b6afe-9a52-431c-b60f-3ef463fd909c", "id": 0} v 0) -- 0x7fd7e40c7c40 con 0x7fd7e4158f70 2024-05-09T00:08:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.440+0000 7fd7daa00640 1 -- 172.21.15.153:0/3515187046 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b42b6afe-9a52-431c-b60f-3ef463fd909c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fd7cc03c850 con 0x7fd7e4158f70 2024-05-09T00:08:26.436 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 msgr2=0x7fd7e415aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc000c00 tx=0x7fd7cc0046c0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 shutdown_connections 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e415c4d0 0x7fd7e41f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7e4158f70 0x7fd7e415aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 --2- 172.21.15.153:0/3515187046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e40c8530 0x7fd7e4154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 >> 172.21.15.153:0/3515187046 conn(0x7fd7e40c9d40 msgr2=0x7fd7e4075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 shutdown_connections 2024-05-09T00:08:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.442+0000 7fd7e9a00640 1 -- 172.21.15.153:0/3515187046 wait complete. 2024-05-09T00:08:26.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 32e3b05a-16b9-4525-b6e2-98c094f1fe1c 1 2024-05-09T00:08:26.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.703+0000 7fa9c3000640 1 Processor -- start 2024-05-09T00:08:26.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.704+0000 7fa9c3000640 1 -- start start 2024-05-09T00:08:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa9bc0cb430 0x7fa9bc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c3000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc15b7f0 con 0x7fa9bc0c8760 2024-05-09T00:08:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c3000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc15bad0 con 0x7fa9bc158b10 2024-05-09T00:08:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa9bc15c5b0 con 0x7fa9bc0cb430 2024-05-09T00:08:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa9bc0cb430 0x7fa9bc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa9bc0cb430 0x7fa9bc0cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47388/0 (socket says 172.21.15.153:47388) 2024-05-09T00:08:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c1200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa9bc158b10 0x7fa9bc0af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47318/0 (socket says 172.21.15.153:47318) 2024-05-09T00:08:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.706+0000 7fa9c2600640 1 -- 172.21.15.153:0/2819801739 learned_addr learned my addr 172.21.15.153:0/2819801739 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.707+0000 7fa9c2600640 1 -- 172.21.15.153:0/2819801739 >> v1:172.21.15.153:6789/0 conn(0x7fa9bc158b10 legacy=0x7fa9bc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.707+0000 7fa9c2600640 1 -- 172.21.15.153:0/2819801739 >> v1:172.21.15.114:6789/0 conn(0x7fa9bc0c8760 legacy=0x7fa9bc155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.707+0000 7fa9c2600640 1 -- 172.21.15.153:0/2819801739 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc15bdb0 con 0x7fa9bc0cb430 2024-05-09T00:08:26.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.708+0000 7fa9c2600640 1 --2- 172.21.15.153:0/2819801739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0cb840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4009e50 tx=0x7fa9b402a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eb9e6caa2d70943 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:26.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.708+0000 7fa9bbe00640 1 -- 172.21.15.153:0/2819801739 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4036070 con 0x7fa9bc0cb430 2024-05-09T00:08:26.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.708+0000 7fa9bbe00640 1 -- 172.21.15.153:0/2819801739 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4031600 con 0x7fa9bc0cb430 2024-05-09T00:08:26.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.708+0000 7fa9bbe00640 1 -- 172.21.15.153:0/2819801739 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40319f0 con 0x7fa9bc0cb430 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 -- 172.21.15.153:0/2819801739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 msgr2=0x7fa9bc0cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 --2- 172.21.15.153:0/2819801739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0cb840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4009e50 tx=0x7fa9b402a7c0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 -- 172.21.15.153:0/2819801739 shutdown_connections 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 --2- 172.21.15.153:0/2819801739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0cb840 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 -- 172.21.15.153:0/2819801739 >> 172.21.15.153:0/2819801739 conn(0x7fa9bc068ef0 msgr2=0x7fa9bc0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 -- 172.21.15.153:0/2819801739 shutdown_connections 2024-05-09T00:08:26.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.709+0000 7fa9c3000640 1 -- 172.21.15.153:0/2819801739 wait complete. 2024-05-09T00:08:26.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.712+0000 7fa9c3000640 1 Processor -- start 2024-05-09T00:08:26.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.712+0000 7fa9c3000640 1 -- start start 2024-05-09T00:08:26.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 0x7fa9bc1ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c3000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9bc158b10 0x7fa9bc0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c3000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0af8c0 con 0x7fa9bc158b10 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0af740 con 0x7fa9bc0cb430 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc0cd070 con 0x7fa9bc0c8760 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 0x7fa9bc1ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 0x7fa9bc1ee7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:57200/0 (socket says 172.21.15.153:57200) 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.714+0000 7fa9c1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47392/0 (socket says 172.21.15.153:47392) 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 -- 172.21.15.153:0/25768406 learned_addr learned my addr 172.21.15.153:0/25768406 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c2600640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9bc158b10 0x7fa9bc0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 -- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 msgr2=0x7fa9bc0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 -- 172.21.15.153:0/25768406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9bc158b10 msgr2=0x7fa9bc0c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9bc158b10 0x7fa9bc0c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 -- 172.21.15.153:0/25768406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc154be0 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.715+0000 7fa9c1c00640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 0x7fa9bc1ee7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000c3a0 tx=0x7fa9b000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0017070 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b00052d0 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0003830 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc154900 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc0c5250 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9b001a070 con 0x7fa9bc0c8760 2024-05-09T00:08:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.716+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa9b0011b80 con 0x7fa9bc0c8760 2024-05-09T00:08:26.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.717+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc078430 con 0x7fa9bc0c8760 2024-05-09T00:08:26.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.719+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa9b0021070 con 0x7fa9bc0c8760 2024-05-09T00:08:26.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.797+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "32e3b05a-16b9-4525-b6e2-98c094f1fe1c", "id": 1} v 0) -- 0x7fa9bc0c0ab0 con 0x7fa9bc0c8760 2024-05-09T00:08:26.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.805+0000 7fa9b9600640 1 -- 172.21.15.153:0/25768406 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32e3b05a-16b9-4525-b6e2-98c094f1fe1c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa9b0011d80 con 0x7fa9bc0c8760 2024-05-09T00:08:26.801 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 msgr2=0x7fa9bc1ee7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 0x7fa9bc1ee7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000c3a0 tx=0x7fa9b000c860 comp rx=0 tx=0).stop 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 shutdown_connections 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9bc158b10 0x7fa9bc0c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9bc0cb430 0x7fa9bc0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 --2- 172.21.15.153:0/25768406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9bc0c8760 0x7fa9bc1ee7d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 >> 172.21.15.153:0/25768406 conn(0x7fa9bc068ef0 msgr2=0x7fa9bc0cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 shutdown_connections 2024-05-09T00:08:26.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:26.807+0000 7fa9c3000640 1 -- 172.21.15.153:0/25768406 wait complete. 2024-05-09T00:08:26.826 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 09b75db5-080a-4672-b5a4-308fdeda451d 2 2024-05-09T00:08:26.840 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:26.843+0000 7f1963b17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:08:26.897 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:26.902+0000 7f2a2213f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:08:26.942 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:26.946+0000 7f1963b17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:08:26.992 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:26.996+0000 7f1963b17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:08:27.015 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:27.019+0000 7f2a2213f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:08:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.073+0000 7fe719e00640 1 Processor -- start 2024-05-09T00:08:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.073+0000 7fe719e00640 1 -- start start 2024-05-09T00:08:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe719e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7140c8760 0x7fe714155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe719e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140cb430 0x7fe7140cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe719e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71415b7f0 con 0x7fe714158b10 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe719e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe71415c5b0 con 0x7fe7140c8760 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe719e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe71415bad0 con 0x7fe7140cb430 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe718a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7140c8760 0x7fe714155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe719400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140cb430 0x7fe7140cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe718a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7140c8760 0x7fe714155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47394/0 (socket says 172.21.15.153:47394) 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe718a00640 1 -- 172.21.15.153:0/2229885583 learned_addr learned my addr 172.21.15.153:0/2229885583 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.075+0000 7fe713e00640 1 --1- 172.21.15.153:0/2229885583 >> v1:172.21.15.153:6789/0 conn(0x7fe714158b10 0x7fe7140af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47334/0 (socket says 172.21.15.153:47334) 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.076+0000 7fe718a00640 1 -- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140cb430 msgr2=0x7fe7140cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.076+0000 7fe718a00640 1 --2- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140cb430 0x7fe7140cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.076+0000 7fe718a00640 1 -- 172.21.15.153:0/2229885583 >> v1:172.21.15.153:6789/0 conn(0x7fe714158b10 legacy=0x7fe7140af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.076+0000 7fe718a00640 1 -- 172.21.15.153:0/2229885583 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71415bdb0 con 0x7fe7140c8760 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.076+0000 7fe719400640 1 --2- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140cb430 0x7fe7140cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.076+0000 7fe713400640 1 -- 172.21.15.153:0/2229885583 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555237019 0 0) 0x7fe71415b7f0 con 0x7fe714158b10 2024-05-09T00:08:27.073 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:27.076+0000 7f2a2213f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.077+0000 7fe718a00640 1 --2- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140c8760 0x7fe714155740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe708009870 tx=0x7fe70802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33b58b42d8f8ba9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.077+0000 7fe713400640 1 -- 172.21.15.153:0/2229885583 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708037070 con 0x7fe7140c8760 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.077+0000 7fe713400640 1 -- 172.21.15.153:0/2229885583 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe708032440 con 0x7fe7140c8760 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.077+0000 7fe713400640 1 -- 172.21.15.153:0/2229885583 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708032810 con 0x7fe7140c8760 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 -- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140c8760 msgr2=0x7fe714155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 --2- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140c8760 0x7fe714155740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe708009870 tx=0x7fe70802a250 comp rx=0 tx=0).stop 2024-05-09T00:08:27.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 -- 172.21.15.153:0/2229885583 shutdown_connections 2024-05-09T00:08:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 --2- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140cb430 0x7fe7140cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 --2- 172.21.15.153:0/2229885583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140c8760 0x7fe714155740 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 -- 172.21.15.153:0/2229885583 >> 172.21.15.153:0/2229885583 conn(0x7fe714068ef0 msgr2=0x7fe7140cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 -- 172.21.15.153:0/2229885583 shutdown_connections 2024-05-09T00:08:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.078+0000 7fe719e00640 1 -- 172.21.15.153:0/2229885583 wait complete. 2024-05-09T00:08:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.080+0000 7fe719e00640 1 Processor -- start 2024-05-09T00:08:27.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.080+0000 7fe719e00640 1 -- start start 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 0x7fe7140c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7140cb430 0x7fe714154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe714158b10 0x7fe714154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe7140af740 con 0x7fe7140cb430 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe714155c80 con 0x7fe714158b10 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe7140af8c0 con 0x7fe7140c8760 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 0x7fe7140c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 0x7fe7140c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:57212/0 (socket says 172.21.15.153:57212) 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 -- 172.21.15.153:0/4009658161 learned_addr learned my addr 172.21.15.153:0/4009658161 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe719400640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe714158b10 0x7fe714154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe713e00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7140cb430 0x7fe714154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 -- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe714158b10 msgr2=0x7fe714154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe714158b10 0x7fe714154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 -- 172.21.15.153:0/4009658161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7140cb430 msgr2=0x7fe714154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7140cb430 0x7fe714154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.082+0000 7fe718a00640 1 -- 172.21.15.153:0/4009658161 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7141edc80 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.083+0000 7fe718a00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 0x7fe7140c5240 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe708009870 tx=0x7fe7080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.083+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708041070 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.083+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70803c890 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.083+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708037040 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.083+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7140c4760 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.083+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7140c5ca0 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.084+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe708044070 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.084+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fe708046d20 con 0x7fe7140c8760 2024-05-09T00:08:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.084+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe714078430 con 0x7fe7140c8760 2024-05-09T00:08:27.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.087+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe708046450 con 0x7fe7140c8760 2024-05-09T00:08:27.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.163+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09b75db5-080a-4672-b5a4-308fdeda451d", "id": 2} v 0) -- 0x7fe7140af520 con 0x7fe7140c8760 2024-05-09T00:08:27.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.170+0000 7fe710c00640 1 -- 172.21.15.153:0/4009658161 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09b75db5-080a-4672-b5a4-308fdeda451d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fe70803cc80 con 0x7fe7140c8760 2024-05-09T00:08:27.166 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 msgr2=0x7fe7140c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 0x7fe7140c5240 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe708009870 tx=0x7fe7080046c0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 shutdown_connections 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe714158b10 0x7fe714154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7140cb430 0x7fe714154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 --2- 172.21.15.153:0/4009658161 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140c8760 0x7fe7140c5240 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.171+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 >> 172.21.15.153:0/4009658161 conn(0x7fe714068ef0 msgr2=0x7fe7140ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.172+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 shutdown_connections 2024-05-09T00:08:27.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.172+0000 7fe719e00640 1 -- 172.21.15.153:0/4009658161 wait complete. 2024-05-09T00:08:27.185 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:27.189+0000 7f1963b17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:08:27.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new d4ae79fe-ddd3-4699-871b-ee740190b4f3 3 2024-05-09T00:08:27.251 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:27.254+0000 7f1963b17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:08:27.284 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:27.288+0000 7f2a2213f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:08:27.311 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:27.315+0000 7f1963b17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:08:27.362 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:27.367+0000 7f2a2213f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:08:27.430 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:27.435+0000 7f2a2213f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:08:27.437 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:27.441+0000 7f1963b17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:08:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.445+0000 7fab8cc00640 1 Processor -- start 2024-05-09T00:08:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.445+0000 7fab8cc00640 1 -- start start 2024-05-09T00:08:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab8cc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab8815c180 0x7fab880af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab8cc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880cc800 0x7fab880ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab8cc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab88159670 con 0x7fab880c87e0 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab8cc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fab880cc370 con 0x7fab8815c180 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab8cc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fab880cba40 con 0x7fab880cc800 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab87400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab8815c180 0x7fab880af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab87400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab8815c180 0x7fab880af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47420/0 (socket says 172.21.15.153:47420) 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab87400640 1 -- 172.21.15.153:0/1049595673 learned_addr learned my addr 172.21.15.153:0/1049595673 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab87e00640 1 --2- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880cc800 0x7fab880ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab87400640 1 -- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880cc800 msgr2=0x7fab880ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.447+0000 7fab87400640 1 --2- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880cc800 0x7fab880ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.448+0000 7fab87400640 1 -- 172.21.15.153:0/1049595673 >> v1:172.21.15.114:6789/0 conn(0x7fab880c87e0 legacy=0x7fab8815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.448+0000 7fab87400640 1 -- 172.21.15.153:0/1049595673 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880cbd20 con 0x7fab8815c180 2024-05-09T00:08:27.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.449+0000 7fab87400640 1 --2- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab8815c180 0x7fab880af1c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fab880cc4f0 tx=0x7fab7802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169ca48131762ac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.449+0000 7fab86a00640 1 -- 172.21.15.153:0/1049595673 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78037070 con 0x7fab8815c180 2024-05-09T00:08:27.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.449+0000 7fab86a00640 1 -- 172.21.15.153:0/1049595673 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78032440 con 0x7fab8815c180 2024-05-09T00:08:27.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.449+0000 7fab86a00640 1 -- 172.21.15.153:0/1049595673 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78032810 con 0x7fab8815c180 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 -- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab8815c180 msgr2=0x7fab880af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 --2- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab8815c180 0x7fab880af1c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fab880cc4f0 tx=0x7fab7802a1c0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 -- 172.21.15.153:0/1049595673 shutdown_connections 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 --2- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880cc800 0x7fab880ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 --2- 172.21.15.153:0/1049595673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab8815c180 0x7fab880af1c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 -- 172.21.15.153:0/1049595673 >> 172.21.15.153:0/1049595673 conn(0x7fab880cd4e0 msgr2=0x7fab880cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 -- 172.21.15.153:0/1049595673 shutdown_connections 2024-05-09T00:08:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.450+0000 7fab8cc00640 1 -- 172.21.15.153:0/1049595673 wait complete. 2024-05-09T00:08:27.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.452+0000 7fab8cc00640 1 Processor -- start 2024-05-09T00:08:27.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.453+0000 7fab8cc00640 1 -- start start 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab8cc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 0x7fab881e5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab8cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab880cc800 0x7fab880c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab8cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8815c180 0x7fab880c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab8cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab8815b400 con 0x7fab8815c180 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab8cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fab880af700 con 0x7fab880cc800 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab8cc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fab8815b580 con 0x7fab880c87e0 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab87400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 0x7fab881e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab7fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab880cc800 0x7fab880c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab87400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 0x7fab881e5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:57228/0 (socket says 172.21.15.153:57228) 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab87400640 1 -- 172.21.15.153:0/2968768336 learned_addr learned my addr 172.21.15.153:0/2968768336 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.454+0000 7fab87e00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8815c180 0x7fab880c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87400640 1 -- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab880cc800 msgr2=0x7fab880c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87400640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab880cc800 0x7fab880c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87400640 1 -- 172.21.15.153:0/2968768336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8815c180 msgr2=0x7fab880c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87400640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8815c180 0x7fab880c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87400640 1 -- 172.21.15.153:0/2968768336 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab881f22e0 con 0x7fab880c87e0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87e00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8815c180 0x7fab880c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab7fe00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab880cc800 0x7fab880c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab87400640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 0x7fab881e5280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab7802a200 tx=0x7fab780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78037040 con 0x7fab880c87e0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78042070 con 0x7fab880c87e0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.455+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78030880 con 0x7fab880c87e0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.456+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab880c6a60 con 0x7fab880c87e0 2024-05-09T00:08:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.456+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab881e22f0 con 0x7fab880c87e0 2024-05-09T00:08:27.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.456+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fab7802ad10 con 0x7fab880c87e0 2024-05-09T00:08:27.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.456+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fab78047d50 con 0x7fab880c87e0 2024-05-09T00:08:27.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.457+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab881e2530 con 0x7fab880c87e0 2024-05-09T00:08:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.459+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fab881e2530 con 0x7fab880c87e0 2024-05-09T00:08:27.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.537+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d4ae79fe-ddd3-4699-871b-ee740190b4f3", "id": 3} v 0) -- 0x7fab88078430 con 0x7fab880c87e0 2024-05-09T00:08:27.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.543+0000 7fab7f400640 1 -- 172.21.15.153:0/2968768336 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4ae79fe-ddd3-4699-871b-ee740190b4f3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fab78047460 con 0x7fab880c87e0 2024-05-09T00:08:27.539 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-05-09T00:08:27.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 msgr2=0x7fab881e5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 0x7fab881e5280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab7802a200 tx=0x7fab780046c0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 shutdown_connections 2024-05-09T00:08:27.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8815c180 0x7fab880c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab880cc800 0x7fab880c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 --2- 172.21.15.153:0/2968768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab880c87e0 0x7fab881e5280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 >> 172.21.15.153:0/2968768336 conn(0x7fab880cd4e0 msgr2=0x7fab88157f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 shutdown_connections 2024-05-09T00:08:27.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.545+0000 7fab8cc00640 1 -- 172.21.15.153:0/2968768336 wait complete. 2024-05-09T00:08:27.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 89334d7c-628b-4e2b-899d-55085379af15 4 2024-05-09T00:08:27.569 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:27.573+0000 7f2a2213f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:08:27.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.819+0000 7fc24ce00640 1 Processor -- start 2024-05-09T00:08:27.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.819+0000 7fc24ce00640 1 -- start start 2024-05-09T00:08:27.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc24ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc248158b10 0x7fc2480af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc24ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc24ce00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24815b7f0 con 0x7fc2480c8760 2024-05-09T00:08:27.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc24ce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc24815c5b0 con 0x7fc248158b10 2024-05-09T00:08:27.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc24ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc24815bad0 con 0x7fc2480af570 2024-05-09T00:08:27.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc247400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc2480c8760 0x7fc248155740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47346/0 (socket says 172.21.15.153:47346) 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc247400640 1 -- 172.21.15.153:0/845359508 learned_addr learned my addr 172.21.15.153:0/845359508 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.821+0000 7fc247e00640 1 --2- 172.21.15.153:0/845359508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.822+0000 7fc246a00640 1 --2- 172.21.15.153:0/845359508 >> v2:172.21.15.114:3300/0 conn(0x7fc248158b10 0x7fc2480af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.822+0000 7fc247e00640 1 -- 172.21.15.153:0/845359508 >> v2:172.21.15.114:3300/0 conn(0x7fc248158b10 msgr2=0x7fc2480af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.822+0000 7fc247e00640 1 --2- 172.21.15.153:0/845359508 >> v2:172.21.15.114:3300/0 conn(0x7fc248158b10 0x7fc2480af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.822+0000 7fc247e00640 1 -- 172.21.15.153:0/845359508 >> v1:172.21.15.153:6789/0 conn(0x7fc2480c8760 legacy=0x7fc248155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.822+0000 7fc246000640 1 -- 172.21.15.153:0/845359508 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800248431 0 0) 0x7fc24815b7f0 con 0x7fc2480c8760 2024-05-09T00:08:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.822+0000 7fc247e00640 1 -- 172.21.15.153:0/845359508 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24815bdb0 con 0x7fc2480af570 2024-05-09T00:08:27.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.823+0000 7fc247e00640 1 --2- 172.21.15.153:0/845359508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480cb430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc240009d90 tx=0x7fc24002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff43450b36008a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.823+0000 7fc246000640 1 -- 172.21.15.153:0/845359508 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240007740 con 0x7fc2480af570 2024-05-09T00:08:27.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.823+0000 7fc246000640 1 -- 172.21.15.153:0/845359508 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2400078e0 con 0x7fc2480af570 2024-05-09T00:08:27.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.823+0000 7fc246000640 1 -- 172.21.15.153:0/845359508 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240007cb0 con 0x7fc2480af570 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 -- 172.21.15.153:0/845359508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 msgr2=0x7fc2480cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 --2- 172.21.15.153:0/845359508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480cb430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc240009d90 tx=0x7fc24002a660 comp rx=0 tx=0).stop 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 -- 172.21.15.153:0/845359508 shutdown_connections 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 --2- 172.21.15.153:0/845359508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480cb430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 --2- 172.21.15.153:0/845359508 >> v2:172.21.15.114:3300/0 conn(0x7fc248158b10 0x7fc2480af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 -- 172.21.15.153:0/845359508 >> 172.21.15.153:0/845359508 conn(0x7fc248068ef0 msgr2=0x7fc2480cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 -- 172.21.15.153:0/845359508 shutdown_connections 2024-05-09T00:08:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.824+0000 7fc24ce00640 1 -- 172.21.15.153:0/845359508 wait complete. 2024-05-09T00:08:27.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.826+0000 7fc24ce00640 1 Processor -- start 2024-05-09T00:08:27.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.827+0000 7fc24ce00640 1 -- start start 2024-05-09T00:08:27.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc24ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc24ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 0x7fc2480c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc24ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc248158b10 0x7fc2481e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc24ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc2480cd1f0 con 0x7fc248158b10 2024-05-09T00:08:27.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc24ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2480cd070 con 0x7fc2480c8760 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc24ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc2480cb970 con 0x7fc2480af570 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc246a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 0x7fc2480c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc247400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc246a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 0x7fc2480c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47438/0 (socket says 172.21.15.153:47438) 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc246a00640 1 -- 172.21.15.153:0/1888374370 learned_addr learned my addr 172.21.15.153:0/1888374370 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.828+0000 7fc247e00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc248158b10 0x7fc2481e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc246a00640 1 -- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 msgr2=0x7fc2480c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc246a00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc246a00640 1 -- 172.21.15.153:0/1888374370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc248158b10 msgr2=0x7fc2481e46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc246a00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc248158b10 0x7fc2481e46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc246a00640 1 -- 172.21.15.153:0/1888374370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2481e5240 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc246a00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 0x7fc2480c6d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc23400d630 tx=0x7fc23400daf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234004240 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2340043e0 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2480c5070 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234003830 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.829+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2480c5630 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.830+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc2340039d0 con 0x7fc2480c8760 2024-05-09T00:08:27.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.830+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc234012930 con 0x7fc2480c8760 2024-05-09T00:08:27.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.830+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc248078430 con 0x7fc2480c8760 2024-05-09T00:08:27.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.833+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc234012d80 con 0x7fc2480c8760 2024-05-09T00:08:27.891 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:27.895+0000 7f1963b17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:08:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.911+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89334d7c-628b-4e2b-899d-55085379af15", "id": 4} v 0) -- 0x7fc2481e4f60 con 0x7fc2480c8760 2024-05-09T00:08:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.920+0000 7fc23f400640 1 -- 172.21.15.153:0/1888374370 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89334d7c-628b-4e2b-899d-55085379af15", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fc234003d90 con 0x7fc2480c8760 2024-05-09T00:08:27.916 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-05-09T00:08:27.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 msgr2=0x7fc2480c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 0x7fc2480c6d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc23400d630 tx=0x7fc23400daf0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 shutdown_connections 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc248158b10 0x7fc2481e46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480c8760 0x7fc2480c6d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 --2- 172.21.15.153:0/1888374370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2480af570 0x7fc2480c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 >> 172.21.15.153:0/1888374370 conn(0x7fc248068ef0 msgr2=0x7fc2481567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 shutdown_connections 2024-05-09T00:08:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:27.921+0000 7fc24ce00640 1 -- 172.21.15.153:0/1888374370 wait complete. 2024-05-09T00:08:27.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 3bbade74-d2bd-44e5-8151-e8e223b0812e 5 2024-05-09T00:08:28.045 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:28.048+0000 7f1963b17040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:08:28.056 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:28.061+0000 7f2a2213f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:08:28.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.197+0000 7fd6a9800640 1 Processor -- start 2024-05-09T00:08:28.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.198+0000 7fd6a9800640 1 -- start start 2024-05-09T00:08:28.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a40c8760 0x7fd6a4155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a9800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 0x7fd6a40af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a9800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a415b7f0 con 0x7fd6a40af570 2024-05-09T00:08:28.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a9800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a415c5b0 con 0x7fd6a4158b10 2024-05-09T00:08:28.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a415bad0 con 0x7fd6a40c8760 2024-05-09T00:08:28.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 0x7fd6a40af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a40c8760 0x7fd6a4155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 0x7fd6a40af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47444/0 (socket says 172.21.15.153:47444) 2024-05-09T00:08:28.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3400640 1 -- 172.21.15.153:0/473760866 learned_addr learned my addr 172.21.15.153:0/473760866 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:28.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3e00640 1 -- 172.21.15.153:0/473760866 >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 msgr2=0x7fd6a40af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:28.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3e00640 1 --2- 172.21.15.153:0/473760866 >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 0x7fd6a40af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.200+0000 7fd6a3e00640 1 -- 172.21.15.153:0/473760866 >> v1:172.21.15.114:6789/0 conn(0x7fd6a40af570 legacy=0x7fd6a40cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:28.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.201+0000 7fd6a3e00640 1 -- 172.21.15.153:0/473760866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a415bdb0 con 0x7fd6a40c8760 2024-05-09T00:08:28.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.201+0000 7fd6a3400640 1 --2- 172.21.15.153:0/473760866 >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 0x7fd6a40af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:28.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.202+0000 7fd6a3e00640 1 --2- 172.21.15.153:0/473760866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a40c8760 0x7fd6a4155740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6940097a0 tx=0x7fd69402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2591ec55081e7968 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:28.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.202+0000 7fd6a2a00640 1 -- 172.21.15.153:0/473760866 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694037070 con 0x7fd6a40c8760 2024-05-09T00:08:28.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.202+0000 7fd6a2a00640 1 -- 172.21.15.153:0/473760866 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694032440 con 0x7fd6a40c8760 2024-05-09T00:08:28.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.202+0000 7fd6a2a00640 1 -- 172.21.15.153:0/473760866 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694032810 con 0x7fd6a40c8760 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 -- 172.21.15.153:0/473760866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a40c8760 msgr2=0x7fd6a4155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 --2- 172.21.15.153:0/473760866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a40c8760 0x7fd6a4155740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6940097a0 tx=0x7fd69402a180 comp rx=0 tx=0).stop 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 -- 172.21.15.153:0/473760866 shutdown_connections 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 --2- 172.21.15.153:0/473760866 >> v2:172.21.15.153:3300/0 conn(0x7fd6a4158b10 0x7fd6a40af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 --2- 172.21.15.153:0/473760866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a40c8760 0x7fd6a4155740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 -- 172.21.15.153:0/473760866 >> 172.21.15.153:0/473760866 conn(0x7fd6a4068ef0 msgr2=0x7fd6a40cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 -- 172.21.15.153:0/473760866 shutdown_connections 2024-05-09T00:08:28.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.203+0000 7fd6a9800640 1 -- 172.21.15.153:0/473760866 wait complete. 2024-05-09T00:08:28.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.205+0000 7fd6a9800640 1 Processor -- start 2024-05-09T00:08:28.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.205+0000 7fd6a9800640 1 -- start start 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 0x7fd6a41f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a40c8760 0x7fd6a40b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a4158b10 0x7fd6a41e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a9800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40cd070 con 0x7fd6a40c8760 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a9800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4155c80 con 0x7fd6a40af570 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a40cd1f0 con 0x7fd6a4158b10 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 0x7fd6a41f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 0x7fd6a41f10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47448/0 (socket says 172.21.15.153:47448) 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a3e00640 1 -- 172.21.15.153:0/1091116487 learned_addr learned my addr 172.21.15.153:0/1091116487 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a8e00640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a4158b10 0x7fd6a41e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.207+0000 7fd6a3400640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a40c8760 0x7fd6a40b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a3e00640 1 -- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a4158b10 msgr2=0x7fd6a41e1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a3e00640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a4158b10 0x7fd6a41e1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a3e00640 1 -- 172.21.15.153:0/1091116487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a40c8760 msgr2=0x7fd6a40b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a3e00640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a40c8760 0x7fd6a40b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a3e00640 1 -- 172.21.15.153:0/1091116487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a415a790 con 0x7fd6a40af570 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a3e00640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 0x7fd6a41f10e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6940098c0 tx=0x7fd6940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694041070 con 0x7fd6a40af570 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69403c870 con 0x7fd6a40af570 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694037040 con 0x7fd6a40af570 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a41549a0 con 0x7fd6a40af570 2024-05-09T00:08:28.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.208+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41f16b0 con 0x7fd6a40af570 2024-05-09T00:08:28.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.209+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd694044070 con 0x7fd6a40af570 2024-05-09T00:08:28.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.209+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd69403cc60 con 0x7fd6a40af570 2024-05-09T00:08:28.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.209+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a4078430 con 0x7fd6a40af570 2024-05-09T00:08:28.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.212+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd694046450 con 0x7fd6a40af570 2024-05-09T00:08:28.222 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:28.227+0000 7f2a2213f040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:08:28.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.292+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bbade74-d2bd-44e5-8151-e8e223b0812e", "id": 5} v 0) -- 0x7fd6a41f1880 con 0x7fd6a40af570 2024-05-09T00:08:28.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.301+0000 7fd69be00640 1 -- 172.21.15.153:0/1091116487 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bbade74-d2bd-44e5-8151-e8e223b0812e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd694046630 con 0x7fd6a40af570 2024-05-09T00:08:28.297 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-05-09T00:08:28.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 msgr2=0x7fd6a41f10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 0x7fd6a41f10e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6940098c0 tx=0x7fd6940046c0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 shutdown_connections 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6a4158b10 0x7fd6a41e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a40c8760 0x7fd6a40b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 --2- 172.21.15.153:0/1091116487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a40af570 0x7fd6a41f10e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 >> 172.21.15.153:0/1091116487 conn(0x7fd6a4068ef0 msgr2=0x7fd6a415ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 shutdown_connections 2024-05-09T00:08:28.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.303+0000 7fd6a9800640 1 -- 172.21.15.153:0/1091116487 wait complete. 2024-05-09T00:08:28.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a4bb8307-e545-40fb-bdce-02b394bc9a88 6 2024-05-09T00:08:28.349 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:28.352+0000 7f1963b17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:08:28.409 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:28.413+0000 7f1963b17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:08:28.539 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:28.543+0000 7f1963b17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:08:28.541 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:28.545+0000 7f2a2213f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:08:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.572+0000 7fcd50000640 1 Processor -- start 2024-05-09T00:08:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.572+0000 7fcd50000640 1 -- start start 2024-05-09T00:08:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.575+0000 7fcd50000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.575+0000 7fcd50000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd480ca780 0x7fcd48158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.575+0000 7fcd50000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd480cab90 0x7fcd481591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.575+0000 7fcd50000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcd480c8c40 con 0x7fcd480cab90 2024-05-09T00:08:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.575+0000 7fcd50000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcd480c8f20 con 0x7fcd480ca780 2024-05-09T00:08:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.575+0000 7fcd50000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd480cbdc0 con 0x7fcd480b3050 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd480ca780 0x7fcd48158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd480ca780 0x7fcd48158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47464/0 (socket says 172.21.15.153:47464) 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 -- 172.21.15.153:0/2597566509 learned_addr learned my addr 172.21.15.153:0/2597566509 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4d600640 1 --2- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4e000640 1 --2- 172.21.15.153:0/2597566509 >> v2:172.21.15.114:3300/0 conn(0x7fcd480cab90 0x7fcd481591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 -- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 msgr2=0x7fcd4815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:28.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 --2- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 -- 172.21.15.153:0/2597566509 >> v2:172.21.15.114:3300/0 conn(0x7fcd480cab90 msgr2=0x7fcd481591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:28.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 --2- 172.21.15.153:0/2597566509 >> v2:172.21.15.114:3300/0 conn(0x7fcd480cab90 0x7fcd481591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.576+0000 7fcd4cc00640 1 -- 172.21.15.153:0/2597566509 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd480cc0a0 con 0x7fcd480ca780 2024-05-09T00:08:28.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.577+0000 7fcd4cc00640 1 --2- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480ca780 0x7fcd48158cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd4808f420 tx=0x7fcd3402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ce2f0cb7b11322 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:28.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.578+0000 7fcd47e00640 1 -- 172.21.15.153:0/2597566509 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037070 con 0x7fcd480ca780 2024-05-09T00:08:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.578+0000 7fcd47e00640 1 -- 172.21.15.153:0/2597566509 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34032440 con 0x7fcd480ca780 2024-05-09T00:08:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.578+0000 7fcd47e00640 1 -- 172.21.15.153:0/2597566509 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34032810 con 0x7fcd480ca780 2024-05-09T00:08:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.578+0000 7fcd50000640 1 -- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480ca780 msgr2=0x7fcd48158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.578+0000 7fcd50000640 1 --2- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480ca780 0x7fcd48158cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd4808f420 tx=0x7fcd3402a1e0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 -- 172.21.15.153:0/2597566509 shutdown_connections 2024-05-09T00:08:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 --2- 172.21.15.153:0/2597566509 >> v2:172.21.15.114:3300/0 conn(0x7fcd480cab90 0x7fcd481591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 --2- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480ca780 0x7fcd48158cb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 --2- 172.21.15.153:0/2597566509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 -- 172.21.15.153:0/2597566509 >> 172.21.15.153:0/2597566509 conn(0x7fcd480cdc50 msgr2=0x7fcd480ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 -- 172.21.15.153:0/2597566509 shutdown_connections 2024-05-09T00:08:28.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.579+0000 7fcd50000640 1 -- 172.21.15.153:0/2597566509 wait complete. 2024-05-09T00:08:28.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.582+0000 7fcd50000640 1 Processor -- start 2024-05-09T00:08:28.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.582+0000 7fcd50000640 1 -- start start 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd50000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd50000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd480ca780 0x7fcd4815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd50000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480b2a50 0x7fcd4814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd50000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd480cc740 con 0x7fcd480ca780 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd50000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd480cc5c0 con 0x7fcd480b2a50 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd50000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd480cc8c0 con 0x7fcd480b3050 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd4d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd4d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:57272/0 (socket says 172.21.15.153:57272) 2024-05-09T00:08:28.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd4e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480b2a50 0x7fcd4814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd4d600640 1 -- 172.21.15.153:0/1335504723 learned_addr learned my addr 172.21.15.153:0/1335504723 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.585+0000 7fcd4cc00640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd480ca780 0x7fcd4815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd4d600640 1 -- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480b2a50 msgr2=0x7fcd4814aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd4d600640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480b2a50 0x7fcd4814aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd4d600640 1 -- 172.21.15.153:0/1335504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd480ca780 msgr2=0x7fcd4815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd4d600640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd480ca780 0x7fcd4815b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd4d600640 1 -- 172.21.15.153:0/1335504723 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd480b0ce0 con 0x7fcd480b3050 2024-05-09T00:08:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd4d600640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815a640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00e8a0 tx=0x7fcd3c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c017070 con 0x7fcd480b3050 2024-05-09T00:08:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00ee90 con 0x7fcd480b3050 2024-05-09T00:08:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd481eeaa0 con 0x7fcd480b3050 2024-05-09T00:08:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00cb20 con 0x7fcd480b3050 2024-05-09T00:08:28.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.586+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd480b11b0 con 0x7fcd480b3050 2024-05-09T00:08:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.587+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd3c01a070 con 0x7fcd480b3050 2024-05-09T00:08:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.587+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcd3c00ccc0 con 0x7fcd480b3050 2024-05-09T00:08:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.588+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd480c7ca0 con 0x7fcd480b3050 2024-05-09T00:08:28.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.590+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcd480c7ca0 con 0x7fcd480b3050 2024-05-09T00:08:28.626 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:28.631+0000 7f2a2213f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:08:28.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.688+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a4bb8307-e545-40fb-bdce-02b394bc9a88", "id": 6} v 0) -- 0x7fcd480ae210 con 0x7fcd480b3050 2024-05-09T00:08:28.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.696+0000 7fcd45600640 1 -- 172.21.15.153:0/1335504723 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4bb8307-e545-40fb-bdce-02b394bc9a88", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcd480ae210 con 0x7fcd480b3050 2024-05-09T00:08:28.692 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-05-09T00:08:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.697+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 msgr2=0x7fcd4815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.697+0000 7fcd50000640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815a640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00e8a0 tx=0x7fcd3c00ed60 comp rx=0 tx=0).stop 2024-05-09T00:08:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.697+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 shutdown_connections 2024-05-09T00:08:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.697+0000 7fcd50000640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd480b2a50 0x7fcd4814aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.697+0000 7fcd50000640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd480ca780 0x7fcd4815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.698+0000 7fcd50000640 1 --2- 172.21.15.153:0/1335504723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd480b3050 0x7fcd4815a640 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.698+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 >> 172.21.15.153:0/1335504723 conn(0x7fcd480cdc50 msgr2=0x7fcd480ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:28.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.698+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 shutdown_connections 2024-05-09T00:08:28.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.698+0000 7fcd50000640 1 -- 172.21.15.153:0/1335504723 wait complete. 2024-05-09T00:08:28.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b 7 2024-05-09T00:08:28.767 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:28.771+0000 7f2a2213f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:08:28.864 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:28.868+0000 7f1963b17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:08:28.920 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:28.923+0000 7f1963b17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:08:28.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.969+0000 7f1998e00640 1 Processor -- start 2024-05-09T00:08:28.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.969+0000 7f1998e00640 1 -- start start 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.971+0000 7f1998e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f19940c8760 0x7f1994155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.971+0000 7f1998e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1994158b10 0x7f19940af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.971+0000 7f1998e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199415b7f0 con 0x7f19940af570 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.971+0000 7f1998e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f199415c5b0 con 0x7f19940c8760 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.971+0000 7f1998e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f199415bad0 con 0x7f1994158b10 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1994158b10 0x7f19940af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1993e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f19940af570 0x7f19940cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39362/0 (socket says 172.21.15.153:39362) 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1994158b10 0x7f19940af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35668/0 (socket says 172.21.15.153:35668) 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1993e00640 1 -- 172.21.15.153:0/4251200477 learned_addr learned my addr 172.21.15.153:0/4251200477 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1993400640 1 --2- 172.21.15.153:0/4251200477 >> v2:172.21.15.114:3300/0 conn(0x7f19940c8760 0x7f1994155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992a00640 1 -- 172.21.15.153:0/4251200477 >> v2:172.21.15.114:3300/0 conn(0x7f19940c8760 msgr2=0x7f1994155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992a00640 1 --2- 172.21.15.153:0/4251200477 >> v2:172.21.15.114:3300/0 conn(0x7f19940c8760 0x7f1994155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992a00640 1 -- 172.21.15.153:0/4251200477 >> v1:172.21.15.153:6789/0 conn(0x7f19940af570 legacy=0x7f19940cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992000640 1 -- 172.21.15.153:0/4251200477 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009402257 0 0) 0x7f199415b7f0 con 0x7f19940af570 2024-05-09T00:08:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.972+0000 7f1992a00640 1 -- 172.21.15.153:0/4251200477 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199415bdb0 con 0x7f1994158b10 2024-05-09T00:08:28.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.973+0000 7f1992a00640 1 --2- 172.21.15.153:0/4251200477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940af030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19940cdf70 tx=0x7f198002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a9f4de136eb5f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:28.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.974+0000 7f1992000640 1 -- 172.21.15.153:0/4251200477 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980037070 con 0x7f1994158b10 2024-05-09T00:08:28.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.974+0000 7f1992000640 1 -- 172.21.15.153:0/4251200477 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1980032440 con 0x7f1994158b10 2024-05-09T00:08:28.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.974+0000 7f1992000640 1 -- 172.21.15.153:0/4251200477 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980032810 con 0x7f1994158b10 2024-05-09T00:08:28.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 -- 172.21.15.153:0/4251200477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 msgr2=0x7f19940af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 --2- 172.21.15.153:0/4251200477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940af030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19940cdf70 tx=0x7f198002a1a0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 -- 172.21.15.153:0/4251200477 shutdown_connections 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 --2- 172.21.15.153:0/4251200477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940af030 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 --2- 172.21.15.153:0/4251200477 >> v2:172.21.15.114:3300/0 conn(0x7f19940c8760 0x7f1994155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 -- 172.21.15.153:0/4251200477 >> 172.21.15.153:0/4251200477 conn(0x7f1994068ef0 msgr2=0x7f19940cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 -- 172.21.15.153:0/4251200477 shutdown_connections 2024-05-09T00:08:28.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.975+0000 7f1998e00640 1 -- 172.21.15.153:0/4251200477 wait complete. 2024-05-09T00:08:28.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.979+0000 7f1998e00640 1 Processor -- start 2024-05-09T00:08:28.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.979+0000 7f1998e00640 1 -- start start 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1998e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 0x7f19940c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1998e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19940c8760 0x7f19940ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1998e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1998e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19940cd070 con 0x7f19940c8760 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1998e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1994155c80 con 0x7f1994158b10 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1998e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f19940cd1f0 con 0x7f19940af570 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1993400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 0x7f19940c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1993e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1993400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 0x7f19940c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:47446/0 (socket says 172.21.15.153:47446) 2024-05-09T00:08:28.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.981+0000 7f1993400640 1 -- 172.21.15.153:0/154619000 learned_addr learned my addr 172.21.15.153:0/154619000 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-09T00:08:28.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1992a00640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19940c8760 0x7f19940ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993400640 1 -- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 msgr2=0x7f19940c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993400640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993400640 1 -- 172.21.15.153:0/154619000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19940c8760 msgr2=0x7f19940ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993400640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19940c8760 0x7f19940ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993400640 1 -- 172.21.15.153:0/154619000 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19941ee420 con 0x7f19940af570 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993e00640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.982+0000 7f1993400640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 0x7f19940c6ef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f198400d620 tx=0x7f198400dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198400b620 con 0x7f19940af570 2024-05-09T00:08:28.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1984019070 con 0x7f19940af570 2024-05-09T00:08:28.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198400ba00 con 0x7f19940af570 2024-05-09T00:08:28.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19941ee700 con 0x7f19940af570 2024-05-09T00:08:28.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19941eecc0 con 0x7f19940af570 2024-05-09T00:08:28.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f198400bba0 con 0x7f19940af570 2024-05-09T00:08:28.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.983+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f198401eac0 con 0x7f19940af570 2024-05-09T00:08:28.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.984+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19941eef00 con 0x7f19940af570 2024-05-09T00:08:28.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:28.987+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f19941eef00 con 0x7f19940af570 2024-05-09T00:08:29.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.065+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b", "id": 7} v 0) -- 0x7f1994078430 con 0x7f19940af570 2024-05-09T00:08:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.073+0000 7f198b400640 1 -- 172.21.15.153:0/154619000 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f198401e460 con 0x7f19940af570 2024-05-09T00:08:29.068 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 msgr2=0x7f19940c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 0x7f19940c6ef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f198400d620 tx=0x7f198400dae0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 shutdown_connections 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1994158b10 0x7f19940c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19940c8760 0x7f19940ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 --2- 172.21.15.153:0/154619000 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19940af570 0x7f19940c6ef0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 >> 172.21.15.153:0/154619000 conn(0x7f1994068ef0 msgr2=0x7f19940b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 shutdown_connections 2024-05-09T00:08:29.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:08:29.074+0000 7f1998e00640 1 -- 172.21.15.153:0/154619000 wait complete. 2024-05-09T00:08:29.093 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T00:08:29.093 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T00:08:29.100 INFO:tasks.ceph.osd.0:Started 2024-05-09T00:08:29.101 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T00:08:29.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T00:08:29.108 INFO:tasks.ceph.osd.1:Started 2024-05-09T00:08:29.108 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T00:08:29.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T00:08:29.108 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:29.109+0000 7f1963b17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:08:29.115 INFO:tasks.ceph.osd.2:Started 2024-05-09T00:08:29.115 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T00:08:29.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T00:08:29.121 INFO:tasks.ceph.osd.3:Started 2024-05-09T00:08:29.121 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T00:08:29.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T00:08:29.128 INFO:tasks.ceph.osd.4:Started 2024-05-09T00:08:29.128 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T00:08:29.128 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T00:08:29.135 INFO:tasks.ceph.osd.5:Started 2024-05-09T00:08:29.135 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T00:08:29.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T00:08:29.136 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.140+0000 7f2a2213f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:08:29.141 INFO:tasks.ceph.osd.6:Started 2024-05-09T00:08:29.141 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T00:08:29.142 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T00:08:29.146 INFO:tasks.ceph.osd.7:Started 2024-05-09T00:08:29.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:29.206 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.210+0000 7f2a2213f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:08:29.345 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:29.348+0000 7f1963b17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:08:29.437 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:29.440+0000 7f1963b17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:08:29.454 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.459+0000 7f2a2213f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:08:29.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.474+0000 7fa315000640 1 Processor -- start 2024-05-09T00:08:29.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.474+0000 7fa315000640 1 -- start start 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.475+0000 7fa315000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310072720 0x7fa3100c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.475+0000 7fa315000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3101585c0 0x7fa3101589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.475+0000 7fa315000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa310074040 con 0x7fa310073800 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.475+0000 7fa315000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa310073df0 con 0x7fa3101585c0 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.475+0000 7fa315000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100c5f40 con 0x7fa310072720 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa310073800 0x7fa3100c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56446/0 (socket says 172.21.15.114:56446) 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30de00640 1 -- 172.21.15.114:0/4089801842 learned_addr learned my addr 172.21.15.114:0/4089801842 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30e800640 1 --2- 172.21.15.114:0/4089801842 >> v2:172.21.15.114:3300/0 conn(0x7fa3101585c0 0x7fa3101589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30d400640 1 --2- 172.21.15.114:0/4089801842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310072720 0x7fa3100c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30ca00640 1 -- 172.21.15.114:0/4089801842 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827654539 0 0) 0x7fa310074040 con 0x7fa310073800 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30ca00640 1 -- 172.21.15.114:0/4089801842 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f4003520 con 0x7fa310073800 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30d400640 1 -- 172.21.15.114:0/4089801842 >> v2:172.21.15.114:3300/0 conn(0x7fa3101585c0 msgr2=0x7fa3101589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30d400640 1 --2- 172.21.15.114:0/4089801842 >> v2:172.21.15.114:3300/0 conn(0x7fa3101585c0 0x7fa3101589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30d400640 1 -- 172.21.15.114:0/4089801842 >> v1:172.21.15.114:6789/0 conn(0x7fa310073800 legacy=0x7fa3100c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30d400640 1 -- 172.21.15.114:0/4089801842 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100c58f0 con 0x7fa310072720 2024-05-09T00:08:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.476+0000 7fa30e800640 1 --2- 172.21.15.114:0/4089801842 >> v2:172.21.15.114:3300/0 conn(0x7fa3101585c0 0x7fa3101589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.477+0000 7fa30d400640 1 --2- 172.21.15.114:0/4089801842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310072720 0x7fa3100c63d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0097a0 tx=0x7fa2fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5333cb4b0e01809f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.478+0000 7fa30ca00640 1 -- 172.21.15.114:0/4089801842 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc037070 con 0x7fa310072720 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.478+0000 7fa30ca00640 1 -- 172.21.15.114:0/4089801842 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc032440 con 0x7fa310072720 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.478+0000 7fa30ca00640 1 -- 172.21.15.114:0/4089801842 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc032810 con 0x7fa310072720 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.478+0000 7fa315000640 1 -- 172.21.15.114:0/4089801842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310072720 msgr2=0x7fa3100c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.478+0000 7fa315000640 1 --2- 172.21.15.114:0/4089801842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310072720 0x7fa3100c63d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0097a0 tx=0x7fa2fc02a180 comp rx=0 tx=0).stop 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.479+0000 7fa315000640 1 -- 172.21.15.114:0/4089801842 shutdown_connections 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.479+0000 7fa315000640 1 --2- 172.21.15.114:0/4089801842 >> v2:172.21.15.114:3300/0 conn(0x7fa3101585c0 0x7fa3101589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.479+0000 7fa315000640 1 --2- 172.21.15.114:0/4089801842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310072720 0x7fa3100c63d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.479+0000 7fa315000640 1 -- 172.21.15.114:0/4089801842 >> 172.21.15.114:0/4089801842 conn(0x7fa31006c680 msgr2=0x7fa31006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:29.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.479+0000 7fa315000640 1 -- 172.21.15.114:0/4089801842 shutdown_connections 2024-05-09T00:08:29.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.479+0000 7fa315000640 1 -- 172.21.15.114:0/4089801842 wait complete. 2024-05-09T00:08:29.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.481+0000 7fa315000640 1 Processor -- start 2024-05-09T00:08:29.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.481+0000 7fa315000640 1 -- start start 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.482+0000 7fa315000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa310072720 0x7fa31014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.482+0000 7fa315000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 0x7fa3101df200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.482+0000 7fa315000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101585c0 0x7fa3101f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.482+0000 7fa315000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa310074320 con 0x7fa3101585c0 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.482+0000 7fa315000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa310072b30 con 0x7fa310072720 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.482+0000 7fa315000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa31014d720 con 0x7fa310073800 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 0x7fa3101df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101585c0 0x7fa3101f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa310072720 0x7fa31014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 0x7fa3101df200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43382/0 (socket says 172.21.15.114:43382) 2024-05-09T00:08:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30d400640 1 -- 172.21.15.114:0/139804159 learned_addr learned my addr 172.21.15.114:0/139804159 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30e800640 1 -- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 msgr2=0x7fa3101df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30e800640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 0x7fa3101df200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30e800640 1 -- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa310072720 msgr2=0x7fa31014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30e800640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa310072720 0x7fa31014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30e800640 1 -- 172.21.15.114:0/139804159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3101f6a00 con 0x7fa3101585c0 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.483+0000 7fa30d400640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 0x7fa3101df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa30e800640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101585c0 0x7fa3101f5fc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3100c6cd0 tx=0x7fa30800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308018020 con 0x7fa3101585c0 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa308014480 con 0x7fa3101585c0 2024-05-09T00:08:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310155a00 con 0x7fa3101585c0 2024-05-09T00:08:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308014870 con 0x7fa3101585c0 2024-05-09T00:08:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31014e630 con 0x7fa3101585c0 2024-05-09T00:08:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa308005d10 con 0x7fa3101585c0 2024-05-09T00:08:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.484+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa308009970 con 0x7fa3101585c0 2024-05-09T00:08:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.485+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31014e460 con 0x7fa3101585c0 2024-05-09T00:08:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.488+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa308022030 con 0x7fa3101585c0 2024-05-09T00:08:29.523 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:29.526+0000 7f1963b17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:08:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.553+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa310069d90 con 0x7fa3101585c0 2024-05-09T00:08:29.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.554+0000 7fa306000640 1 -- 172.21.15.114:0/139804159 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa310069d90 con 0x7fa3101585c0 2024-05-09T00:08:29.550 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:29.550 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:29.067375+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101585c0 msgr2=0x7fa3101f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101585c0 0x7fa3101f5fc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3100c6cd0 tx=0x7fa30800ef90 comp rx=0 tx=0).stop 2024-05-09T00:08:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 shutdown_connections 2024-05-09T00:08:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101585c0 0x7fa3101f5fc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa310073800 0x7fa3101df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 --2- 172.21.15.114:0/139804159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa310072720 0x7fa31014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 >> 172.21.15.114:0/139804159 conn(0x7fa31006c680 msgr2=0x7fa310157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 shutdown_connections 2024-05-09T00:08:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:29.555+0000 7fa315000640 1 -- 172.21.15.114:0/139804159 wait complete. 2024-05-09T00:08:29.573 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T00:08:29.573 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T00:08:29.580 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:29.584+0000 7f1963b17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:08:29.623 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.627+0000 7f2a2213f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:08:29.683 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.688+0000 7f2a2213f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:08:29.764 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.768+0000 7f2a2213f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:08:29.817 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:29.821+0000 7f2a2213f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:08:29.874 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-09T00:08:29.878+0000 7fe850213640 -1 Falling back to public interface 2024-05-09T00:08:29.886 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-09T00:08:29.890+0000 7f093160f640 -1 Falling back to public interface 2024-05-09T00:08:29.901 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-09T00:08:29.905+0000 7ff6cf61e640 -1 Falling back to public interface 2024-05-09T00:08:29.908 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-09T00:08:29.912+0000 7fe9d53fc640 -1 Falling back to public interface 2024-05-09T00:08:29.922 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-09T00:08:29.927+0000 7fdf05f55640 -1 Falling back to public interface 2024-05-09T00:08:29.941 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-05-09T00:08:29.944+0000 7fe5ba686640 -1 Falling back to public interface 2024-05-09T00:08:29.945 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-09T00:08:29.949+0000 7f0958423640 -1 Falling back to public interface 2024-05-09T00:08:29.972 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-09T00:08:29.976+0000 7fc71d753640 -1 Falling back to public interface 2024-05-09T00:08:30.128 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:30.131+0000 7f1963b17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:08:30.263 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:30.267+0000 7f1963b17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:08:30.376 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:30.381+0000 7f2a2213f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:08:30.379 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:30.511 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-09T00:08:30.515+0000 7f2a2213f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:08:30.593 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.596+0000 7ff6ce200640 1 Processor -- start 2024-05-09T00:08:30.593 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.597+0000 7ff6ce200640 1 -- start start 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.598+0000 7ff6ce200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6c80ca0d0 0x7ff6c806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.598+0000 7ff6ce200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c815c3a0 con 0x7ff6c806eea0 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.598+0000 7ff6ce200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c806e1c0 con 0x7ff6c80ca880 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.598+0000 7ff6ce200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff6c815c640 con 0x7ff6c80ca0d0 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff6c806eea0 0x7ff6c8158720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56452/0 (socket says 172.21.15.114:56452) 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c7e00640 1 -- 172.21.15.114:0/704160674 learned_addr learned my addr 172.21.15.114:0/704160674 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:30.595 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6a00640 1 --2- 172.21.15.114:0/704160674 >> v2:172.21.15.153:3300/0 conn(0x7ff6c80ca0d0 0x7ff6c806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416356137 0 0) 0x7ff6c815c3a0 con 0x7ff6c806eea0 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6ac003520 con 0x7ff6c806eea0 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1955408544 0 0) 0x7ff6ac003520 con 0x7ff6c806eea0 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 >> v2:172.21.15.153:3300/0 conn(0x7ff6c80ca0d0 msgr2=0x7ff6c806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 --2- 172.21.15.114:0/704160674 >> v2:172.21.15.153:3300/0 conn(0x7ff6c80ca0d0 0x7ff6c806e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 >> v1:172.21.15.153:6789/0 conn(0x7ff6c80ca880 legacy=0x7ff6c80c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c80cad40 con 0x7ff6c806eea0 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.599+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7ff6c0001a90 con 0x7ff6c806eea0 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 >> v1:172.21.15.114:6789/0 conn(0x7ff6c806eea0 legacy=0x7ff6c8158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:30.598 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac003a50 0x7ff6ac003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6ac004800 0x7ff6ac004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ac0053a0 0x7ff6ac00ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c815c640 con 0x7ff6ac0053a0 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac00c330 con 0x7ff6ac003a50 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ac00c530 con 0x7ff6ac004800 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7e00640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ac0053a0 0x7ff6ac00ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7400640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac003a50 0x7ff6ac003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c6a00640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6ac004800 0x7ff6ac004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7e00640 1 -- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6ac004800 msgr2=0x7ff6ac004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7e00640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6ac004800 0x7ff6ac004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7e00640 1 -- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac003a50 msgr2=0x7ff6ac003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7e00640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac003a50 0x7ff6ac003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.600+0000 7ff6c7e00640 1 -- 172.21.15.114:0/704160674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac003520 con 0x7ff6ac0053a0 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.601+0000 7ff6c7e00640 1 -- 172.21.15.114:0/704160674 reap_dead start 2024-05-09T00:08:30.599 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.601+0000 7ff6c7e00640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ac0053a0 0x7ff6ac00ba50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6c815c570 tx=0x7ff6ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57240db5a3717898 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:30.600 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.601+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000a500 con 0x7ff6ac0053a0 2024-05-09T00:08:30.600 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c002f070 con 0x7ff6ac0053a0 2024-05-09T00:08:30.600 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6c6000640 1 -- 172.21.15.114:0/704160674 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c002bbd0 con 0x7ff6ac0053a0 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 -- 172.21.15.114:0/704160674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ac0053a0 msgr2=0x7ff6ac00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ac0053a0 0x7ff6ac00ba50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6c815c570 tx=0x7ff6ac005830 comp rx=0 tx=0).stop 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 -- 172.21.15.114:0/704160674 shutdown_connections 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 --2- 172.21.15.114:0/704160674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ac0053a0 0x7ff6ac00ba50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 -- 172.21.15.114:0/704160674 >> 172.21.15.114:0/704160674 conn(0x7ff6c80ad580 msgr2=0x7ff6c80ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 -- 172.21.15.114:0/704160674 shutdown_connections 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.602+0000 7ff6ce200640 1 -- 172.21.15.114:0/704160674 wait complete. 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.604+0000 7ff6ce200640 1 Processor -- start 2024-05-09T00:08:30.601 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.605+0000 7ff6ce200640 1 -- start start 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6ce200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0053a0 0x7ff6c81f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6ce200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 0x7ff6c8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6ce200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c8156cd0 0x7ff6c80af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6ce200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c806e960 con 0x7ff6c8157930 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6ce200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c80c93f0 con 0x7ff6ac0053a0 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6ce200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c806eae0 con 0x7ff6c8156cd0 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6c6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 0x7ff6c8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6c6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 0x7ff6c8156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49986/0 (socket says 172.21.15.114:49986) 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6c6a00640 1 -- 172.21.15.114:0/3100174209 learned_addr learned my addr 172.21.15.114:0/3100174209 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6c7400640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0053a0 0x7ff6c81f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.606+0000 7ff6c7e00640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c8156cd0 0x7ff6c80af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:30.603 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6c6a00640 1 -- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c8156cd0 msgr2=0x7ff6c80af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:30.604 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6c6a00640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c8156cd0 0x7ff6c80af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.604 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6c6a00640 1 -- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0053a0 msgr2=0x7ff6c81f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:30.604 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6c6a00640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0053a0 0x7ff6c81f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.604 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6c6a00640 1 -- 172.21.15.114:0/3100174209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c81f2050 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6c6a00640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 0x7ff6c8156790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4011590 tx=0x7ff6b4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4015930 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b4015ad0 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c80ae5c0 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b401d400 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.607+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c809d6e0 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.608+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c806da50 con 0x7ff6c8157930 2024-05-09T00:08:30.605 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.609+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 2) ==== 49122+0+0 (secure 0 0 0) 0x7ff6b4013400 con 0x7ff6c8157930 2024-05-09T00:08:30.606 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.609+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff6b4051090 con 0x7ff6c8157930 2024-05-09T00:08:30.607 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.611+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff6c806da50 con 0x7ff6c8157930 2024-05-09T00:08:30.670 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.674+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6c8157490 con 0x7ff6c8157930 2024-05-09T00:08:30.671 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.675+0000 7ff6bf400640 1 -- 172.21.15.114:0/3100174209 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff6c8157490 con 0x7ff6c8157930 2024-05-09T00:08:30.671 INFO:teuthology.misc.health.smithi114.stdout: 2024-05-09T00:08:30.671 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:29.067375+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:30.672 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 msgr2=0x7ff6c8156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:30.672 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 0x7ff6c8156790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4011590 tx=0x7ff6b4011a50 comp rx=0 tx=0).stop 2024-05-09T00:08:30.672 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 shutdown_connections 2024-05-09T00:08:30.672 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c8156cd0 0x7ff6c80af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.672 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c8157930 0x7ff6c8156790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.672 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 --2- 172.21.15.114:0/3100174209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6ac0053a0 0x7ff6c81f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:30.673 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 >> 172.21.15.114:0/3100174209 conn(0x7ff6c80ad580 msgr2=0x7ff6c8071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:30.673 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 shutdown_connections 2024-05-09T00:08:30.673 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:30.676+0000 7ff6ce200640 1 -- 172.21.15.114:0/3100174209 wait complete. 2024-05-09T00:08:30.691 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T00:08:31.304 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:31.308+0000 7f1903800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T00:08:31.309 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-05-09T00:08:31.311+0000 7f1903800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T00:08:33.250 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-09T00:08:33.255+0000 7fe850213640 -1 osd.4 0 log_to_monitors true 2024-05-09T00:08:33.467 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-09T00:08:33.471+0000 7f093160f640 -1 osd.6 0 log_to_monitors true 2024-05-09T00:08:33.488 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-09T00:08:33.492+0000 7ff6cf61e640 -1 osd.2 0 log_to_monitors true 2024-05-09T00:08:33.514 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-09T00:08:33.518+0000 7fe9d53fc640 -1 osd.3 0 log_to_monitors true 2024-05-09T00:08:33.553 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-09T00:08:33.557+0000 7fdf05f55640 -1 osd.7 0 log_to_monitors true 2024-05-09T00:08:33.569 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-09T00:08:33.573+0000 7f0958423640 -1 osd.1 0 log_to_monitors true 2024-05-09T00:08:33.583 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-05-09T00:08:33.587+0000 7fe5ba686640 -1 osd.0 0 log_to_monitors true 2024-05-09T00:08:33.607 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-09T00:08:33.612+0000 7fc71d753640 -1 osd.5 0 log_to_monitors true 2024-05-09T00:08:35.862 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-09T00:08:35.866+0000 7fe84aa00640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T00:08:36.015 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-09T00:08:36.019+0000 7fe840a00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.305 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-09T00:08:37.310+0000 7fdf00e00640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T00:08:37.314 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-09T00:08:37.318+0000 7fdef6e00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.374 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-09T00:08:37.379+0000 7fc719000640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T00:08:37.385 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-09T00:08:37.389+0000 7fc70e600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.400 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-09T00:08:37.404+0000 7f092be00640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T00:08:37.407 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-09T00:08:37.412+0000 7f0921e00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.498 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:37.702 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-09T00:08:37.706+0000 7f0953200640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T00:08:37.712 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-09T00:08:37.716+0000 7f0949200640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.743 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-05-09T00:08:37.746+0000 7fe5b5600640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T00:08:37.757 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-05-09T00:08:37.761+0000 7fe5ab600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.782 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-09T00:08:37.786+0000 7fe9d0200640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T00:08:37.788 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-09T00:08:37.792+0000 7fe9c6200640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.820 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-09T00:08:37.824+0000 7ff6caa00640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T00:08:37.828 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.832+0000 7f926c800640 1 Processor -- start 2024-05-09T00:08:37.829 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.832+0000 7f926c800640 1 -- start start 2024-05-09T00:08:37.830 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.834+0000 7f926c800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92640b2ca0 0x7f9264158e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:37.830 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.834+0000 7f926c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 0x7f926415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:37.831 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-09T00:08:37.834+0000 7ff6c0000640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:08:37.831 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.834+0000 7f926c800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92640cb670 con 0x7f92640cc5c0 2024-05-09T00:08:37.831 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.834+0000 7f926c800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f92640cbb20 con 0x7f92640b2ca0 2024-05-09T00:08:37.831 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.834+0000 7f926c800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92640c8a30 con 0x7f926415b8e0 2024-05-09T00:08:37.831 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.835+0000 7f9269400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 0x7f926415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:37.831 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.835+0000 7f9269e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92640b2ca0 0x7f9264158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:37.831 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.835+0000 7f9269400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 0x7f926415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43072/0 (socket says 172.21.15.114:43072) 2024-05-09T00:08:37.832 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.835+0000 7f9269e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92640b2ca0 0x7f9264158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:39314/0 (socket says 172.21.15.114:39314) 2024-05-09T00:08:37.832 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.835+0000 7f9269400640 1 -- 172.21.15.114:0/961240174 learned_addr learned my addr 172.21.15.114:0/961240174 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:37.832 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.836+0000 7f9269e00640 1 -- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 msgr2=0x7f926415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:37.832 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.836+0000 7f9269e00640 1 --2- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 0x7f926415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:37.832 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.836+0000 7f9269e00640 1 -- 172.21.15.114:0/961240174 >> v1:172.21.15.153:6789/0 conn(0x7f92640cc5c0 legacy=0x7f92640cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:37.832 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.836+0000 7f9269e00640 1 -- 172.21.15.114:0/961240174 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92640cbdc0 con 0x7f92640b2ca0 2024-05-09T00:08:37.833 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.836+0000 7f9269400640 1 --2- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 0x7f926415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:37.833 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.837+0000 7f9269e00640 1 --2- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92640b2ca0 0x7f9264158e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92580097a0 tx=0x7f925802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b611e43448f59ca0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:37.834 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.837+0000 7f9268a00640 1 -- 172.21.15.114:0/961240174 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258037070 con 0x7f92640b2ca0 2024-05-09T00:08:37.834 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.837+0000 7f9268a00640 1 -- 172.21.15.114:0/961240174 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925802ae50 con 0x7f92640b2ca0 2024-05-09T00:08:37.834 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.837+0000 7f9268a00640 1 -- 172.21.15.114:0/961240174 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258032660 con 0x7f92640b2ca0 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 -- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92640b2ca0 msgr2=0x7f9264158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 --2- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92640b2ca0 0x7f9264158e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92580097a0 tx=0x7f925802a100 comp rx=0 tx=0).stop 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 -- 172.21.15.114:0/961240174 shutdown_connections 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 --2- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926415b8e0 0x7f926415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 --2- 172.21.15.114:0/961240174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92640b2ca0 0x7f9264158e40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 -- 172.21.15.114:0/961240174 >> 172.21.15.114:0/961240174 conn(0x7f9264069120 msgr2=0x7f92640af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 -- 172.21.15.114:0/961240174 shutdown_connections 2024-05-09T00:08:37.835 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.838+0000 7f926c800640 1 -- 172.21.15.114:0/961240174 wait complete. 2024-05-09T00:08:37.836 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.840+0000 7f926c800640 1 Processor -- start 2024-05-09T00:08:37.837 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.841+0000 7f926c800640 1 -- start start 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 0x7f926414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92640cc5c0 0x7f92640ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926c800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f926415b8e0 0x7f92641f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92640ca8a0 con 0x7f92640b2ca0 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926c800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92640cd0e0 con 0x7f926415b8e0 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926c800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92640caa20 con 0x7f92640cc5c0 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f9269e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 0x7f926414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f9269e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 0x7f926414f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45582/0 (socket says 172.21.15.114:45582) 2024-05-09T00:08:37.840 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f9269e00640 1 -- 172.21.15.114:0/61699896 learned_addr learned my addr 172.21.15.114:0/61699896 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f9269400640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92640cc5c0 0x7f92640ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.842+0000 7f926a800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f926415b8e0 0x7f92641f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269e00640 1 -- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92640cc5c0 msgr2=0x7f92640ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269e00640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92640cc5c0 0x7f92640ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269e00640 1 -- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f926415b8e0 msgr2=0x7f92641f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269e00640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f926415b8e0 0x7f92641f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269e00640 1 -- 172.21.15.114:0/61699896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92641ee4b0 con 0x7f92640b2ca0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269400640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92640cc5c0 0x7f92640ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f926a800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f926415b8e0 0x7f92641f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f9269e00640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 0x7f926414f3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92580098c0 tx=0x7f92580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258041030 con 0x7f92640b2ca0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925802ac50 con 0x7f92640b2ca0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92641ee790 con 0x7f92640b2ca0 2024-05-09T00:08:37.841 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258037040 con 0x7f92640b2ca0 2024-05-09T00:08:37.842 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.843+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92641eed50 con 0x7f92640b2ca0 2024-05-09T00:08:37.842 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.844+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92640783c0 con 0x7f92640b2ca0 2024-05-09T00:08:37.842 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.845+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f9258044070 con 0x7f92640b2ca0 2024-05-09T00:08:37.842 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.846+0000 7f925e000640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9248076270 0x7f9248078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:37.843 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.846+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f92580b6e20 con 0x7f92640b2ca0 2024-05-09T00:08:37.843 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.847+0000 7f9269400640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9248076270 0x7f9248078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:37.843 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.847+0000 7f9269400640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9248076270 0x7f9248078780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92640b2b70 tx=0x7f9254008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:37.848 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:37.852+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f92580814e0 con 0x7f92640b2ca0 2024-05-09T00:08:38.055 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.059+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92640c6ea0 con 0x7f92640b2ca0 2024-05-09T00:08:38.057 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.061+0000 7f925e000640 1 -- 172.21.15.114:0/61699896 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10980 (secure 0 0 0) 0x7f9258080de0 con 0x7f92640b2ca0 2024-05-09T00:08:38.058 INFO:teuthology.misc.health.smithi114.stdout: 2024-05-09T00:08:38.058 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":15,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:37.972589+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9248076270 msgr2=0x7f9248078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9248076270 0x7f9248078780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92640b2b70 tx=0x7f9254008040 comp rx=0 tx=0).stop 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 msgr2=0x7f926414f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 0x7f926414f3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92580098c0 tx=0x7f92580046c0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 shutdown_connections 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9248076270 0x7f9248078780 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.061 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f926415b8e0 0x7f92641f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.062 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.064+0000 7f926c800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92640cc5c0 0x7f92640ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.062 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.065+0000 7f926c800640 1 --2- 172.21.15.114:0/61699896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92640b2ca0 0x7f926414f3c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.062 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.065+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 >> 172.21.15.114:0/61699896 conn(0x7f9264069120 msgr2=0x7f92640c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:38.062 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.065+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 shutdown_connections 2024-05-09T00:08:38.062 INFO:teuthology.misc.health.smithi114.stderr:2024-05-09T00:08:38.065+0000 7f926c800640 1 -- 172.21.15.114:0/61699896 wait complete. 2024-05-09T00:08:38.081 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T00:08:38.081 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T00:08:38.081 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T00:08:38.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T00:08:38.086 INFO:tasks.ceph.mds.a:Started 2024-05-09T00:08:38.086 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T00:08:38.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T00:08:38.092 INFO:tasks.ceph.mds.c:Started 2024-05-09T00:08:38.092 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T00:08:38.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T00:08:38.100 INFO:tasks.ceph.mds.b:Started 2024-05-09T00:08:38.100 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T00:08:38.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T00:08:38.108 INFO:tasks.ceph.mds.d:Started 2024-05-09T00:08:38.108 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T00:08:38.109 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:08:38.294 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-05-09T00:08:38.295 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-05-09T00:08:38.324 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-09T00:08:38.332 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-09T00:08:38.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.354+0000 7f71e9200640 1 Processor -- start 2024-05-09T00:08:38.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.354+0000 7f71e9200640 1 -- start start 2024-05-09T00:08:38.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e40c8530 0x7f71e4158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e9200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f71e4158f70 0x7f71e415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e9200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71e415c4d0 0x7f71e40c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e9200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f71e415bb00 con 0x7f71e415c4d0 2024-05-09T00:08:38.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e9200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f71e40c82d0 con 0x7f71e4158f70 2024-05-09T00:08:38.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71e40c9500 con 0x7f71e40c8530 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71e415c4d0 0x7f71e40c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71e415c4d0 0x7f71e40c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45626/0 (socket says 172.21.15.114:45626) 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 -- 172.21.15.114:0/3355371648 learned_addr learned my addr 172.21.15.114:0/3355371648 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71dbe00640 1 --2- 172.21.15.114:0/3355371648 >> v2:172.21.15.153:3300/0 conn(0x7f71e4158f70 0x7f71e415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e1e00640 1 --2- 172.21.15.114:0/3355371648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e40c8530 0x7f71e4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 -- 172.21.15.114:0/3355371648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e40c8530 msgr2=0x7f71e4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 --2- 172.21.15.114:0/3355371648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e40c8530 0x7f71e4158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 -- 172.21.15.114:0/3355371648 >> v2:172.21.15.153:3300/0 conn(0x7f71e4158f70 msgr2=0x7f71e415bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 --2- 172.21.15.114:0/3355371648 >> v2:172.21.15.153:3300/0 conn(0x7f71e4158f70 0x7f71e415bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.356+0000 7f71e2800640 1 -- 172.21.15.114:0/3355371648 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e40c97e0 con 0x7f71e415c4d0 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.358+0000 7f71e2800640 1 --2- 172.21.15.114:0/3355371648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e40c6780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71e40cad80 tx=0x7f71dc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395a0b7ba7e883f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.358+0000 7f71e1400640 1 -- 172.21.15.114:0/3355371648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc036070 con 0x7f71e415c4d0 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.358+0000 7f71e1400640 1 -- 172.21.15.114:0/3355371648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc031600 con 0x7f71e415c4d0 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.358+0000 7f71e1400640 1 -- 172.21.15.114:0/3355371648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0319d0 con 0x7f71e415c4d0 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 -- 172.21.15.114:0/3355371648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 msgr2=0x7f71e40c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 --2- 172.21.15.114:0/3355371648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e40c6780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71e40cad80 tx=0x7f71dc02a610 comp rx=0 tx=0).stop 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 -- 172.21.15.114:0/3355371648 shutdown_connections 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 --2- 172.21.15.114:0/3355371648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e40c6780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 --2- 172.21.15.114:0/3355371648 >> v2:172.21.15.153:3300/0 conn(0x7f71e4158f70 0x7f71e415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 --2- 172.21.15.114:0/3355371648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e40c8530 0x7f71e4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 -- 172.21.15.114:0/3355371648 >> 172.21.15.114:0/3355371648 conn(0x7f71e40c9d40 msgr2=0x7f71e40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:38.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 -- 172.21.15.114:0/3355371648 shutdown_connections 2024-05-09T00:08:38.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.359+0000 7f71e9200640 1 -- 172.21.15.114:0/3355371648 wait complete. 2024-05-09T00:08:38.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.361+0000 7f71e9200640 1 Processor -- start 2024-05-09T00:08:38.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.361+0000 7f71e9200640 1 -- start start 2024-05-09T00:08:38.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.362+0000 7f71e9200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e40c8530 0x7f71e41570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.362+0000 7f71e9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e4158f70 0x7f71e4153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.362+0000 7f71e9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e4154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.362+0000 7f71e9200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40c7fe0 con 0x7f71e415c4d0 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.362+0000 7f71e9200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40c7e60 con 0x7f71e40c8530 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.362+0000 7f71e9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71e40c6cc0 con 0x7f71e4158f70 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e40c8530 0x7f71e41570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e4158f70 0x7f71e4153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e40c8530 0x7f71e41570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:39378/0 (socket says 172.21.15.114:39378) 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e4158f70 0x7f71e4153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43138/0 (socket says 172.21.15.114:43138) 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e1e00640 1 -- 172.21.15.114:0/1941977307 learned_addr learned my addr 172.21.15.114:0/1941977307 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e2800640 1 -- 172.21.15.114:0/1941977307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e4158f70 msgr2=0x7f71e4153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e2800640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e4158f70 0x7f71e4153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e2800640 1 -- 172.21.15.114:0/1941977307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e40c8530 msgr2=0x7f71e41570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e2800640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e40c8530 0x7f71e41570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.363+0000 7f71e2800640 1 -- 172.21.15.114:0/1941977307 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e4158590 con 0x7f71e415c4d0 2024-05-09T00:08:38.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.364+0000 7f71e2800640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e4154080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71e40cae00 tx=0x7f71dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:38.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.364+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc036030 con 0x7f71e415c4d0 2024-05-09T00:08:38.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.364+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc040070 con 0x7f71e415c4d0 2024-05-09T00:08:38.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.364+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc009510 con 0x7f71e415c4d0 2024-05-09T00:08:38.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.364+0000 7f71e9200640 1 -- 172.21.15.114:0/1941977307 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e41f1fe0 con 0x7f71e415c4d0 2024-05-09T00:08:38.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.364+0000 7f71e9200640 1 -- 172.21.15.114:0/1941977307 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e41e31c0 con 0x7f71e415c4d0 2024-05-09T00:08:38.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.365+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b4005290 con 0x7f71e415c4d0 2024-05-09T00:08:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.366+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f71dc007bf0 con 0x7f71e415c4d0 2024-05-09T00:08:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.367+0000 7f71da000640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71c0076240 0x7f71c0078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.367+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7f71dc0b7660 con 0x7f71e415c4d0 2024-05-09T00:08:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.368+0000 7f71e1e00640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71c0076240 0x7f71c0078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.368+0000 7f71e1e00640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71c0076240 0x7f71c0078750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009a80 tx=0x7f71d4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:38.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.372+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f71dc080f10 con 0x7f71e415c4d0 2024-05-09T00:08:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.599+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71b4005580 con 0x7f71e415c4d0 2024-05-09T00:08:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.599+0000 7f71da000640 1 -- 172.21.15.114:0/1941977307 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f71dc085210 con 0x7f71e415c4d0 2024-05-09T00:08:38.596 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:38.596 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T00:08:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71c0076240 msgr2=0x7f71c0078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71c0076240 0x7f71c0078750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009a80 tx=0x7f71d4009190 comp rx=0 tx=0).stop 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 msgr2=0x7f71e4154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e4154080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71e40cae00 tx=0x7f71dc004a40 comp rx=0 tx=0).stop 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 shutdown_connections 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71c0076240 0x7f71c0078750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e415c4d0 0x7f71e4154080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71e4158f70 0x7f71e4153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 --2- 172.21.15.114:0/1941977307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e40c8530 0x7f71e41570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 >> 172.21.15.114:0/1941977307 conn(0x7f71e40c9d40 msgr2=0x7f71e40a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 shutdown_connections 2024-05-09T00:08:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:38.602+0000 7f71d3400640 1 -- 172.21.15.114:0/1941977307 wait complete. 2024-05-09T00:08:39.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:08:39.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:08:40.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:08:40.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.882+0000 7f773b200640 1 Processor -- start 2024-05-09T00:08:40.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.883+0000 7f773b200640 1 -- start start 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.884+0000 7f773b200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7734153760 0x7f7734159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.884+0000 7f773b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 0x7f77340aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.884+0000 7f773b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7734156bb0 con 0x7f77340c43c0 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.884+0000 7f773b200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f77340ac710 con 0x7f7734153760 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.884+0000 7f773b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7734156e90 con 0x7f77340ae940 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7733e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f77340c43c0 0x7f7734159830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58686/0 (socket says 172.21.15.114:58686) 2024-05-09T00:08:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7733e00640 1 -- 172.21.15.114:0/4121078929 learned_addr learned my addr 172.21.15.114:0/4121078929 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7739200640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 0x7f77340aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7733400640 1 --2- 172.21.15.114:0/4121078929 >> v2:172.21.15.153:3300/0 conn(0x7f7734153760 0x7f7734159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448580067 0 0) 0x7f7734156bb0 con 0x7f77340c43c0 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7718003520 con 0x7f77340c43c0 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1184196881 0 0) 0x7f7718003520 con 0x7f77340c43c0 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 msgr2=0x7f77340aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 0x7f77340aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 >> v2:172.21.15.153:3300/0 conn(0x7f7734153760 msgr2=0x7f7734159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.885+0000 7f7732a00640 1 --2- 172.21.15.114:0/4121078929 >> v2:172.21.15.153:3300/0 conn(0x7f7734153760 0x7f7734159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77340ac960 con 0x7f77340c43c0 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f772c001a70 con 0x7f77340c43c0 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 >> v1:172.21.15.114:6789/0 conn(0x7f77340c43c0 legacy=0x7f7734159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7718003a00 0x7f7718003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 0x7f7718004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f7718005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77340ac710 con 0x7f7718004d40 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7734156e90 con 0x7f7718003a00 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f771800baf0 con 0x7f77340ae940 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7739200640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f7718005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7733400640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 0x7f7718004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7739200640 1 -- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 msgr2=0x7f7718004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7739200640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77340ae940 0x7f7718004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7739200640 1 -- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7718003a00 msgr2=0x7f7718003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7739200640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7718003a00 0x7f7718003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.886+0000 7f7739200640 1 -- 172.21.15.114:0/4121078929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7718003520 con 0x7f7718004d40 2024-05-09T00:08:40.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.887+0000 7f7739200640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f7718005150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7724009ac0 tx=0x7f7718005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d5687fc62e34d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724036070 con 0x7f7718004d40 2024-05-09T00:08:40.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7724031400 con 0x7f7718004d40 2024-05-09T00:08:40.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f7732a00640 1 -- 172.21.15.114:0/4121078929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724009690 con 0x7f7718004d40 2024-05-09T00:08:40.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f773b200640 1 -- 172.21.15.114:0/4121078929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 msgr2=0x7f7718005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f773b200640 1 --2- 172.21.15.114:0/4121078929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f7718005150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7724009ac0 tx=0x7f7718005830 comp rx=0 tx=0).stop 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f7739200640 1 -- 172.21.15.114:0/4121078929 reap_dead start 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f773b200640 1 -- 172.21.15.114:0/4121078929 shutdown_connections 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.888+0000 7f773b200640 1 -- 172.21.15.114:0/4121078929 >> 172.21.15.114:0/4121078929 conn(0x7f773406c680 msgr2=0x7f773406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.889+0000 7f773b200640 1 -- 172.21.15.114:0/4121078929 shutdown_connections 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.889+0000 7f773b200640 1 -- 172.21.15.114:0/4121078929 wait complete. 2024-05-09T00:08:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.891+0000 7f773b200640 1 Processor -- start 2024-05-09T00:08:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.891+0000 7f773b200640 1 -- start start 2024-05-09T00:08:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.892+0000 7f773b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f773414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.892+0000 7f773b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77341ec3d0 0x7f7734148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.892+0000 7f773b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77341ec7e0 0x7f77341489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f773b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77340ad3c0 con 0x7f7718004d40 2024-05-09T00:08:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f773b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f773415a480 con 0x7f77341ec7e0 2024-05-09T00:08:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f773b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f77340aed50 con 0x7f77341ec3d0 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f773414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f773414a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45684/0 (socket says 172.21.15.114:45684) 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 -- 172.21.15.114:0/1918486492 learned_addr learned my addr 172.21.15.114:0/1918486492 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7739200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77341ec7e0 0x7f77341489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733400640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77341ec3d0 0x7f7734148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 -- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77341ec3d0 msgr2=0x7f7734148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77341ec3d0 0x7f7734148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 -- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77341ec7e0 msgr2=0x7f77341489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77341ec7e0 0x7f77341489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7733e00640 1 -- 172.21.15.114:0/1918486492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7734159300 con 0x7f7718004d40 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.893+0000 7f7739200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77341ec7e0 0x7f77341489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.894+0000 7f7733e00640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f773414a640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f772c00cb20 tx=0x7f772c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.894+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c018070 con 0x7f7718004d40 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.894+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c00a7d0 con 0x7f7718004d40 2024-05-09T00:08:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.894+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7734149000 con 0x7f7718004d40 2024-05-09T00:08:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.894+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c00abc0 con 0x7f7718004d40 2024-05-09T00:08:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.894+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7734152dc0 con 0x7f7718004d40 2024-05-09T00:08:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.895+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7734077430 con 0x7f7718004d40 2024-05-09T00:08:40.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.897+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f772c01b070 con 0x7f7718004d40 2024-05-09T00:08:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.898+0000 7f772be00640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7714076270 0x7f7714078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.898+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f772c096da0 con 0x7f7718004d40 2024-05-09T00:08:40.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.898+0000 7f7733400640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7714076270 0x7f7714078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.899+0000 7f7733400640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7714076270 0x7f7714078780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77341528b0 tx=0x7f7720008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:40.903+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f772c060ba0 con 0x7f7718004d40 2024-05-09T00:08:41.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.035+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f772c05c730 con 0x7f7718004d40 2024-05-09T00:08:41.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.161+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77340c6ca0 con 0x7f7718004d40 2024-05-09T00:08:41.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.163+0000 7f772be00640 1 -- 172.21.15.114:0/1918486492 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f772c071dd0 con 0x7f7718004d40 2024-05-09T00:08:41.159 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:41.159 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T00:08:41.159 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2024-05-09T00:08:41.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7714076270 msgr2=0x7f7714078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7714076270 0x7f7714078780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77341528b0 tx=0x7f7720008040 comp rx=0 tx=0).stop 2024-05-09T00:08:41.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 msgr2=0x7f773414a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f773414a640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f772c00cb20 tx=0x7f772c00a060 comp rx=0 tx=0).stop 2024-05-09T00:08:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 shutdown_connections 2024-05-09T00:08:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7714076270 0x7f7714078780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77341ec7e0 0x7f77341489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77341ec3d0 0x7f7734148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 --2- 172.21.15.114:0/1918486492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7718004d40 0x7f773414a640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.165+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 >> 172.21.15.114:0/1918486492 conn(0x7f773406c680 msgr2=0x7f77340c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.166+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 shutdown_connections 2024-05-09T00:08:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.166+0000 7f773b200640 1 -- 172.21.15.114:0/1918486492 wait complete. 2024-05-09T00:08:41.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T00:08:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.463+0000 7f95c3400640 1 Processor -- start 2024-05-09T00:08:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.464+0000 7f95c3400640 1 -- start start 2024-05-09T00:08:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.465+0000 7f95c3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc072720 0x7f95bc0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.465+0000 7f95c3400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc074040 con 0x7f95bc1585c0 2024-05-09T00:08:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.465+0000 7f95c3400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc0c58f0 con 0x7f95bc073800 2024-05-09T00:08:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.465+0000 7f95c3400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc073df0 con 0x7f95bc072720 2024-05-09T00:08:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.466+0000 7f95c1400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f95bc1585c0 0x7f95bc15f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58690/0 (socket says 172.21.15.114:58690) 2024-05-09T00:08:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.466+0000 7f95c1400640 1 -- 172.21.15.114:0/3280924276 learned_addr learned my addr 172.21.15.114:0/3280924276 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.466+0000 7f95bbe00640 1 --2- 172.21.15.114:0/3280924276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc072720 0x7f95bc0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.467+0000 7f95bb400640 1 -- 172.21.15.114:0/3280924276 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943415327 0 0) 0x7f95bc0c58f0 con 0x7f95bc073800 2024-05-09T00:08:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.467+0000 7f95bb400640 1 -- 172.21.15.114:0/3280924276 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95a0003520 con 0x7f95bc073800 2024-05-09T00:08:41.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.467+0000 7f95bbe00640 1 -- 172.21.15.114:0/3280924276 >> v1:172.21.15.153:6789/0 conn(0x7f95bc073800 legacy=0x7f95bc0c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.467+0000 7f95bbe00640 1 -- 172.21.15.114:0/3280924276 >> v1:172.21.15.114:6789/0 conn(0x7f95bc1585c0 legacy=0x7f95bc15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.467+0000 7f95bbe00640 1 -- 172.21.15.114:0/3280924276 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc0c5bd0 con 0x7f95bc072720 2024-05-09T00:08:41.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.468+0000 7f95bbe00640 1 --2- 172.21.15.114:0/3280924276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc072720 0x7f95bc0c63d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95a80097d0 tx=0x7f95a802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e8ce344ed0661ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:41.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.469+0000 7f95bb400640 1 -- 172.21.15.114:0/3280924276 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8037070 con 0x7f95bc072720 2024-05-09T00:08:41.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.469+0000 7f95bb400640 1 -- 172.21.15.114:0/3280924276 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a8032440 con 0x7f95bc072720 2024-05-09T00:08:41.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.469+0000 7f95bb400640 1 -- 172.21.15.114:0/3280924276 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a80327f0 con 0x7f95bc072720 2024-05-09T00:08:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 -- 172.21.15.114:0/3280924276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc072720 msgr2=0x7f95bc0c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 --2- 172.21.15.114:0/3280924276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc072720 0x7f95bc0c63d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95a80097d0 tx=0x7f95a802a210 comp rx=0 tx=0).stop 2024-05-09T00:08:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 -- 172.21.15.114:0/3280924276 shutdown_connections 2024-05-09T00:08:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 --2- 172.21.15.114:0/3280924276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc072720 0x7f95bc0c63d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 -- 172.21.15.114:0/3280924276 >> 172.21.15.114:0/3280924276 conn(0x7f95bc06c680 msgr2=0x7f95bc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 -- 172.21.15.114:0/3280924276 shutdown_connections 2024-05-09T00:08:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.470+0000 7f95c3400640 1 -- 172.21.15.114:0/3280924276 wait complete. 2024-05-09T00:08:41.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.472+0000 7f95c3400640 1 Processor -- start 2024-05-09T00:08:41.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.472+0000 7f95c3400640 1 -- start start 2024-05-09T00:08:41.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 0x7f95bc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:41.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc073800 0x7f95bc1ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:41.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc1585c0 0x7f95bc149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:41.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc074320 con 0x7f95bc072720 2024-05-09T00:08:41.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c3400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc0c5f40 con 0x7f95bc073800 2024-05-09T00:08:41.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c3400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc14fc80 con 0x7f95bc1585c0 2024-05-09T00:08:41.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 0x7f95bc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:41.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 0x7f95bc0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45698/0 (socket says 172.21.15.114:45698) 2024-05-09T00:08:41.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c0a00640 1 -- 172.21.15.114:0/2857025765 learned_addr learned my addr 172.21.15.114:0/2857025765 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:41.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95bbe00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc073800 0x7f95bc1ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:41.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.474+0000 7f95c1400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc1585c0 0x7f95bc149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.475+0000 7f95c0a00640 1 -- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc1585c0 msgr2=0x7f95bc149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.475+0000 7f95c0a00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc1585c0 0x7f95bc149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.475+0000 7f95c0a00640 1 -- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc073800 msgr2=0x7f95bc1ee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.475+0000 7f95c0a00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc073800 0x7f95bc1ee6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.475+0000 7f95c0a00640 1 -- 172.21.15.114:0/2857025765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc1552c0 con 0x7f95bc072720 2024-05-09T00:08:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.475+0000 7f95c0a00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 0x7f95bc0c9650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00c3c0 tx=0x7f95ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:41.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.499+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac017070 con 0x7f95bc072720 2024-05-09T00:08:41.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.499+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc1555a0 con 0x7f95bc072720 2024-05-09T00:08:41.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.499+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac0052d0 con 0x7f95bc072720 2024-05-09T00:08:41.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.500+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac003830 con 0x7f95bc072720 2024-05-09T00:08:41.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.500+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc155b60 con 0x7f95bc072720 2024-05-09T00:08:41.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.501+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc077430 con 0x7f95bc072720 2024-05-09T00:08:41.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.503+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f95ac01a070 con 0x7f95bc072720 2024-05-09T00:08:41.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.504+0000 7f95b8c00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f959c076300 0x7f959c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:41.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.504+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f95ac096590 con 0x7f95bc072720 2024-05-09T00:08:41.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.504+0000 7f95bbe00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f959c076300 0x7f959c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:41.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.505+0000 7f95bbe00640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f959c076300 0x7f959c078810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f95a8034000 tx=0x7f95a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:41.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.514+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f95ac05fb60 con 0x7f95bc072720 2024-05-09T00:08:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.729+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f95bc0c3aa0 con 0x7f95bc072720 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.730+0000 7f95b8c00640 1 -- 172.21.15.114:0/2857025765 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f95ac0681a0 con 0x7f95bc072720 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-05-09T00:08:41.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-05-09T00:08:41.728 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-05-09T00:08:41.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.733+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f959c076300 msgr2=0x7f959c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.733+0000 7f95c3400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f959c076300 0x7f959c078810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f95a8034000 tx=0x7f95a802e000 comp rx=0 tx=0).stop 2024-05-09T00:08:41.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.733+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 msgr2=0x7f95bc0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:41.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.733+0000 7f95c3400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 0x7f95bc0c9650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00c3c0 tx=0x7f95ac00c880 comp rx=0 tx=0).stop 2024-05-09T00:08:41.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 shutdown_connections 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f959c076300 0x7f959c078810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc1585c0 0x7f95bc149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc073800 0x7f95bc1ee6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 --2- 172.21.15.114:0/2857025765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc072720 0x7f95bc0c9650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 >> 172.21.15.114:0/2857025765 conn(0x7f95bc06c680 msgr2=0x7f95bc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 shutdown_connections 2024-05-09T00:08:41.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:41.734+0000 7f95c3400640 1 -- 172.21.15.114:0/2857025765 wait complete. 2024-05-09T00:08:41.758 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-05-09T00:08:41.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-05-09T00:08:42.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.034+0000 7fb3f7e00640 1 Processor -- start 2024-05-09T00:08:42.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.035+0000 7fb3f7e00640 1 -- start start 2024-05-09T00:08:42.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3f80c50e0 0x7fb3f806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:42.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3f80ae850 0x7fb3f80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:42.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f8156180 con 0x7fb3f80c54f0 2024-05-09T00:08:42.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f8156d90 con 0x7fb3f80ae850 2024-05-09T00:08:42.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f8156460 con 0x7fb3f80c50e0 2024-05-09T00:08:42.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3f80ae850 0x7fb3f80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:42.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3f80ae850 0x7fb3f80aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45706/0 (socket says 172.21.15.114:45706) 2024-05-09T00:08:42.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.037+0000 7fb3f7400640 1 -- 172.21.15.114:0/664153071 learned_addr learned my addr 172.21.15.114:0/664153071 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:42.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.038+0000 7fb3f6a00640 1 --2- 172.21.15.114:0/664153071 >> v2:172.21.15.153:3300/0 conn(0x7fb3f80c50e0 0x7fb3f806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:42.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.038+0000 7fb3f7400640 1 -- 172.21.15.114:0/664153071 >> v2:172.21.15.153:3300/0 conn(0x7fb3f80c50e0 msgr2=0x7fb3f806e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:42.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.038+0000 7fb3f7400640 1 --2- 172.21.15.114:0/664153071 >> v2:172.21.15.153:3300/0 conn(0x7fb3f80c50e0 0x7fb3f806e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:42.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.038+0000 7fb3f7400640 1 -- 172.21.15.114:0/664153071 >> v1:172.21.15.153:6789/0 conn(0x7fb3f80c54f0 legacy=0x7fb3f806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:42.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.038+0000 7fb3f7400640 1 -- 172.21.15.114:0/664153071 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f8156740 con 0x7fb3f80ae850 2024-05-09T00:08:42.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.038+0000 7fb3f6a00640 1 --2- 172.21.15.114:0/664153071 >> v2:172.21.15.153:3300/0 conn(0x7fb3f80c50e0 0x7fb3f806e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:42.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.039+0000 7fb3f7400640 1 --2- 172.21.15.114:0/664153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80ae850 0x7fb3f80aec60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8071690 tx=0x7fb3f002a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524620432ac8f75b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:42.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.039+0000 7fb3f6000640 1 -- 172.21.15.114:0/664153071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0036070 con 0x7fb3f80ae850 2024-05-09T00:08:42.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.039+0000 7fb3f6000640 1 -- 172.21.15.114:0/664153071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f0031400 con 0x7fb3f80ae850 2024-05-09T00:08:42.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.039+0000 7fb3f6000640 1 -- 172.21.15.114:0/664153071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00317d0 con 0x7fb3f80ae850 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 -- 172.21.15.114:0/664153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80ae850 msgr2=0x7fb3f80aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/664153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80ae850 0x7fb3f80aec60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8071690 tx=0x7fb3f002a620 comp rx=0 tx=0).stop 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 -- 172.21.15.114:0/664153071 shutdown_connections 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/664153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80ae850 0x7fb3f80aec60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/664153071 >> v2:172.21.15.153:3300/0 conn(0x7fb3f80c50e0 0x7fb3f806e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 -- 172.21.15.114:0/664153071 >> 172.21.15.114:0/664153071 conn(0x7fb3f80c5ff0 msgr2=0x7fb3f80c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 -- 172.21.15.114:0/664153071 shutdown_connections 2024-05-09T00:08:42.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.040+0000 7fb3f7e00640 1 -- 172.21.15.114:0/664153071 wait complete. 2024-05-09T00:08:42.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.043+0000 7fb3f7e00640 1 Processor -- start 2024-05-09T00:08:42.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.043+0000 7fb3f7e00640 1 -- start start 2024-05-09T00:08:42.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3f7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3f80ae850 0x7fb3f81f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:42.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 0x7fb3f80c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:42.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3f7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3f81f1610 0x7fb3f80c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:42.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3f7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f806f0b0 con 0x7fb3f80c50e0 2024-05-09T00:08:42.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3f7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f80c5db0 con 0x7fb3f80ae850 2024-05-09T00:08:42.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3f7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f8155e50 con 0x7fb3f81f1610 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.044+0000 7fb3efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 0x7fb3f80c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 0x7fb3f80c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45708/0 (socket says 172.21.15.114:45708) 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 -- 172.21.15.114:0/809400748 learned_addr learned my addr 172.21.15.114:0/809400748 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3f6a00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3f80ae850 0x7fb3f81f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 -- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3f81f1610 msgr2=0x7fb3f80c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3f81f1610 0x7fb3f80c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 -- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3f80ae850 msgr2=0x7fb3f81f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3f80ae850 0x7fb3f81f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:42.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 -- 172.21.15.114:0/809400748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f8072730 con 0x7fb3f80c50e0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3efe00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 0x7fb3f80c7ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000b3e0 tx=0x7fb3e000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.045+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0015020 con 0x7fb3f80c50e0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.046+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e0011830 con 0x7fb3f80c50e0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.046+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f81228c0 con 0x7fb3f80c50e0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.046+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0011c20 con 0x7fb3f80c50e0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.046+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f80721a0 con 0x7fb3f80c50e0 2024-05-09T00:08:42.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.047+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f80784d0 con 0x7fb3f80c50e0 2024-05-09T00:08:42.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.048+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb3e0018020 con 0x7fb3f80c50e0 2024-05-09T00:08:42.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.051+0000 7fb3eea00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb3d40762d0 0x7fb3d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:42.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.051+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fb3e0097180 con 0x7fb3f80c50e0 2024-05-09T00:08:42.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.051+0000 7fb3f6a00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb3d40762d0 0x7fb3d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:42.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.051+0000 7fb3f6a00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb3d40762d0 0x7fb3d40787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800a950 tx=0x7fb3e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.055+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb3e001f020 con 0x7fb3f80c50e0 2024-05-09T00:08:42.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:42.262+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7fb3f80acdb0 con 0x7fb3f80c50e0 2024-05-09T00:08:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.038+0000 7fb3eea00640 1 -- 172.21.15.114:0/809400748 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v19) ==== 128+0+0 (secure 0 0 0) 0x7fb3e0095e20 con 0x7fb3f80c50e0 2024-05-09T00:08:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'a_metadata' created 2024-05-09T00:08:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb3d40762d0 msgr2=0x7fb3d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb3d40762d0 0x7fb3d40787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800a950 tx=0x7fb3e8008040 comp rx=0 tx=0).stop 2024-05-09T00:08:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 msgr2=0x7fb3f80c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 0x7fb3f80c7ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000b3e0 tx=0x7fb3e000b8a0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 shutdown_connections 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb3d40762d0 0x7fb3d40787e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3f81f1610 0x7fb3f80c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f80c50e0 0x7fb3f80c7ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.043+0000 7fb3f7e00640 1 --2- 172.21.15.114:0/809400748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3f80ae850 0x7fb3f81f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.044+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 >> 172.21.15.114:0/809400748 conn(0x7fb3f80c5ff0 msgr2=0x7fb3f8152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.044+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 shutdown_connections 2024-05-09T00:08:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.044+0000 7fb3f7e00640 1 -- 172.21.15.114:0/809400748 wait complete. 2024-05-09T00:08:43.075 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T00:08:43.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.341+0000 7fee9a000640 1 Processor -- start 2024-05-09T00:08:43.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.342+0000 7fee9a000640 1 -- start start 2024-05-09T00:08:43.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.344+0000 7fee9a000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fee94072860 0x7fee94159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.344+0000 7fee9a000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9406ff20 con 0x7fee94160310 2024-05-09T00:08:43.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.344+0000 7fee9a000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee94160980 con 0x7fee94072d20 2024-05-09T00:08:43.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.344+0000 7fee9a000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fee94160720 con 0x7fee94072860 2024-05-09T00:08:43.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.345+0000 7fee93e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fee94160310 0x7fee940c4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58706/0 (socket says 172.21.15.114:58706) 2024-05-09T00:08:43.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.345+0000 7fee93e00640 1 -- 172.21.15.114:0/1935221391 learned_addr learned my addr 172.21.15.114:0/1935221391 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:43.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.345+0000 7fee93400640 1 --2- 172.21.15.114:0/1935221391 >> v2:172.21.15.153:3300/0 conn(0x7fee94072860 0x7fee94159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.345+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561177366 0 0) 0x7fee9406ff20 con 0x7fee94160310 2024-05-09T00:08:43.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.345+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee78003520 con 0x7fee94160310 2024-05-09T00:08:43.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.345+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4202767093 0 0) 0x7fee78003520 con 0x7fee94160310 2024-05-09T00:08:43.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 >> v2:172.21.15.153:3300/0 conn(0x7fee94072860 msgr2=0x7fee94159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:43.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 --2- 172.21.15.114:0/1935221391 >> v2:172.21.15.153:3300/0 conn(0x7fee94072860 0x7fee94159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 >> v1:172.21.15.153:6789/0 conn(0x7fee94072d20 legacy=0x7fee9415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9406f8d0 con 0x7fee94160310 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fee8c001a70 con 0x7fee94160310 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 >> v1:172.21.15.114:6789/0 conn(0x7fee94160310 legacy=0x7fee940c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee78003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78004800 0x7fee78004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee78005350 0x7fee7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fee94160720 con 0x7fee78003a50 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee7800c280 con 0x7fee78004800 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fee7800c480 con 0x7fee78005350 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93400640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee78003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee8be00640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78004800 0x7fee78004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93e00640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee78005350 0x7fee7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93400640 1 -- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee78005350 msgr2=0x7fee7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93400640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee78005350 0x7fee7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93400640 1 -- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78004800 msgr2=0x7fee78004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:43.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93400640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78004800 0x7fee78004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.346+0000 7fee93400640 1 -- 172.21.15.114:0/1935221391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee78003520 con 0x7fee78003a50 2024-05-09T00:08:43.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.347+0000 7fee93e00640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee78005350 0x7fee7800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:43.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.347+0000 7fee93e00640 1 -- 172.21.15.114:0/1935221391 reap_dead start 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.348+0000 7fee93400640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee78003ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee84009a90 tx=0x7fee78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e5b999cc62e4a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.348+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84036070 con 0x7fee78003a50 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.348+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee84031400 con 0x7fee78003a50 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.348+0000 7fee92a00640 1 -- 172.21.15.114:0/1935221391 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84009690 con 0x7fee78003a50 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 -- 172.21.15.114:0/1935221391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 msgr2=0x7fee78003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee78003ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee84009a90 tx=0x7fee78005830 comp rx=0 tx=0).stop 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 -- 172.21.15.114:0/1935221391 shutdown_connections 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 --2- 172.21.15.114:0/1935221391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee78003ec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 -- 172.21.15.114:0/1935221391 >> 172.21.15.114:0/1935221391 conn(0x7fee9406c680 msgr2=0x7fee9406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 -- 172.21.15.114:0/1935221391 shutdown_connections 2024-05-09T00:08:43.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.349+0000 7fee9a000640 1 -- 172.21.15.114:0/1935221391 wait complete. 2024-05-09T00:08:43.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.352+0000 7fee9a000640 1 Processor -- start 2024-05-09T00:08:43.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.352+0000 7fee9a000640 1 -- start start 2024-05-09T00:08:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee9a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee9415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee9a000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee940aca20 0x7fee940ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee9a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee94154560 0x7fee94154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee9a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fee94159d60 con 0x7fee78003a50 2024-05-09T00:08:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee9a000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee94159be0 con 0x7fee94154560 2024-05-09T00:08:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee9a000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fee94159ee0 con 0x7fee940aca20 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee93400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee9415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee93400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee9415c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45718/0 (socket says 172.21.15.114:45718) 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.354+0000 7fee93400640 1 -- 172.21.15.114:0/186403446 learned_addr learned my addr 172.21.15.114:0/186403446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee8be00640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee940aca20 0x7fee940ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93e00640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee94154560 0x7fee94154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93400640 1 -- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee940aca20 msgr2=0x7fee940ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93400640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee940aca20 0x7fee940ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93400640 1 -- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee94154560 msgr2=0x7fee94154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93400640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee94154560 0x7fee94154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93400640 1 -- 172.21.15.114:0/186403446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee941f6270 con 0x7fee78003a50 2024-05-09T00:08:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.355+0000 7fee93400640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee9415c850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee84009a90 tx=0x7fee84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.356+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84040020 con 0x7fee78003a50 2024-05-09T00:08:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.356+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8403b680 con 0x7fee78003a50 2024-05-09T00:08:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.356+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84036040 con 0x7fee78003a50 2024-05-09T00:08:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.356+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee941e5f20 con 0x7fee78003a50 2024-05-09T00:08:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.356+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee94154eb0 con 0x7fee78003a50 2024-05-09T00:08:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.357+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee94077430 con 0x7fee78003a50 2024-05-09T00:08:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.358+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee84043020 con 0x7fee78003a50 2024-05-09T00:08:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.360+0000 7fee8b400640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fee700762d0 0x7fee700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.360+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5222+0+0 (secure 0 0 0) 0x7fee840b7b20 con 0x7fee78003a50 2024-05-09T00:08:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.360+0000 7fee8be00640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fee700762d0 0x7fee700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:43.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.360+0000 7fee8be00640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fee700762d0 0x7fee700787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fee9415d0a0 tx=0x7fee7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.365+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fee8404a030 con 0x7fee78003a50 2024-05-09T00:08:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:43.571+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fee9406e9a0 con 0x7fee78003a50 2024-05-09T00:08:44.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.057+0000 7fee8b400640 1 -- 172.21.15.114:0/186403446 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v20) ==== 160+0+0 (secure 0 0 0) 0x7fee840816f0 con 0x7fee78003a50 2024-05-09T00:08:44.053 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'a_data' created 2024-05-09T00:08:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.061+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fee700762d0 msgr2=0x7fee700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.061+0000 7fee9a000640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fee700762d0 0x7fee700787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fee9415d0a0 tx=0x7fee7c009040 comp rx=0 tx=0).stop 2024-05-09T00:08:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.061+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 msgr2=0x7fee9415c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.061+0000 7fee9a000640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee9415c850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee84009a90 tx=0x7fee84004730 comp rx=0 tx=0).stop 2024-05-09T00:08:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.061+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 shutdown_connections 2024-05-09T00:08:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fee700762d0 0x7fee700787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee94154560 0x7fee94154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee940aca20 0x7fee940ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 --2- 172.21.15.114:0/186403446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee78003a50 0x7fee9415c850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 >> 172.21.15.114:0/186403446 conn(0x7fee9406c680 msgr2=0x7fee9406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 shutdown_connections 2024-05-09T00:08:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.062+0000 7fee9a000640 1 -- 172.21.15.114:0/186403446 wait complete. 2024-05-09T00:08:44.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-05-09T00:08:44.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.349+0000 7f4f2f800640 1 Processor -- start 2024-05-09T00:08:44.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.349+0000 7f4f2f800640 1 -- start start 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f2f800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f28072720 0x7f4f280c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f2f800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f281585c0 0x7f4f281589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f2f800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28074040 con 0x7f4f28073800 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f2f800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4f28073df0 con 0x7f4f28072720 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f2f800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4f280c5f40 con 0x7f4f281585c0 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f1fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f28072720 0x7f4f280c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f1fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f28072720 0x7f4f280c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45720/0 (socket says 172.21.15.114:45720) 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f1fe00640 1 -- 172.21.15.114:0/463556594 learned_addr learned my addr 172.21.15.114:0/463556594 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.351+0000 7f4f2d800640 1 --2- 172.21.15.114:0/463556594 >> v2:172.21.15.153:3300/0 conn(0x7f4f281585c0 0x7f4f281589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:44.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.352+0000 7f4f1fe00640 1 -- 172.21.15.114:0/463556594 >> v2:172.21.15.153:3300/0 conn(0x7f4f281585c0 msgr2=0x7f4f281589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:44.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.352+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/463556594 >> v2:172.21.15.153:3300/0 conn(0x7f4f281585c0 0x7f4f281589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.352+0000 7f4f1fe00640 1 -- 172.21.15.114:0/463556594 >> v1:172.21.15.153:6789/0 conn(0x7f4f28073800 legacy=0x7f4f280c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:44.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.352+0000 7f4f1fe00640 1 -- 172.21.15.114:0/463556594 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f280c58f0 con 0x7f4f28072720 2024-05-09T00:08:44.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.353+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/463556594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f280c63d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f2806d740 tx=0x7f4f1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f084234aa4451be1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:44.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.353+0000 7f4f27e00640 1 -- 172.21.15.114:0/463556594 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18037070 con 0x7f4f28072720 2024-05-09T00:08:44.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.353+0000 7f4f27e00640 1 -- 172.21.15.114:0/463556594 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f18032440 con 0x7f4f28072720 2024-05-09T00:08:44.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.353+0000 7f4f27e00640 1 -- 172.21.15.114:0/463556594 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18032810 con 0x7f4f28072720 2024-05-09T00:08:44.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 -- 172.21.15.114:0/463556594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 msgr2=0x7f4f280c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:44.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 --2- 172.21.15.114:0/463556594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f280c63d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f2806d740 tx=0x7f4f1802a1e0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 -- 172.21.15.114:0/463556594 shutdown_connections 2024-05-09T00:08:44.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 --2- 172.21.15.114:0/463556594 >> v2:172.21.15.153:3300/0 conn(0x7f4f281585c0 0x7f4f281589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 --2- 172.21.15.114:0/463556594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f280c63d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 -- 172.21.15.114:0/463556594 >> 172.21.15.114:0/463556594 conn(0x7f4f2806c680 msgr2=0x7f4f2806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:44.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 -- 172.21.15.114:0/463556594 shutdown_connections 2024-05-09T00:08:44.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.354+0000 7f4f2f800640 1 -- 172.21.15.114:0/463556594 wait complete. 2024-05-09T00:08:44.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.356+0000 7f4f2f800640 1 Processor -- start 2024-05-09T00:08:44.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.356+0000 7f4f2f800640 1 -- start start 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f281dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2f800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f28073800 0x7f4f281541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2f800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f281585c0 0x7f4f28147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2f800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28074320 con 0x7f4f28072720 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2f800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28072b30 con 0x7f4f281585c0 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2f800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2814d310 con 0x7f4f28073800 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f281dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f281dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45736/0 (socket says 172.21.15.114:45736) 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2ce00640 1 -- 172.21.15.114:0/2241114918 learned_addr learned my addr 172.21.15.114:0/2241114918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f2d800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f281585c0 0x7f4f28147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:44.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.358+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f28073800 0x7f4f281541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2ce00640 1 -- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f28073800 msgr2=0x7f4f281541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2ce00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f28073800 0x7f4f281541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2ce00640 1 -- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f281585c0 msgr2=0x7f4f28147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2ce00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f281585c0 0x7f4f28147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2ce00640 1 -- 172.21.15.114:0/2241114918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f281e0470 con 0x7f4f28072720 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f28073800 0x7f4f281541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2ce00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f281dff30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000b420 tx=0x7f4f1000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10011830 con 0x7f4f28072720 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10016070 con 0x7f4f28072720 2024-05-09T00:08:44.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2814ec80 con 0x7f4f28072720 2024-05-09T00:08:44.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10011c10 con 0x7f4f28072720 2024-05-09T00:08:44.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.359+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2814c470 con 0x7f4f28072720 2024-05-09T00:08:44.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.360+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f28077430 con 0x7f4f28072720 2024-05-09T00:08:44.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.362+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f10004020 con 0x7f4f28072720 2024-05-09T00:08:44.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.363+0000 7f4f25600640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f040762d0 0x7f4f040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:44.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.363+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5599+0+0 (secure 0 0 0) 0x7f4f10097a00 con 0x7f4f28072720 2024-05-09T00:08:44.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.363+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f040762d0 0x7f4f040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:44.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.364+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f040762d0 0x7f4f040787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f18034000 tx=0x7f4f1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:44.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.367+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f10020020 con 0x7f4f28072720 2024-05-09T00:08:44.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:44.609+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7f4f280c5630 con 0x7f4f28072720 2024-05-09T00:08:45.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.081+0000 7f4f25600640 1 -- 172.21.15.114:0/2241114918 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7f4f10061440 con 0x7f4f28072720 2024-05-09T00:08:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T00:08:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.093+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f040762d0 msgr2=0x7f4f040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.093+0000 7f4f2f800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f040762d0 0x7f4f040787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f18034000 tx=0x7f4f1802e000 comp rx=0 tx=0).stop 2024-05-09T00:08:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.093+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 msgr2=0x7f4f281dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.093+0000 7f4f2f800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f281dff30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000b420 tx=0x7f4f1000b8e0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.094+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 shutdown_connections 2024-05-09T00:08:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.094+0000 7f4f2f800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f040762d0 0x7f4f040787e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.094+0000 7f4f2f800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f281585c0 0x7f4f28147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.094+0000 7f4f2f800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f28073800 0x7f4f281541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.094+0000 7f4f2f800640 1 --2- 172.21.15.114:0/2241114918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f28072720 0x7f4f281dff30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.095+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 >> 172.21.15.114:0/2241114918 conn(0x7f4f2806c680 msgr2=0x7f4f2806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.095+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 shutdown_connections 2024-05-09T00:08:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.095+0000 7f4f2f800640 1 -- 172.21.15.114:0/2241114918 wait complete. 2024-05-09T00:08:45.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.374+0000 7f2560000640 1 Processor -- start 2024-05-09T00:08:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.375+0000 7f2560000640 1 -- start start 2024-05-09T00:08:45.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f2560000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25580c9910 0x7f255806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f2560000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2558155170 con 0x7f25580706b0 2024-05-09T00:08:45.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f2560000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2558155450 con 0x7f2558151f30 2024-05-09T00:08:45.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f2560000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f25580c4900 con 0x7f25580c9910 2024-05-09T00:08:45.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f255e000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f25580706b0 0x7f25580c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58714/0 (socket says 172.21.15.114:58714) 2024-05-09T00:08:45.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f255e000640 1 -- 172.21.15.114:0/2254494611 learned_addr learned my addr 172.21.15.114:0/2254494611 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f255cc00640 1 --2- 172.21.15.114:0/2254494611 >> v2:172.21.15.153:3300/0 conn(0x7f25580c9910 0x7f255806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.377+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021054852 0 0) 0x7f2558155170 con 0x7f25580706b0 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253c003520 con 0x7f25580706b0 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949461724 0 0) 0x7f253c003520 con 0x7f25580706b0 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 >> v2:172.21.15.153:3300/0 conn(0x7f25580c9910 msgr2=0x7f255806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 --2- 172.21.15.114:0/2254494611 >> v2:172.21.15.153:3300/0 conn(0x7f25580c9910 0x7f255806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 >> v1:172.21.15.153:6789/0 conn(0x7f2558151f30 legacy=0x7f25580c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25580c4be0 con 0x7f25580706b0 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f2550001a70 con 0x7f25580706b0 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 >> v1:172.21.15.114:6789/0 conn(0x7f25580706b0 legacy=0x7f25580c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c003aa0 0x7f253c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f253c004800 0x7f253c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f253c005350 0x7f253c00dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f25580c4900 con 0x7f253c004800 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f253c00e4f0 con 0x7f253c003aa0 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f253c00e6f0 con 0x7f253c005350 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.378+0000 7f255cc00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f253c004800 0x7f253c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255d600640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c003aa0 0x7f253c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255cc00640 1 -- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f253c005350 msgr2=0x7f253c00dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255cc00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f253c005350 0x7f253c00dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255cc00640 1 -- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c003aa0 msgr2=0x7f253c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255cc00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c003aa0 0x7f253c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255cc00640 1 -- 172.21.15.114:0/2254494611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c003520 con 0x7f253c004800 2024-05-09T00:08:45.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.379+0000 7f255e000640 1 -- 172.21.15.114:0/2254494611 reap_dead start 2024-05-09T00:08:45.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.380+0000 7f255cc00640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f253c004800 0x7f253c004c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f254400ba20 tx=0x7f253c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ae952a42ce46f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.380+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254400b040 con 0x7f253c004800 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.380+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2544031600 con 0x7f253c004800 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.380+0000 7f2557e00640 1 -- 172.21.15.114:0/2254494611 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440319d0 con 0x7f253c004800 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 -- 172.21.15.114:0/2254494611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f253c004800 msgr2=0x7f253c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f253c004800 0x7f253c004c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f254400ba20 tx=0x7f253c005830 comp rx=0 tx=0).stop 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 -- 172.21.15.114:0/2254494611 shutdown_connections 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 --2- 172.21.15.114:0/2254494611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f253c004800 0x7f253c004c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 -- 172.21.15.114:0/2254494611 >> 172.21.15.114:0/2254494611 conn(0x7f25580c9d40 msgr2=0x7f25580ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 -- 172.21.15.114:0/2254494611 shutdown_connections 2024-05-09T00:08:45.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.381+0000 7f2560000640 1 -- 172.21.15.114:0/2254494611 wait complete. 2024-05-09T00:08:45.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.384+0000 7f2560000640 1 Processor -- start 2024-05-09T00:08:45.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.384+0000 7f2560000640 1 -- start start 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.385+0000 7f2560000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c004800 0x7f25581579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.385+0000 7f2560000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2558157ef0 0x7f25581f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.385+0000 7f2560000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 0x7f25580ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.385+0000 7f2560000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2558151f30 con 0x7f25581f1b10 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.385+0000 7f2560000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25580c43d0 con 0x7f253c004800 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.385+0000 7f2560000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f25581520b0 con 0x7f2558157ef0 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 0x7f25580ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 0x7f25580ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45748/0 (socket says 172.21.15.114:45748) 2024-05-09T00:08:45.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 -- 172.21.15.114:0/1283210105 learned_addr learned my addr 172.21.15.114:0/1283210105 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:45.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255d600640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c004800 0x7f25581579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255cc00640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2558157ef0 0x7f25581f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 -- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2558157ef0 msgr2=0x7f25581f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2558157ef0 0x7f25581f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 -- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c004800 msgr2=0x7f25581579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c004800 0x7f25581579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.386+0000 7f255e000640 1 -- 172.21.15.114:0/1283210105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25581543f0 con 0x7f25581f1b10 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.387+0000 7f255e000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 0x7f25580ad780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2558071ab0 tx=0x7f255000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.387+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255000a610 con 0x7f25581f1b10 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.387+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255000a7f0 con 0x7f25581f1b10 2024-05-09T00:08:45.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.387+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255814f090 con 0x7f25581f1b10 2024-05-09T00:08:45.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.387+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255000abe0 con 0x7f25581f1b10 2024-05-09T00:08:45.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.387+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25580af2a0 con 0x7f25581f1b10 2024-05-09T00:08:45.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.388+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25581f2460 con 0x7f25581f1b10 2024-05-09T00:08:45.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.390+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2550011070 con 0x7f25581f1b10 2024-05-09T00:08:45.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.391+0000 7f2555600640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f25380762d0 0x7f25380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.391+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f2550096f50 con 0x7f25581f1b10 2024-05-09T00:08:45.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.391+0000 7f255d600640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f25380762d0 0x7f25380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.392+0000 7f255d600640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f25380762d0 0x7f25380787e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2548007fd0 tx=0x7f2548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.396+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f25581f2460 con 0x7f25581f1b10 2024-05-09T00:08:45.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.601+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2558077430 con 0x7f25581f1b10 2024-05-09T00:08:45.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.603+0000 7f2555600640 1 -- 172.21.15.114:0/1283210105 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16650 (secure 0 0 0) 0x7f255001a060 con 0x7f25581f1b10 2024-05-09T00:08:45.599 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:45.599 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:44.610931+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:45.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.605+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f25380762d0 msgr2=0x7f25380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.605+0000 7f2560000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f25380762d0 0x7f25380787e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2548007fd0 tx=0x7f2548009040 comp rx=0 tx=0).stop 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.605+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 msgr2=0x7f25580ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.605+0000 7f2560000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 0x7f25580ad780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2558071ab0 tx=0x7f255000ccd0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 shutdown_connections 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f25380762d0 0x7f25380787e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25581f1b10 0x7f25580ad780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2558157ef0 0x7f25581f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 --2- 172.21.15.114:0/1283210105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f253c004800 0x7f25581579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 >> 172.21.15.114:0/1283210105 conn(0x7f25580c9d40 msgr2=0x7f25580a9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 shutdown_connections 2024-05-09T00:08:45.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.606+0000 7f2560000640 1 -- 172.21.15.114:0/1283210105 wait complete. 2024-05-09T00:08:45.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:45.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.899+0000 7fb221000640 1 Processor -- start 2024-05-09T00:08:45.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.899+0000 7fb221000640 1 -- start start 2024-05-09T00:08:45.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.901+0000 7fb221000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 0x7fb21c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.901+0000 7fb221000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb21c145810 0x7fb21c0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.901+0000 7fb221000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21c145c20 con 0x7fb21c0c4c20 2024-05-09T00:08:45.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.901+0000 7fb221000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb21c072800 con 0x7fb21c145810 2024-05-09T00:08:45.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.902+0000 7fb221000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c0c3a40 con 0x7fb21c15c450 2024-05-09T00:08:45.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.902+0000 7fb213e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 0x7fb21c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.902+0000 7fb213e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 0x7fb21c0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43272/0 (socket says 172.21.15.114:43272) 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.902+0000 7fb213e00640 1 -- 172.21.15.114:0/2460356919 learned_addr learned my addr 172.21.15.114:0/2460356919 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.902+0000 7fb21be00640 1 --2- 172.21.15.114:0/2460356919 >> v2:172.21.15.153:3300/0 conn(0x7fb21c145810 0x7fb21c0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.903+0000 7fb213e00640 1 -- 172.21.15.114:0/2460356919 >> v2:172.21.15.153:3300/0 conn(0x7fb21c145810 msgr2=0x7fb21c0c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.903+0000 7fb213e00640 1 --2- 172.21.15.114:0/2460356919 >> v2:172.21.15.153:3300/0 conn(0x7fb21c145810 0x7fb21c0c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.903+0000 7fb213e00640 1 -- 172.21.15.114:0/2460356919 >> v1:172.21.15.153:6789/0 conn(0x7fb21c0c4c20 legacy=0x7fb21c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.903+0000 7fb213e00640 1 -- 172.21.15.114:0/2460356919 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c06ed30 con 0x7fb21c15c450 2024-05-09T00:08:45.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.903+0000 7fb21aa00640 1 -- 172.21.15.114:0/2460356919 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699465976 0 0) 0x7fb21c145c20 con 0x7fb21c0c4c20 2024-05-09T00:08:45.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.905+0000 7fb213e00640 1 --2- 172.21.15.114:0/2460356919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 0x7fb21c0700b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb204009870 tx=0x7fb20402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f447acc2ca238613 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.905+0000 7fb21aa00640 1 -- 172.21.15.114:0/2460356919 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204037070 con 0x7fb21c15c450 2024-05-09T00:08:45.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.905+0000 7fb21aa00640 1 -- 172.21.15.114:0/2460356919 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb204032440 con 0x7fb21c15c450 2024-05-09T00:08:45.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.905+0000 7fb21aa00640 1 -- 172.21.15.114:0/2460356919 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204032810 con 0x7fb21c15c450 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 -- 172.21.15.114:0/2460356919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 msgr2=0x7fb21c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 --2- 172.21.15.114:0/2460356919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 0x7fb21c0700b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb204009870 tx=0x7fb20402a1c0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 -- 172.21.15.114:0/2460356919 shutdown_connections 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 --2- 172.21.15.114:0/2460356919 >> v2:172.21.15.153:3300/0 conn(0x7fb21c145810 0x7fb21c0c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 --2- 172.21.15.114:0/2460356919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c15c450 0x7fb21c0700b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 -- 172.21.15.114:0/2460356919 >> 172.21.15.114:0/2460356919 conn(0x7fb21c0c9730 msgr2=0x7fb21c0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 -- 172.21.15.114:0/2460356919 shutdown_connections 2024-05-09T00:08:45.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.906+0000 7fb221000640 1 -- 172.21.15.114:0/2460356919 wait complete. 2024-05-09T00:08:45.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.909+0000 7fb221000640 1 Processor -- start 2024-05-09T00:08:45.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.909+0000 7fb221000640 1 -- start start 2024-05-09T00:08:45.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb221000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb21c0c4c20 0x7fb21c0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb221000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c145810 0x7fb21c0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb221000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 0x7fb21c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb221000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c06f5d0 con 0x7fb21c15c450 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb221000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c06f2f0 con 0x7fb21c0c4c20 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb221000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c06f8b0 con 0x7fb21c145810 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.910+0000 7fb21be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 0x7fb21c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 0x7fb21c0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45750/0 (socket says 172.21.15.114:45750) 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 -- 172.21.15.114:0/395385512 learned_addr learned my addr 172.21.15.114:0/395385512 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb213e00640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c145810 0x7fb21c0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21b400640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb21c0c4c20 0x7fb21c0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 -- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c145810 msgr2=0x7fb21c0ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c145810 0x7fb21c0ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 -- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb21c0c4c20 msgr2=0x7fb21c0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb21c0c4c20 0x7fb21c0ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:45.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 -- 172.21.15.114:0/395385512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c15b3b0 con 0x7fb21c15c450 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb213e00640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c145810 0x7fb21c0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21b400640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb21c0c4c20 0x7fb21c0ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb21be00640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 0x7fb21c0acb80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb21400efc0 tx=0x7fb21400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.911+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214018020 con 0x7fb21c15c450 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.912+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb214014480 con 0x7fb21c15c450 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.912+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214009e60 con 0x7fb21c15c450 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.912+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c142a80 con 0x7fb21c15c450 2024-05-09T00:08:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.912+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c141b70 con 0x7fb21c15c450 2024-05-09T00:08:45.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.913+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c145100 con 0x7fb21c15c450 2024-05-09T00:08:45.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.914+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb214005d10 con 0x7fb21c15c450 2024-05-09T00:08:45.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.915+0000 7fb213400640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb1f80762d0 0x7fb1f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:45.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.915+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fb2140982f0 con 0x7fb21c15c450 2024-05-09T00:08:45.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.916+0000 7fb21b400640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb1f80762d0 0x7fb1f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.916+0000 7fb21b400640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb1f80762d0 0x7fb1f80787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb20c000f60 tx=0x7fb20c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:45.920+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb21c145100 con 0x7fb21c15c450 2024-05-09T00:08:46.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.117+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb21c0ad0c0 con 0x7fb21c15c450 2024-05-09T00:08:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.118+0000 7fb213400640 1 -- 172.21.15.114:0/395385512 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16637 (secure 0 0 0) 0x7fb214022030 con 0x7fb21c15c450 2024-05-09T00:08:46.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:46.114 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:46.080110+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb1f80762d0 msgr2=0x7fb1f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb1f80762d0 0x7fb1f80787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb20c000f60 tx=0x7fb20c009040 comp rx=0 tx=0).stop 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 msgr2=0x7fb21c0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 0x7fb21c0acb80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb21400efc0 tx=0x7fb21400c490 comp rx=0 tx=0).stop 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 shutdown_connections 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb1f80762d0 0x7fb1f80787e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21c15c450 0x7fb21c0acb80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb21c145810 0x7fb21c0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 --2- 172.21.15.114:0/395385512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb21c0c4c20 0x7fb21c0ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 >> 172.21.15.114:0/395385512 conn(0x7fb21c0c9730 msgr2=0x7fb21c0c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 shutdown_connections 2024-05-09T00:08:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.121+0000 7fb221000640 1 -- 172.21.15.114:0/395385512 wait complete. 2024-05-09T00:08:46.142 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-05-09T00:08:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.411+0000 7f8ba3e00640 1 Processor -- start 2024-05-09T00:08:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.411+0000 7f8ba3e00640 1 -- start start 2024-05-09T00:08:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.413+0000 7f8ba3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ba415c070 0x7f8ba40c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.413+0000 7f8ba3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba40741e0 con 0x7f8ba4158170 2024-05-09T00:08:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.413+0000 7f8ba3e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba40744c0 con 0x7f8ba41552e0 2024-05-09T00:08:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.413+0000 7f8ba3e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba406e9d0 con 0x7f8ba415c070 2024-05-09T00:08:46.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.414+0000 7f8ba3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ba4158170 0x7f8ba4158580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58728/0 (socket says 172.21.15.114:58728) 2024-05-09T00:08:46.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.414+0000 7f8ba3400640 1 -- 172.21.15.114:0/1026154294 learned_addr learned my addr 172.21.15.114:0/1026154294 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.414+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/1026154294 >> v2:172.21.15.153:3300/0 conn(0x7f8ba415c070 0x7f8ba40c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.414+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266510103 0 0) 0x7f8ba40741e0 con 0x7f8ba4158170 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.414+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b88003520 con 0x7f8ba4158170 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 804043518 0 0) 0x7f8b88003520 con 0x7f8ba4158170 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 >> v2:172.21.15.153:3300/0 conn(0x7f8ba415c070 msgr2=0x7f8ba40c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 --2- 172.21.15.114:0/1026154294 >> v2:172.21.15.153:3300/0 conn(0x7f8ba415c070 0x7f8ba40c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 >> v1:172.21.15.153:6789/0 conn(0x7f8ba41552e0 legacy=0x7f8ba41556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba406ec20 con 0x7f8ba4158170 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f8b9c001a70 con 0x7f8ba4158170 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 >> v1:172.21.15.114:6789/0 conn(0x7f8ba4158170 legacy=0x7f8ba4158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b88003a50 0x7f8b88003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b88004800 0x7f8b88004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88005250 0x7f8b8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba406e9d0 con 0x7f8b88003a50 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8800c1e0 con 0x7f8b88004800 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8800c3e0 con 0x7f8b88005250 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.415+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b88003a50 0x7f8b88003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2000640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b88004800 0x7f8b88004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2a00640 1 -- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88005250 msgr2=0x7f8b8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88005250 0x7f8b8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2a00640 1 -- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b88004800 msgr2=0x7f8b88004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b88004800 0x7f8b88004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2a00640 1 -- 172.21.15.114:0/1026154294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b88003520 con 0x7f8b88003a50 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba2000640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b88004800 0x7f8b88004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:46.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.416+0000 7f8ba3400640 1 -- 172.21.15.114:0/1026154294 reap_dead start 2024-05-09T00:08:46.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.417+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b88003a50 0x7f8b88003ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009a90 tx=0x7f8b88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932d5a62405eea7c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.417+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94036070 con 0x7f8b88003a50 2024-05-09T00:08:46.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.417+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94031400 con 0x7f8b88003a50 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.417+0000 7f8ba1600640 1 -- 172.21.15.114:0/1026154294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94009690 con 0x7f8b88003a50 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 -- 172.21.15.114:0/1026154294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b88003a50 msgr2=0x7f8b88003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b88003a50 0x7f8b88003ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009a90 tx=0x7f8b88005830 comp rx=0 tx=0).stop 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 -- 172.21.15.114:0/1026154294 shutdown_connections 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/1026154294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b88003a50 0x7f8b88003ec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 -- 172.21.15.114:0/1026154294 >> 172.21.15.114:0/1026154294 conn(0x7f8ba40c5ea0 msgr2=0x7f8ba40c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 -- 172.21.15.114:0/1026154294 shutdown_connections 2024-05-09T00:08:46.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.418+0000 7f8ba3e00640 1 -- 172.21.15.114:0/1026154294 wait complete. 2024-05-09T00:08:46.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.420+0000 7f8ba3e00640 1 Processor -- start 2024-05-09T00:08:46.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.420+0000 7f8ba3e00640 1 -- start start 2024-05-09T00:08:46.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.421+0000 7f8ba3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88003a50 0x7f8ba414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ba414c400 0x7f8ba41f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 0x7f8ba41526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba415c480 con 0x7f8ba41522a0 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba406ef90 con 0x7f8ba414c400 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba415c600 con 0x7f8b88003a50 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 0x7f8ba41526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 0x7f8ba41526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45770/0 (socket says 172.21.15.114:45770) 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 -- 172.21.15.114:0/299013382 learned_addr learned my addr 172.21.15.114:0/299013382 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88003a50 0x7f8ba414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba2000640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ba414c400 0x7f8ba41f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 -- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88003a50 msgr2=0x7f8ba414bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88003a50 0x7f8ba414bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 -- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ba414c400 msgr2=0x7f8ba41f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ba414c400 0x7f8ba41f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:46.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.422+0000 7f8ba3400640 1 -- 172.21.15.114:0/299013382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba41edda0 con 0x7f8ba41522a0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.423+0000 7f8ba3400640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 0x7f8ba41526b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40c5bc0 tx=0x7f8b9c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.423+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00a5b0 con 0x7f8ba41522a0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.423+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c00a750 con 0x7f8ba41522a0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.423+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00ab80 con 0x7f8ba41522a0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.423+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba41f12c0 con 0x7f8ba41522a0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.423+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba4154f80 con 0x7f8ba41522a0 2024-05-09T00:08:46.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.424+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4078430 con 0x7f8ba41522a0 2024-05-09T00:08:46.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.426+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b9c00ad20 con 0x7f8ba41522a0 2024-05-09T00:08:46.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.427+0000 7f8b9aa00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b840762d0 0x7f8b840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:46.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.427+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f8b9c096c30 con 0x7f8ba41522a0 2024-05-09T00:08:46.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.427+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b840762d0 0x7f8b840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.428+0000 7f8ba2a00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b840762d0 0x7f8b840787e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b94033000 tx=0x7f8b94008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.432+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8b9c01b070 con 0x7f8ba41522a0 2024-05-09T00:08:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:46.676+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8ba415b150 con 0x7f8ba41522a0 2024-05-09T00:08:47.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.094+0000 7f8b9aa00640 1 -- 172.21.15.114:0/299013382 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 113+0+0 (secure 0 0 0) 0x7f8b9c060590 con 0x7f8ba41522a0 2024-05-09T00:08:47.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b840762d0 msgr2=0x7f8b840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b840762d0 0x7f8b840787e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b94033000 tx=0x7f8b94008030 comp rx=0 tx=0).stop 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 msgr2=0x7f8ba41526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 0x7f8ba41526b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40c5bc0 tx=0x7f8b9c00cc00 comp rx=0 tx=0).stop 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 shutdown_connections 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b840762d0 0x7f8b840787e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba41522a0 0x7f8ba41526b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ba414c400 0x7f8ba41f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 --2- 172.21.15.114:0/299013382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b88003a50 0x7f8ba414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 >> 172.21.15.114:0/299013382 conn(0x7f8ba40c5ea0 msgr2=0x7f8ba40af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 shutdown_connections 2024-05-09T00:08:47.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.098+0000 7f8ba3e00640 1 -- 172.21.15.114:0/299013382 wait complete. 2024-05-09T00:08:47.122 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-09T00:08:47.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-05-09T00:08:47.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.406+0000 7f8bd7e00640 1 Processor -- start 2024-05-09T00:08:47.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.407+0000 7f8bd7e00640 1 -- start start 2024-05-09T00:08:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 0x7f8bd8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8bd80c4db0 0x7f8bd80c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd7e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bd80721a0 con 0x7f8bd80af230 2024-05-09T00:08:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd8072ca0 con 0x7f8bd80c4db0 2024-05-09T00:08:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd8158820 con 0x7f8bd8154e60 2024-05-09T00:08:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd6a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8bd80af230 0x7f8bd8072590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58742/0 (socket says 172.21.15.114:58742) 2024-05-09T00:08:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd6a00640 1 -- 172.21.15.114:0/1371713671 learned_addr learned my addr 172.21.15.114:0/1371713671 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd7400640 1 --2- 172.21.15.114:0/1371713671 >> v2:172.21.15.153:3300/0 conn(0x7f8bd80c4db0 0x7f8bd80c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bce000640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 0x7f8bd8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.409+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641584805 0 0) 0x7f8bd80721a0 con 0x7f8bd80af230 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bbc003500 con 0x7f8bd80af230 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3437501207 0 0) 0x7f8bbc003500 con 0x7f8bd80af230 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 msgr2=0x7f8bd8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 0x7f8bd8158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 >> v2:172.21.15.153:3300/0 conn(0x7f8bd80c4db0 msgr2=0x7f8bd80c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 --2- 172.21.15.114:0/1371713671 >> v2:172.21.15.153:3300/0 conn(0x7f8bd80c4db0 0x7f8bd80c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd81584f0 con 0x7f8bd80af230 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f8bc8001a70 con 0x7f8bd80af230 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 >> v1:172.21.15.114:6789/0 conn(0x7f8bd80af230 legacy=0x7f8bd8072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bbc004bc0 0x7f8bbc005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bbc003890 0x7f8bbc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 0x7f8bbc00b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8072ca0 con 0x7f8bbc004bc0 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8158820 con 0x7f8bbc003890 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8bbc00bbc0 con 0x7f8bd8154e60 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.410+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bbc004bc0 0x7f8bbc005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bd7400640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 0x7f8bbc00b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bce000640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bbc003890 0x7f8bbc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bd6a00640 1 -- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 msgr2=0x7f8bbc00b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bd8154e60 0x7f8bbc00b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bd6a00640 1 -- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bbc003890 msgr2=0x7f8bbc003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bbc003890 0x7f8bbc003d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.411+0000 7f8bd6a00640 1 -- 172.21.15.114:0/1371713671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bbc003500 con 0x7f8bbc004bc0 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.412+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bbc004bc0 0x7f8bbc005030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800a8a0 tx=0x7f8bbc004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5db940fce4930f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.412+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800a4c0 con 0x7f8bbc004bc0 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.412+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc802f070 con 0x7f8bbc004bc0 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.412+0000 7f8bd6000640 1 -- 172.21.15.114:0/1371713671 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc802bc20 con 0x7f8bbc004bc0 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7e00640 1 -- 172.21.15.114:0/1371713671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bbc004bc0 msgr2=0x7f8bbc005030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/1371713671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bbc004bc0 0x7f8bbc005030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800a8a0 tx=0x7f8bbc004800 comp rx=0 tx=0).stop 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7400640 1 -- 172.21.15.114:0/1371713671 reap_dead start 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7e00640 1 -- 172.21.15.114:0/1371713671 shutdown_connections 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7e00640 1 -- 172.21.15.114:0/1371713671 >> 172.21.15.114:0/1371713671 conn(0x7f8bd80c5ea0 msgr2=0x7f8bd80c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7e00640 1 -- 172.21.15.114:0/1371713671 shutdown_connections 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.413+0000 7f8bd7e00640 1 -- 172.21.15.114:0/1371713671 wait complete. 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.415+0000 7f8bd7e00640 1 Processor -- start 2024-05-09T00:08:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.415+0000 7f8bd7e00640 1 -- start start 2024-05-09T00:08:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.416+0000 7f8bd7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bbc004bc0 0x7f8bd80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd80bf8f0 0x7f8bd81e0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 0x7f8bd814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8155270 con 0x7f8bd814fe40 2024-05-09T00:08:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80740e0 con 0x7f8bd80bf8f0 2024-05-09T00:08:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd80743c0 con 0x7f8bbc004bc0 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 0x7f8bd814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 0x7f8bd814f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45800/0 (socket says 172.21.15.114:45800) 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 -- 172.21.15.114:0/3328028992 learned_addr learned my addr 172.21.15.114:0/3328028992 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bce000640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd80bf8f0 0x7f8bd81e0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bbc004bc0 0x7f8bd80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 -- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bbc004bc0 msgr2=0x7f8bd80c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bbc004bc0 0x7f8bd80c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 -- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd80bf8f0 msgr2=0x7f8bd81e0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd80bf8f0 0x7f8bd81e0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bd7400640 1 -- 172.21.15.114:0/3328028992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd80c3540 con 0x7f8bd814fe40 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.417+0000 7f8bce000640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd80bf8f0 0x7f8bd81e0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.418+0000 7f8bd7400640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 0x7f8bd814f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8bd806e2d0 tx=0x7f8bd00134a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.418+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0020070 con 0x7f8bd814fe40 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.418+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd0013c20 con 0x7f8bd814fe40 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.418+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd80c8e10 con 0x7f8bd814fe40 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.418+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000be20 con 0x7f8bd814fe40 2024-05-09T00:08:47.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.418+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd80bea80 con 0x7f8bd814fe40 2024-05-09T00:08:47.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.419+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd8078430 con 0x7f8bd814fe40 2024-05-09T00:08:47.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.421+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8bd0023070 con 0x7f8bd814fe40 2024-05-09T00:08:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.422+0000 7f8bcf400640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8bb40762d0 0x7f8bb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.422+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f8bd009b0e0 con 0x7f8bd814fe40 2024-05-09T00:08:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.422+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8bb40762d0 0x7f8bb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.423+0000 7f8bd6a00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8bb40762d0 0x7f8bb40787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8033000 tx=0x7f8bc8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.427+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8bd0016070 con 0x7f8bd814fe40 2024-05-09T00:08:47.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:47.678+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8bd8072370 con 0x7f8bd814fe40 2024-05-09T00:08:48.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.106+0000 7f8bcf400640 1 -- 172.21.15.114:0/3328028992 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f8bd0064ae0 con 0x7f8bd814fe40 2024-05-09T00:08:48.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8bb40762d0 msgr2=0x7f8bb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8bb40762d0 0x7f8bb40787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8033000 tx=0x7f8bc8009030 comp rx=0 tx=0).stop 2024-05-09T00:08:48.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 msgr2=0x7f8bd814f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 0x7f8bd814f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8bd806e2d0 tx=0x7f8bd00134a0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 shutdown_connections 2024-05-09T00:08:48.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8bb40762d0 0x7f8bb40787e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd814fe40 0x7f8bd814f320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bd80bf8f0 0x7f8bd81e0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 --2- 172.21.15.114:0/3328028992 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bbc004bc0 0x7f8bd80c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 >> 172.21.15.114:0/3328028992 conn(0x7f8bd80c5ea0 msgr2=0x7f8bd81545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:48.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.110+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 shutdown_connections 2024-05-09T00:08:48.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.111+0000 7f8bd7e00640 1 -- 172.21.15.114:0/3328028992 wait complete. 2024-05-09T00:08:48.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-05-09T00:08:48.322 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-05-09T00:08:48.327+0000 7f7bbb000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:08:48.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.399+0000 7f7a7d400640 1 Processor -- start 2024-05-09T00:08:48.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.399+0000 7f7a7d400640 1 -- start start 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.401+0000 7f7a7d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a781586e0 0x7f7a7806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.401+0000 7f7a7d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a78154730 0x7f7a78154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.401+0000 7f7a7d400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a78073bc0 con 0x7f7a780af300 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.401+0000 7f7a7d400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7a780c54c0 con 0x7f7a78154730 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.401+0000 7f7a7d400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7a78158c30 con 0x7f7a781586e0 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a78154730 0x7f7a78154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a78154730 0x7f7a78154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56658/0 (socket says 172.21.15.114:56658) 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 -- 172.21.15.114:0/3487491661 learned_addr learned my addr 172.21.15.114:0/3487491661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a76800640 1 --2- 172.21.15.114:0/3487491661 >> v2:172.21.15.153:3300/0 conn(0x7f7a781586e0 0x7f7a7806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 -- 172.21.15.114:0/3487491661 >> v2:172.21.15.153:3300/0 conn(0x7f7a781586e0 msgr2=0x7f7a7806f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 --2- 172.21.15.114:0/3487491661 >> v2:172.21.15.153:3300/0 conn(0x7f7a781586e0 0x7f7a7806f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 -- 172.21.15.114:0/3487491661 >> v1:172.21.15.153:6789/0 conn(0x7f7a780af300 legacy=0x7f7a7806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:48.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a77200640 1 -- 172.21.15.114:0/3487491661 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a78073600 con 0x7f7a78154730 2024-05-09T00:08:48.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.402+0000 7f7a76800640 1 --2- 172.21.15.114:0/3487491661 >> v2:172.21.15.153:3300/0 conn(0x7f7a781586e0 0x7f7a7806f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.403+0000 7f7a77200640 1 --2- 172.21.15.114:0/3487491661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a78154730 0x7f7a78154b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a780aedf0 tx=0x7f7a7002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d41c7219e25d3f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a75e00640 1 -- 172.21.15.114:0/3487491661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70036070 con 0x7f7a78154730 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a75e00640 1 -- 172.21.15.114:0/3487491661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a70031400 con 0x7f7a78154730 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a75e00640 1 -- 172.21.15.114:0/3487491661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700317d0 con 0x7f7a78154730 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a7d400640 1 -- 172.21.15.114:0/3487491661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a78154730 msgr2=0x7f7a78154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a7d400640 1 --2- 172.21.15.114:0/3487491661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a78154730 0x7f7a78154b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a780aedf0 tx=0x7f7a7002a5d0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a7d400640 1 -- 172.21.15.114:0/3487491661 shutdown_connections 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a7d400640 1 --2- 172.21.15.114:0/3487491661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a78154730 0x7f7a78154b40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a7d400640 1 --2- 172.21.15.114:0/3487491661 >> v2:172.21.15.153:3300/0 conn(0x7f7a781586e0 0x7f7a7806f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.404+0000 7f7a7d400640 1 -- 172.21.15.114:0/3487491661 >> 172.21.15.114:0/3487491661 conn(0x7f7a7806c680 msgr2=0x7f7a7806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:48.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.405+0000 7f7a7d400640 1 -- 172.21.15.114:0/3487491661 shutdown_connections 2024-05-09T00:08:48.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.405+0000 7f7a7d400640 1 -- 172.21.15.114:0/3487491661 wait complete. 2024-05-09T00:08:48.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.407+0000 7f7a7d400640 1 Processor -- start 2024-05-09T00:08:48.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.407+0000 7f7a7d400640 1 -- start start 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a7d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a780af300 0x7f7a781514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a7d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a78154730 0x7f7a781442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a7d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 0x7f7a780c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a7d400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781520f0 con 0x7f7a781586e0 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a7d400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a78151f70 con 0x7f7a78154730 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a7d400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a78155080 con 0x7f7a780af300 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a77200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 0x7f7a780c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a77200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 0x7f7a780c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56674/0 (socket says 172.21.15.114:56674) 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.408+0000 7f7a77200640 1 -- 172.21.15.114:0/2227577296 learned_addr learned my addr 172.21.15.114:0/2227577296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a6de00640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a78154730 0x7f7a781442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a76800640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a780af300 0x7f7a781514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a77200640 1 -- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a780af300 msgr2=0x7f7a781514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a77200640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a780af300 0x7f7a781514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a77200640 1 -- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a78154730 msgr2=0x7f7a781442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a77200640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a78154730 0x7f7a781442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a77200640 1 -- 172.21.15.114:0/2227577296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a78141590 con 0x7f7a781586e0 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a77200640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 0x7f7a780c8af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a7002abc0 tx=0x7f7a70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70036050 con 0x7f7a781586e0 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a70042070 con 0x7f7a781586e0 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a781f01d0 con 0x7f7a781586e0 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.409+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7003d8b0 con 0x7f7a781586e0 2024-05-09T00:08:48.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.410+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a781f04b0 con 0x7f7a781586e0 2024-05-09T00:08:48.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.410+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a78077430 con 0x7f7a781586e0 2024-05-09T00:08:48.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.412+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a7003da50 con 0x7f7a781586e0 2024-05-09T00:08:48.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.413+0000 7f7a6f400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7a540762d0 0x7f7a540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:48.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.413+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f7a700b84c0 con 0x7f7a781586e0 2024-05-09T00:08:48.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.413+0000 7f7a76800640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7a540762d0 0x7f7a540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.414+0000 7f7a76800640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7a540762d0 0x7f7a540787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800b840 tx=0x7f7a68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:48.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.417+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a78073bc0 con 0x7f7a781586e0 2024-05-09T00:08:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:48.667+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7a78141a70 con 0x7f7a781586e0 2024-05-09T00:08:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.128+0000 7f7a6f400640 1 -- 172.21.15.114:0/2227577296 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v9) ==== 110+0+0 (secure 0 0 0) 0x7f7a70081d00 con 0x7f7a781586e0 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7a540762d0 msgr2=0x7f7a540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7a540762d0 0x7f7a540787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800b840 tx=0x7f7a68008040 comp rx=0 tx=0).stop 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 msgr2=0x7f7a780c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 0x7f7a780c8af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a7002abc0 tx=0x7f7a70004a40 comp rx=0 tx=0).stop 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 shutdown_connections 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7a540762d0 0x7f7a540787e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a781586e0 0x7f7a780c8af0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a78154730 0x7f7a781442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 --2- 172.21.15.114:0/2227577296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a780af300 0x7f7a781514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.132+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 >> 172.21.15.114:0/2227577296 conn(0x7f7a7806c680 msgr2=0x7f7a7806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:49.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.133+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 shutdown_connections 2024-05-09T00:08:49.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.133+0000 7f7a7d400640 1 -- 172.21.15.114:0/2227577296 wait complete. 2024-05-09T00:08:49.154 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-05-09T00:08:49.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:08:49.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.425+0000 7fa5e3400640 1 Processor -- start 2024-05-09T00:08:49.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.426+0000 7fa5e3400640 1 -- start start 2024-05-09T00:08:49.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5e3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5dc153760 0x7fa5dc159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5e3400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc156bb0 con 0x7fa5dc0ae940 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5e3400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc156e90 con 0x7fa5dc0c43c0 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5e3400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc0ac710 con 0x7fa5dc153760 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5dbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5dc153760 0x7fa5dc159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5dbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5dc153760 0x7fa5dc159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56686/0 (socket says 172.21.15.114:56686) 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5dbe00640 1 -- 172.21.15.114:0/2959536550 learned_addr learned my addr 172.21.15.114:0/2959536550 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.428+0000 7fa5e1400640 1 --1- 172.21.15.114:0/2959536550 >> v1:172.21.15.114:6789/0 conn(0x7fa5dc0ae940 0x7fa5dc0aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40542/0 (socket says 172.21.15.114:40542) 2024-05-09T00:08:49.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.429+0000 7fa5dbe00640 1 -- 172.21.15.114:0/2959536550 >> v1:172.21.15.153:6789/0 conn(0x7fa5dc0c43c0 legacy=0x7fa5dc159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.429+0000 7fa5dbe00640 1 -- 172.21.15.114:0/2959536550 >> v1:172.21.15.114:6789/0 conn(0x7fa5dc0ae940 legacy=0x7fa5dc0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.429+0000 7fa5dbe00640 1 -- 172.21.15.114:0/2959536550 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc0ac960 con 0x7fa5dc153760 2024-05-09T00:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.430+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/2959536550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc153760 0x7fa5dc159f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0ac890 tx=0x7fa5cc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c5a7c1f9fc8627 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.430+0000 7fa5db400640 1 -- 172.21.15.114:0/2959536550 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc036070 con 0x7fa5dc153760 2024-05-09T00:08:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.430+0000 7fa5db400640 1 -- 172.21.15.114:0/2959536550 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5cc031600 con 0x7fa5dc153760 2024-05-09T00:08:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.430+0000 7fa5db400640 1 -- 172.21.15.114:0/2959536550 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0319d0 con 0x7fa5dc153760 2024-05-09T00:08:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 -- 172.21.15.114:0/2959536550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc153760 msgr2=0x7fa5dc159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 --2- 172.21.15.114:0/2959536550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc153760 0x7fa5dc159f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0ac890 tx=0x7fa5cc02a710 comp rx=0 tx=0).stop 2024-05-09T00:08:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 -- 172.21.15.114:0/2959536550 shutdown_connections 2024-05-09T00:08:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 --2- 172.21.15.114:0/2959536550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc153760 0x7fa5dc159f40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 -- 172.21.15.114:0/2959536550 >> 172.21.15.114:0/2959536550 conn(0x7fa5dc06c680 msgr2=0x7fa5dc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 -- 172.21.15.114:0/2959536550 shutdown_connections 2024-05-09T00:08:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.431+0000 7fa5e3400640 1 -- 172.21.15.114:0/2959536550 wait complete. 2024-05-09T00:08:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.433+0000 7fa5e3400640 1 Processor -- start 2024-05-09T00:08:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.434+0000 7fa5e3400640 1 -- start start 2024-05-09T00:08:49.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 0x7fa5dc155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5dc0c43c0 0x7fa5dc14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5dc153760 0x7fa5dc14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc0ad3c0 con 0x7fa5dc0ae940 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e3400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc15a480 con 0x7fa5dc0c43c0 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e3400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc0af460 con 0x7fa5dc153760 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 0x7fa5dc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 0x7fa5dc155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56696/0 (socket says 172.21.15.114:56696) 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.435+0000 7fa5e0a00640 1 -- 172.21.15.114:0/1835398111 learned_addr learned my addr 172.21.15.114:0/1835398111 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e1400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5dc153760 0x7fa5dc14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5dc0c43c0 0x7fa5dc14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e0a00640 1 -- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5dc153760 msgr2=0x7fa5dc14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e0a00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5dc153760 0x7fa5dc14df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e0a00640 1 -- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5dc0c43c0 msgr2=0x7fa5dc14ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e0a00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5dc0c43c0 0x7fa5dc14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e0a00640 1 -- 172.21.15.114:0/1835398111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc1ee670 con 0x7fa5dc0ae940 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e1400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5dc153760 0x7fa5dc14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e0a00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 0x7fa5dc155130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c370 tx=0x7fa5c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4017070 con 0x7fa5dc0ae940 2024-05-09T00:08:49.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c40052d0 con 0x7fa5dc0ae940 2024-05-09T00:08:49.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc0c83f0 con 0x7fa5dc0ae940 2024-05-09T00:08:49.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003830 con 0x7fa5dc0ae940 2024-05-09T00:08:49.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.436+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc1ee910 con 0x7fa5dc0ae940 2024-05-09T00:08:49.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.438+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc1ee460 con 0x7fa5dc0ae940 2024-05-09T00:08:49.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.439+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5c401a070 con 0x7fa5dc0ae940 2024-05-09T00:08:49.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.440+0000 7fa5d8c00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa5b80762d0 0x7fa5b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.440+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fa5c40968f0 con 0x7fa5dc0ae940 2024-05-09T00:08:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.440+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa5b80762d0 0x7fa5b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.441+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa5b80762d0 0x7fa5b80787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc033000 tx=0x7fa5cc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:49.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.445+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5c4060260 con 0x7fa5dc0ae940 2024-05-09T00:08:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.683+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5dc077430 con 0x7fa5dc0ae940 2024-05-09T00:08:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.684+0000 7fa5d8c00640 1 -- 172.21.15.114:0/1835398111 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fa5c4068250 con 0x7fa5dc0ae940 2024-05-09T00:08:49.680 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:49.680 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-09T00:08:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.686+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa5b80762d0 msgr2=0x7fa5b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.686+0000 7fa5e3400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa5b80762d0 0x7fa5b80787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc033000 tx=0x7fa5cc009000 comp rx=0 tx=0).stop 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.686+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 msgr2=0x7fa5dc155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.686+0000 7fa5e3400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 0x7fa5dc155130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c370 tx=0x7fa5c400c830 comp rx=0 tx=0).stop 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 shutdown_connections 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa5b80762d0 0x7fa5b80787e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5dc153760 0x7fa5dc14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5dc0c43c0 0x7fa5dc14ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 --2- 172.21.15.114:0/1835398111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0ae940 0x7fa5dc155130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 >> 172.21.15.114:0/1835398111 conn(0x7fa5dc06c680 msgr2=0x7fa5dc0c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:49.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 shutdown_connections 2024-05-09T00:08:49.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.687+0000 7fa5e3400640 1 -- 172.21.15.114:0/1835398111 wait complete. 2024-05-09T00:08:49.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:49.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.977+0000 7f2fcbe00640 1 Processor -- start 2024-05-09T00:08:49.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.978+0000 7f2fcbe00640 1 -- start start 2024-05-09T00:08:49.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fcc0aba00 0x7f2fcc0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc156b00 0x7f2fcc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcbe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc0ad340 con 0x7f2fcc1566f0 2024-05-09T00:08:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcbe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2fcc156260 con 0x7f2fcc0aba00 2024-05-09T00:08:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2fcc155f10 con 0x7f2fcc156b00 2024-05-09T00:08:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fcc0aba00 0x7f2fcc0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fcc0aba00 0x7f2fcc0accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56708/0 (socket says 172.21.15.114:56708) 2024-05-09T00:08:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcaa00640 1 -- 172.21.15.114:0/2579036538 learned_addr learned my addr 172.21.15.114:0/2579036538 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fca000640 1 --1- 172.21.15.114:0/2579036538 >> v1:172.21.15.114:6789/0 conn(0x7f2fcc1566f0 0x7f2fcc0ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40556/0 (socket says 172.21.15.114:40556) 2024-05-09T00:08:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcb400640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc156b00 0x7f2fcc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcaa00640 1 -- 172.21.15.114:0/2579036538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc156b00 msgr2=0x7f2fcc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.980+0000 7f2fcaa00640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc156b00 0x7f2fcc0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.981+0000 7f2fcaa00640 1 -- 172.21.15.114:0/2579036538 >> v1:172.21.15.114:6789/0 conn(0x7f2fcc1566f0 legacy=0x7f2fcc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.981+0000 7f2fc9600640 1 -- 172.21.15.114:0/2579036538 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935690233 0 0) 0x7f2fcc0ad340 con 0x7f2fcc1566f0 2024-05-09T00:08:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.981+0000 7f2fcaa00640 1 -- 172.21.15.114:0/2579036538 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc0c4f40 con 0x7f2fcc0aba00 2024-05-09T00:08:49.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.981+0000 7f2fcb400640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc156b00 0x7f2fcc0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:49.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.982+0000 7f2fcaa00640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc0aba00 0x7f2fcc0accb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009e50 tx=0x7f2fbc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8456c5f6abd9eb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:49.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.982+0000 7f2fc9600640 1 -- 172.21.15.114:0/2579036538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc036070 con 0x7f2fcc0aba00 2024-05-09T00:08:49.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.982+0000 7f2fc9600640 1 -- 172.21.15.114:0/2579036538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc031600 con 0x7f2fcc0aba00 2024-05-09T00:08:49.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.982+0000 7f2fc9600640 1 -- 172.21.15.114:0/2579036538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0319d0 con 0x7f2fcc0aba00 2024-05-09T00:08:49.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 -- 172.21.15.114:0/2579036538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc0aba00 msgr2=0x7f2fcc0accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc0aba00 0x7f2fcc0accb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009e50 tx=0x7f2fbc02a710 comp rx=0 tx=0).stop 2024-05-09T00:08:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 -- 172.21.15.114:0/2579036538 shutdown_connections 2024-05-09T00:08:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc156b00 0x7f2fcc0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/2579036538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc0aba00 0x7f2fcc0accb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 -- 172.21.15.114:0/2579036538 >> 172.21.15.114:0/2579036538 conn(0x7f2fcc0c9730 msgr2=0x7f2fcc0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 -- 172.21.15.114:0/2579036538 shutdown_connections 2024-05-09T00:08:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.983+0000 7f2fcbe00640 1 -- 172.21.15.114:0/2579036538 wait complete. 2024-05-09T00:08:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.985+0000 7f2fcbe00640 1 Processor -- start 2024-05-09T00:08:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.985+0000 7f2fcbe00640 1 -- start start 2024-05-09T00:08:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc0aba00 0x7f2fcc152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fcc1566f0 0x7f2fcc072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 0x7f2fcc159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcbe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc0af470 con 0x7f2fcc156b00 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc0c4920 con 0x7f2fcc1566f0 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2fcc13e830 con 0x7f2fcc0aba00 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 0x7f2fcc159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 0x7f2fcc159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56722/0 (socket says 172.21.15.114:56722) 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 -- 172.21.15.114:0/1582786527 learned_addr learned my addr 172.21.15.114:0/1582786527 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 -- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc0aba00 msgr2=0x7f2fcc152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fca000640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fcc1566f0 0x7f2fcc072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcaa00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc0aba00 0x7f2fcc152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc0aba00 0x7f2fcc152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 -- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fcc1566f0 msgr2=0x7f2fcc072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fcc1566f0 0x7f2fcc072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.987+0000 7f2fcb400640 1 -- 172.21.15.114:0/1582786527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc1ee300 con 0x7f2fcc156b00 2024-05-09T00:08:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.988+0000 7f2fcb400640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 0x7f2fcc159210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400c5c0 tx=0x7f2fc400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.988+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4015070 con 0x7f2fcc156b00 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.988+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc4011820 con 0x7f2fcc156b00 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.988+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc073930 con 0x7f2fcc156b00 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.988+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4011c10 con 0x7f2fcc156b00 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.988+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc159f00 con 0x7f2fcc156b00 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.989+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc078430 con 0x7f2fcc156b00 2024-05-09T00:08:49.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.990+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fc4018070 con 0x7f2fcc156b00 2024-05-09T00:08:49.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.991+0000 7f2fc2a00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fa8076300 0x7f2fa8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:49.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.991+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f2fc40973f0 con 0x7f2fcc156b00 2024-05-09T00:08:49.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.992+0000 7f2fcaa00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fa8076300 0x7f2fa8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:49.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.992+0000 7f2fcaa00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fa8076300 0x7f2fa8078810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc033000 tx=0x7f2fbc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:49.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:49.997+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fcc1ee300 con 0x7f2fcc156b00 2024-05-09T00:08:50.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.205+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fcc0c4b80 con 0x7f2fcc156b00 2024-05-09T00:08:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.207+0000 7f2fc2a00640 1 -- 172.21.15.114:0/1582786527 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16637 (secure 0 0 0) 0x7f2fc4060d60 con 0x7f2fcc156b00 2024-05-09T00:08:50.203 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:50.203 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:46.080110+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.209+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fa8076300 msgr2=0x7f2fa8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.209+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fa8076300 0x7f2fa8078810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc033000 tx=0x7f2fbc009000 comp rx=0 tx=0).stop 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.209+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 msgr2=0x7f2fcc159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.209+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 0x7f2fcc159210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400c5c0 tx=0x7f2fc400ca80 comp rx=0 tx=0).stop 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 shutdown_connections 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fa8076300 0x7f2fa8078810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fcc156b00 0x7f2fcc159210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fcc1566f0 0x7f2fcc072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 --2- 172.21.15.114:0/1582786527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fcc0aba00 0x7f2fcc152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 >> 172.21.15.114:0/1582786527 conn(0x7f2fcc0c9730 msgr2=0x7f2fcc0ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 shutdown_connections 2024-05-09T00:08:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.210+0000 7f2fcbe00640 1 -- 172.21.15.114:0/1582786527 wait complete. 2024-05-09T00:08:50.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T00:08:50.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:08:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.495+0000 7f2eab200640 1 Processor -- start 2024-05-09T00:08:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.495+0000 7f2eab200640 1 -- start start 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eab200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac0b2c30 0x7f2eac0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eab200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2eac159020 0x7f2eac0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eab200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eac0c8c80 con 0x7f2eac158c10 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eab200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac0b3040 con 0x7f2eac159020 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eab200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac06d790 con 0x7f2eac0b2c30 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eaa800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2eac159020 0x7f2eac0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eaa800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2eac159020 0x7f2eac0cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56734/0 (socket says 172.21.15.114:56734) 2024-05-09T00:08:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2eaa800640 1 -- 172.21.15.114:0/8912452 learned_addr learned my addr 172.21.15.114:0/8912452 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.497+0000 7f2ea9e00640 1 --2- 172.21.15.114:0/8912452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac0b2c30 0x7f2eac0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.498+0000 7f2eaa800640 1 -- 172.21.15.114:0/8912452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac0b2c30 msgr2=0x7f2eac0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.498+0000 7f2eaa800640 1 --2- 172.21.15.114:0/8912452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac0b2c30 0x7f2eac0c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.498+0000 7f2eaa800640 1 -- 172.21.15.114:0/8912452 >> v1:172.21.15.153:6789/0 conn(0x7f2eac158c10 legacy=0x7f2eac0af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.498+0000 7f2eaa800640 1 -- 172.21.15.114:0/8912452 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac06da70 con 0x7f2eac159020 2024-05-09T00:08:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.499+0000 7f2eaa800640 1 --2- 172.21.15.114:0/8912452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac159020 0x7f2eac0cb4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009870 tx=0x7f2ea402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d31a1f3d646a38 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.499+0000 7f2ea8a00640 1 -- 172.21.15.114:0/8912452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4037070 con 0x7f2eac159020 2024-05-09T00:08:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.499+0000 7f2ea8a00640 1 -- 172.21.15.114:0/8912452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea4032440 con 0x7f2eac159020 2024-05-09T00:08:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.499+0000 7f2ea8a00640 1 -- 172.21.15.114:0/8912452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4032810 con 0x7f2eac159020 2024-05-09T00:08:50.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 -- 172.21.15.114:0/8912452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac159020 msgr2=0x7f2eac0cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 --2- 172.21.15.114:0/8912452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac159020 0x7f2eac0cb4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009870 tx=0x7f2ea402a1c0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 -- 172.21.15.114:0/8912452 shutdown_connections 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 --2- 172.21.15.114:0/8912452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac159020 0x7f2eac0cb4f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 --2- 172.21.15.114:0/8912452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac0b2c30 0x7f2eac0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 -- 172.21.15.114:0/8912452 >> 172.21.15.114:0/8912452 conn(0x7f2eac0cd8f0 msgr2=0x7f2eac0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 -- 172.21.15.114:0/8912452 shutdown_connections 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.500+0000 7f2eab200640 1 -- 172.21.15.114:0/8912452 wait complete. 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.502+0000 7f2eab200640 1 Processor -- start 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.502+0000 7f2eab200640 1 -- start start 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.503+0000 7f2eab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 0x7f2eac0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.503+0000 7f2eab200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac158c10 0x7f2eac1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.503+0000 7f2eab200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eac159020 0x7f2eac152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.503+0000 7f2eab200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac0afca0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.503+0000 7f2eab200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac06e030 con 0x7f2eac159020 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.503+0000 7f2eab200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac0afe20 con 0x7f2eac158c10 2024-05-09T00:08:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 0x7f2eac0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 0x7f2eac0b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56736/0 (socket says 172.21.15.114:56736) 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 -- 172.21.15.114:0/734737015 learned_addr learned my addr 172.21.15.114:0/734737015 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 -- 172.21.15.114:0/734737015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac158c10 msgr2=0x7f2eac1f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac158c10 0x7f2eac1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 -- 172.21.15.114:0/734737015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eac159020 msgr2=0x7f2eac152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eac159020 0x7f2eac152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 -- 172.21.15.114:0/734737015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac1537b0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea9e00640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 0x7f2eac0b1440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400d600 tx=0x7f2e9400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.504+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004240 con 0x7f2eac0b2c30 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.505+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e940043e0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.505+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94003830 con 0x7f2eac0b2c30 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.505+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac1ee6e0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.505+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac1574d0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.506+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac078430 con 0x7f2eac0b2c30 2024-05-09T00:08:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.507+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e940039d0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.508+0000 7f2ea2000640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e880762d0 0x7f2e880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.508+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f2e94097890 con 0x7f2eac0b2c30 2024-05-09T00:08:50.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.508+0000 7f2ea9400640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e880762d0 0x7f2e880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:50.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.509+0000 7f2ea9400640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e880762d0 0x7f2e880787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ad610 tx=0x7f2e9c007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.513+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e940611f0 con 0x7f2eac0b2c30 2024-05-09T00:08:50.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.719+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2eac1ee490 con 0x7f2e880762d0 2024-05-09T00:08:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.731+0000 7f2ea2000640 1 -- 172.21.15.114:0/734737015 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7f2eac1ee490 con 0x7f2e880762d0 2024-05-09T00:08:50.731 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:08:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e880762d0 msgr2=0x7f2e880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e880762d0 0x7f2e880787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ad610 tx=0x7f2e9c007cf0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 msgr2=0x7f2eac0b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 0x7f2eac0b1440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400d600 tx=0x7f2e9400dac0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 shutdown_connections 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e880762d0 0x7f2e880787e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eac159020 0x7f2eac152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2eac158c10 0x7f2eac1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 --2- 172.21.15.114:0/734737015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2eac0b2c30 0x7f2eac0b1440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.736+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 >> 172.21.15.114:0/734737015 conn(0x7f2eac0cd8f0 msgr2=0x7f2eac0ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.737+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 shutdown_connections 2024-05-09T00:08:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:50.737+0000 7f2eab200640 1 -- 172.21.15.114:0/734737015 wait complete. 2024-05-09T00:08:50.757 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-09T00:08:50.287385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":3022848,"data_stored":1795188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.227297"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115519+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:46.115519+0000","last_peered":"2024-05-09T00:08:46.115519+0000","last_clean":"2024-05-09T00:08:46.115519+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:46.115519+0000","last_undegraded":"2024-05-09T00:08:46.115519+0000","last_fullsized":"2024-05-09T00:08:46.115519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104304+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:46.104304+0000","last_peered":"2024-05-09T00:08:46.104304+0000","last_clean":"2024-05-09T00:08:46.104304+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:46.104304+0000","last_undegraded":"2024-05-09T00:08:46.104304+0000","last_fullsized":"2024-05-09T00:08:46.104304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104069+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:46.104069+0000","last_peered":"2024-05-09T00:08:46.104069+0000","last_clean":"2024-05-09T00:08:46.104069+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:46.104069+0000","last_undegraded":"2024-05-09T00:08:46.104069+0000","last_fullsized":"2024-05-09T00:08:46.104069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987271+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:46.987271+0000","last_peered":"2024-05-09T00:08:46.987271+0000","last_clean":"2024-05-09T00:08:46.987271+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:46.987271+0000","last_undegraded":"2024-05-09T00:08:46.987271+0000","last_fullsized":"2024-05-09T00:08:46.987271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115093+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:46.115093+0000","last_peered":"2024-05-09T00:08:46.115093+0000","last_clean":"2024-05-09T00:08:46.115093+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:46.115093+0000","last_undegraded":"2024-05-09T00:08:46.115093+0000","last_fullsized":"2024-05-09T00:08:46.115093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987061+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:46.987061+0000","last_peered":"2024-05-09T00:08:46.987061+0000","last_clean":"2024-05-09T00:08:46.987061+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:46.987061+0000","last_undegraded":"2024-05-09T00:08:46.987061+0000","last_fullsized":"2024-05-09T00:08:46.987061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114955+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:46.114955+0000","last_peered":"2024-05-09T00:08:46.114955+0000","last_clean":"2024-05-09T00:08:46.114955+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:46.114955+0000","last_undegraded":"2024-05-09T00:08:46.114955+0000","last_fullsized":"2024-05-09T00:08:46.114955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.099918+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:46.099918+0000","last_peered":"2024-05-09T00:08:46.099918+0000","last_clean":"2024-05-09T00:08:46.099918+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:46.099918+0000","last_undegraded":"2024-05-09T00:08:46.099918+0000","last_fullsized":"2024-05-09T00:08:46.099918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.095596+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:46.095596+0000","last_peered":"2024-05-09T00:08:46.095596+0000","last_clean":"2024-05-09T00:08:46.095596+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:46.095596+0000","last_undegraded":"2024-05-09T00:08:46.095596+0000","last_fullsized":"2024-05-09T00:08:46.095596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115465+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:46.115465+0000","last_peered":"2024-05-09T00:08:46.115465+0000","last_clean":"2024-05-09T00:08:46.115465+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:46.115465+0000","last_undegraded":"2024-05-09T00:08:46.115465+0000","last_fullsized":"2024-05-09T00:08:46.115465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115214+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:46.115214+0000","last_peered":"2024-05-09T00:08:46.115214+0000","last_clean":"2024-05-09T00:08:46.115214+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:46.115214+0000","last_undegraded":"2024-05-09T00:08:46.115214+0000","last_fullsized":"2024-05-09T00:08:46.115214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115060+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:46.115060+0000","last_peered":"2024-05-09T00:08:46.115060+0000","last_clean":"2024-05-09T00:08:46.115060+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:46.115060+0000","last_undegraded":"2024-05-09T00:08:46.115060+0000","last_fullsized":"2024-05-09T00:08:46.115060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386080+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:46.386080+0000","last_peered":"2024-05-09T00:08:46.386080+0000","last_clean":"2024-05-09T00:08:46.386080+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:46.386080+0000","last_undegraded":"2024-05-09T00:08:46.386080+0000","last_fullsized":"2024-05-09T00:08:46.386080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.385973+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:46.385973+0000","last_peered":"2024-05-09T00:08:46.385973+0000","last_clean":"2024-05-09T00:08:46.385973+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:46.385973+0000","last_undegraded":"2024-05-09T00:08:46.385973+0000","last_fullsized":"2024-05-09T00:08:46.385973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100679+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:46.100679+0000","last_peered":"2024-05-09T00:08:46.100679+0000","last_clean":"2024-05-09T00:08:46.100679+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:46.100679+0000","last_undegraded":"2024-05-09T00:08:46.100679+0000","last_fullsized":"2024-05-09T00:08:46.100679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986032+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:46.986032+0000","last_peered":"2024-05-09T00:08:46.986032+0000","last_clean":"2024-05-09T00:08:46.986032+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:46.986032+0000","last_undegraded":"2024-05-09T00:08:46.986032+0000","last_fullsized":"2024-05-09T00:08:46.986032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988309+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:46.988309+0000","last_peered":"2024-05-09T00:08:46.988309+0000","last_clean":"2024-05-09T00:08:46.988309+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:46.988309+0000","last_undegraded":"2024-05-09T00:08:46.988309+0000","last_fullsized":"2024-05-09T00:08:46.988309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987488+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:46.987488+0000","last_peered":"2024-05-09T00:08:46.987488+0000","last_clean":"2024-05-09T00:08:46.987488+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:46.987488+0000","last_undegraded":"2024-05-09T00:08:46.987488+0000","last_fullsized":"2024-05-09T00:08:46.987488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988109+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:46.988109+0000","last_peered":"2024-05-09T00:08:46.988109+0000","last_clean":"2024-05-09T00:08:46.988109+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:46.988109+0000","last_undegraded":"2024-05-09T00:08:46.988109+0000","last_fullsized":"2024-05-09T00:08:46.988109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115712+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:46.115712+0000","last_peered":"2024-05-09T00:08:46.115712+0000","last_clean":"2024-05-09T00:08:46.115712+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:46.115712+0000","last_undegraded":"2024-05-09T00:08:46.115712+0000","last_fullsized":"2024-05-09T00:08:46.115712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.101010+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:46.101010+0000","last_peered":"2024-05-09T00:08:46.101010+0000","last_clean":"2024-05-09T00:08:46.101010+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:46.101010+0000","last_undegraded":"2024-05-09T00:08:46.101010+0000","last_fullsized":"2024-05-09T00:08:46.101010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094633+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:46.094633+0000","last_peered":"2024-05-09T00:08:46.094633+0000","last_clean":"2024-05-09T00:08:46.094633+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:46.094633+0000","last_undegraded":"2024-05-09T00:08:46.094633+0000","last_fullsized":"2024-05-09T00:08:46.094633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100309+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:46.100309+0000","last_peered":"2024-05-09T00:08:46.100309+0000","last_clean":"2024-05-09T00:08:46.100309+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:46.100309+0000","last_undegraded":"2024-05-09T00:08:46.100309+0000","last_fullsized":"2024-05-09T00:08:46.100309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986048+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:46.986048+0000","last_peered":"2024-05-09T00:08:46.986048+0000","last_clean":"2024-05-09T00:08:46.986048+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:46.986048+0000","last_undegraded":"2024-05-09T00:08:46.986048+0000","last_fullsized":"2024-05-09T00:08:46.986048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104435+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:46.104435+0000","last_peered":"2024-05-09T00:08:46.104435+0000","last_clean":"2024-05-09T00:08:46.104435+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:46.104435+0000","last_undegraded":"2024-05-09T00:08:46.104435+0000","last_fullsized":"2024-05-09T00:08:46.104435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987254+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:46.987254+0000","last_peered":"2024-05-09T00:08:46.987254+0000","last_clean":"2024-05-09T00:08:46.987254+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:46.987254+0000","last_undegraded":"2024-05-09T00:08:46.987254+0000","last_fullsized":"2024-05-09T00:08:46.987254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.387002+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:46.387002+0000","last_peered":"2024-05-09T00:08:46.387002+0000","last_clean":"2024-05-09T00:08:46.387002+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:46.387002+0000","last_undegraded":"2024-05-09T00:08:46.387002+0000","last_fullsized":"2024-05-09T00:08:46.387002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386155+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:46.386155+0000","last_peered":"2024-05-09T00:08:46.386155+0000","last_clean":"2024-05-09T00:08:46.386155+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:46.386155+0000","last_undegraded":"2024-05-09T00:08:46.386155+0000","last_fullsized":"2024-05-09T00:08:46.386155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103450+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:46.103450+0000","last_peered":"2024-05-09T00:08:46.103450+0000","last_clean":"2024-05-09T00:08:46.103450+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:46.103450+0000","last_undegraded":"2024-05-09T00:08:46.103450+0000","last_fullsized":"2024-05-09T00:08:46.103450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987128+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:46.987128+0000","last_peered":"2024-05-09T00:08:46.987128+0000","last_clean":"2024-05-09T00:08:46.987128+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:46.987128+0000","last_undegraded":"2024-05-09T00:08:46.987128+0000","last_fullsized":"2024-05-09T00:08:46.987128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987180+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:46.987180+0000","last_peered":"2024-05-09T00:08:46.987180+0000","last_clean":"2024-05-09T00:08:46.987180+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:46.987180+0000","last_undegraded":"2024-05-09T00:08:46.987180+0000","last_fullsized":"2024-05-09T00:08:46.987180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986291+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:46.986291+0000","last_peered":"2024-05-09T00:08:46.986291+0000","last_clean":"2024-05-09T00:08:46.986291+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:46.986291+0000","last_undegraded":"2024-05-09T00:08:46.986291+0000","last_fullsized":"2024-05-09T00:08:46.986291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094811+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:46.094811+0000","last_peered":"2024-05-09T00:08:46.094811+0000","last_clean":"2024-05-09T00:08:46.094811+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:46.094811+0000","last_undegraded":"2024-05-09T00:08:46.094811+0000","last_fullsized":"2024-05-09T00:08:46.094811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103185+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:46.103185+0000","last_peered":"2024-05-09T00:08:46.103185+0000","last_clean":"2024-05-09T00:08:46.103185+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:46.103185+0000","last_undegraded":"2024-05-09T00:08:46.103185+0000","last_fullsized":"2024-05-09T00:08:46.103185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.101355+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:46.101355+0000","last_peered":"2024-05-09T00:08:46.101355+0000","last_clean":"2024-05-09T00:08:46.101355+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:46.101355+0000","last_undegraded":"2024-05-09T00:08:46.101355+0000","last_fullsized":"2024-05-09T00:08:46.101355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987856+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:46.987856+0000","last_peered":"2024-05-09T00:08:46.987856+0000","last_clean":"2024-05-09T00:08:46.987856+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:46.987856+0000","last_undegraded":"2024-05-09T00:08:46.987856+0000","last_fullsized":"2024-05-09T00:08:46.987856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.385405+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:46.385405+0000","last_peered":"2024-05-09T00:08:46.385405+0000","last_clean":"2024-05-09T00:08:46.385405+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:46.385405+0000","last_undegraded":"2024-05-09T00:08:46.385405+0000","last_fullsized":"2024-05-09T00:08:46.385405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100403+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:46.100403+0000","last_peered":"2024-05-09T00:08:46.100403+0000","last_clean":"2024-05-09T00:08:46.100403+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:46.100403+0000","last_undegraded":"2024-05-09T00:08:46.100403+0000","last_fullsized":"2024-05-09T00:08:46.100403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986171+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:46.986171+0000","last_peered":"2024-05-09T00:08:46.986171+0000","last_clean":"2024-05-09T00:08:46.986171+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:46.986171+0000","last_undegraded":"2024-05-09T00:08:46.986171+0000","last_fullsized":"2024-05-09T00:08:46.986171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.099082+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:46.099082+0000","last_peered":"2024-05-09T00:08:46.099082+0000","last_clean":"2024-05-09T00:08:46.099082+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:46.099082+0000","last_undegraded":"2024-05-09T00:08:46.099082+0000","last_fullsized":"2024-05-09T00:08:46.099082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.095493+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:46.095493+0000","last_peered":"2024-05-09T00:08:46.095493+0000","last_clean":"2024-05-09T00:08:46.095493+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:46.095493+0000","last_undegraded":"2024-05-09T00:08:46.095493+0000","last_fullsized":"2024-05-09T00:08:46.095493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987382+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:46.987382+0000","last_peered":"2024-05-09T00:08:46.987382+0000","last_clean":"2024-05-09T00:08:46.987382+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:46.987382+0000","last_undegraded":"2024-05-09T00:08:46.987382+0000","last_fullsized":"2024-05-09T00:08:46.987382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115300+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:46.115300+0000","last_peered":"2024-05-09T00:08:46.115300+0000","last_clean":"2024-05-09T00:08:46.115300+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:46.115300+0000","last_undegraded":"2024-05-09T00:08:46.115300+0000","last_fullsized":"2024-05-09T00:08:46.115300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104784+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:46.104784+0000","last_peered":"2024-05-09T00:08:46.104784+0000","last_clean":"2024-05-09T00:08:46.104784+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:46.104784+0000","last_undegraded":"2024-05-09T00:08:46.104784+0000","last_fullsized":"2024-05-09T00:08:46.104784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987000+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:46.987000+0000","last_peered":"2024-05-09T00:08:46.987000+0000","last_clean":"2024-05-09T00:08:46.987000+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:46.987000+0000","last_undegraded":"2024-05-09T00:08:46.987000+0000","last_fullsized":"2024-05-09T00:08:46.987000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987804+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:46.987804+0000","last_peered":"2024-05-09T00:08:46.987804+0000","last_clean":"2024-05-09T00:08:46.987804+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:46.987804+0000","last_undegraded":"2024-05-09T00:08:46.987804+0000","last_fullsized":"2024-05-09T00:08:46.987804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987493+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:08:46.987493+0000","last_peered":"2024-05-09T00:08:46.987493+0000","last_clean":"2024-05-09T00:08:46.987493+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:08:46.987493+0000","last_undegraded":"2024-05-09T00:08:46.987493+0000","last_fullsized":"2024-05-09T00:08:46.987493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115953+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:46.115953+0000","last_peered":"2024-05-09T00:08:46.115953+0000","last_clean":"2024-05-09T00:08:46.115953+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:46.115953+0000","last_undegraded":"2024-05-09T00:08:46.115953+0000","last_fullsized":"2024-05-09T00:08:46.115953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986764+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:46.986764+0000","last_peered":"2024-05-09T00:08:46.986764+0000","last_clean":"2024-05-09T00:08:46.986764+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:46.986764+0000","last_undegraded":"2024-05-09T00:08:46.986764+0000","last_fullsized":"2024-05-09T00:08:46.986764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386483+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:46.386483+0000","last_peered":"2024-05-09T00:08:46.386483+0000","last_clean":"2024-05-09T00:08:46.386483+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:46.386483+0000","last_undegraded":"2024-05-09T00:08:46.386483+0000","last_fullsized":"2024-05-09T00:08:46.386483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988086+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:46.988086+0000","last_peered":"2024-05-09T00:08:46.988086+0000","last_clean":"2024-05-09T00:08:46.988086+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:46.988086+0000","last_undegraded":"2024-05-09T00:08:46.988086+0000","last_fullsized":"2024-05-09T00:08:46.988086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988578+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:46.988578+0000","last_peered":"2024-05-09T00:08:46.988578+0000","last_clean":"2024-05-09T00:08:46.988578+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:46.988578+0000","last_undegraded":"2024-05-09T00:08:46.988578+0000","last_fullsized":"2024-05-09T00:08:46.988578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114745+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:46.114745+0000","last_peered":"2024-05-09T00:08:46.114745+0000","last_clean":"2024-05-09T00:08:46.114745+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:46.114745+0000","last_undegraded":"2024-05-09T00:08:46.114745+0000","last_fullsized":"2024-05-09T00:08:46.114745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094963+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:46.094963+0000","last_peered":"2024-05-09T00:08:46.094963+0000","last_clean":"2024-05-09T00:08:46.094963+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:46.094963+0000","last_undegraded":"2024-05-09T00:08:46.094963+0000","last_fullsized":"2024-05-09T00:08:46.094963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.098591+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:46.098591+0000","last_peered":"2024-05-09T00:08:46.098591+0000","last_clean":"2024-05-09T00:08:46.098591+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:46.098591+0000","last_undegraded":"2024-05-09T00:08:46.098591+0000","last_fullsized":"2024-05-09T00:08:46.098591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986549+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:46.986549+0000","last_peered":"2024-05-09T00:08:46.986549+0000","last_clean":"2024-05-09T00:08:46.986549+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:46.986549+0000","last_undegraded":"2024-05-09T00:08:46.986549+0000","last_fullsized":"2024-05-09T00:08:46.986549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.116279+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:46.116279+0000","last_peered":"2024-05-09T00:08:46.116279+0000","last_clean":"2024-05-09T00:08:46.116279+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:46.116279+0000","last_undegraded":"2024-05-09T00:08:46.116279+0000","last_fullsized":"2024-05-09T00:08:46.116279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987592+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:46.987592+0000","last_peered":"2024-05-09T00:08:46.987592+0000","last_clean":"2024-05-09T00:08:46.987592+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:46.987592+0000","last_undegraded":"2024-05-09T00:08:46.987592+0000","last_fullsized":"2024-05-09T00:08:46.987592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103753+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:46.103753+0000","last_peered":"2024-05-09T00:08:46.103753+0000","last_clean":"2024-05-09T00:08:46.103753+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:46.103753+0000","last_undegraded":"2024-05-09T00:08:46.103753+0000","last_fullsized":"2024-05-09T00:08:46.103753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115977+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:46.115977+0000","last_peered":"2024-05-09T00:08:46.115977+0000","last_clean":"2024-05-09T00:08:46.115977+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:46.115977+0000","last_undegraded":"2024-05-09T00:08:46.115977+0000","last_fullsized":"2024-05-09T00:08:46.115977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103767+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:46.103767+0000","last_peered":"2024-05-09T00:08:46.103767+0000","last_clean":"2024-05-09T00:08:46.103767+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:46.103767+0000","last_undegraded":"2024-05-09T00:08:46.103767+0000","last_fullsized":"2024-05-09T00:08:46.103767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115744+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:46.115744+0000","last_peered":"2024-05-09T00:08:46.115744+0000","last_clean":"2024-05-09T00:08:46.115744+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:46.115744+0000","last_undegraded":"2024-05-09T00:08:46.115744+0000","last_fullsized":"2024-05-09T00:08:46.115744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386619+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:46.386619+0000","last_peered":"2024-05-09T00:08:46.386619+0000","last_clean":"2024-05-09T00:08:46.386619+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:46.386619+0000","last_undegraded":"2024-05-09T00:08:46.386619+0000","last_fullsized":"2024-05-09T00:08:46.386619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987423+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:46.987423+0000","last_peered":"2024-05-09T00:08:46.987423+0000","last_clean":"2024-05-09T00:08:46.987423+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:46.987423+0000","last_undegraded":"2024-05-09T00:08:46.987423+0000","last_fullsized":"2024-05-09T00:08:46.987423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094413+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:46.094413+0000","last_peered":"2024-05-09T00:08:46.094413+0000","last_clean":"2024-05-09T00:08:46.094413+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:46.094413+0000","last_undegraded":"2024-05-09T00:08:46.094413+0000","last_fullsized":"2024-05-09T00:08:46.094413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988343+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:46.988343+0000","last_peered":"2024-05-09T00:08:46.988343+0000","last_clean":"2024-05-09T00:08:46.988343+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:46.988343+0000","last_undegraded":"2024-05-09T00:08:46.988343+0000","last_fullsized":"2024-05-09T00:08:46.988343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.102471+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:46.102471+0000","last_peered":"2024-05-09T00:08:46.102471+0000","last_clean":"2024-05-09T00:08:46.102471+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:46.102471+0000","last_undegraded":"2024-05-09T00:08:46.102471+0000","last_fullsized":"2024-05-09T00:08:46.102471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986235+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:46.986235+0000","last_peered":"2024-05-09T00:08:46.986235+0000","last_clean":"2024-05-09T00:08:46.986235+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:46.986235+0000","last_undegraded":"2024-05-09T00:08:46.986235+0000","last_fullsized":"2024-05-09T00:08:46.986235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.385779+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:46.385779+0000","last_peered":"2024-05-09T00:08:46.385779+0000","last_clean":"2024-05-09T00:08:46.385779+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:46.385779+0000","last_undegraded":"2024-05-09T00:08:46.385779+0000","last_fullsized":"2024-05-09T00:08:46.385779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986452+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:46.986452+0000","last_peered":"2024-05-09T00:08:46.986452+0000","last_clean":"2024-05-09T00:08:46.986452+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:46.986452+0000","last_undegraded":"2024-05-09T00:08:46.986452+0000","last_fullsized":"2024-05-09T00:08:46.986452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100160+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:46.100160+0000","last_peered":"2024-05-09T00:08:46.100160+0000","last_clean":"2024-05-09T00:08:46.100160+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:46.100160+0000","last_undegraded":"2024-05-09T00:08:46.100160+0000","last_fullsized":"2024-05-09T00:08:46.100160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988289+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:46.988289+0000","last_peered":"2024-05-09T00:08:46.988289+0000","last_clean":"2024-05-09T00:08:46.988289+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:46.988289+0000","last_undegraded":"2024-05-09T00:08:46.988289+0000","last_fullsized":"2024-05-09T00:08:46.988289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114884+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:46.114884+0000","last_peered":"2024-05-09T00:08:46.114884+0000","last_clean":"2024-05-09T00:08:46.114884+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:46.114884+0000","last_undegraded":"2024-05-09T00:08:46.114884+0000","last_fullsized":"2024-05-09T00:08:46.114884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103632+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:46.103632+0000","last_peered":"2024-05-09T00:08:46.103632+0000","last_clean":"2024-05-09T00:08:46.103632+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:46.103632+0000","last_undegraded":"2024-05-09T00:08:46.103632+0000","last_fullsized":"2024-05-09T00:08:46.103632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986408+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:46.986408+0000","last_peered":"2024-05-09T00:08:46.986408+0000","last_clean":"2024-05-09T00:08:46.986408+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:46.986408+0000","last_undegraded":"2024-05-09T00:08:46.986408+0000","last_fullsized":"2024-05-09T00:08:46.986408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988267+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:46.988267+0000","last_peered":"2024-05-09T00:08:46.988267+0000","last_clean":"2024-05-09T00:08:46.988267+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:46.988267+0000","last_undegraded":"2024-05-09T00:08:46.988267+0000","last_fullsized":"2024-05-09T00:08:46.988267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386596+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:46.386596+0000","last_peered":"2024-05-09T00:08:46.386596+0000","last_clean":"2024-05-09T00:08:46.386596+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:46.386596+0000","last_undegraded":"2024-05-09T00:08:46.386596+0000","last_fullsized":"2024-05-09T00:08:46.386596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.113024+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:46.113024+0000","last_peered":"2024-05-09T00:08:46.113024+0000","last_clean":"2024-05-09T00:08:46.113024+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:46.113024+0000","last_undegraded":"2024-05-09T00:08:46.113024+0000","last_fullsized":"2024-05-09T00:08:46.113024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104328+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:46.104328+0000","last_peered":"2024-05-09T00:08:46.104328+0000","last_clean":"2024-05-09T00:08:46.104328+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:46.104328+0000","last_undegraded":"2024-05-09T00:08:46.104328+0000","last_fullsized":"2024-05-09T00:08:46.104328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988234+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:46.988234+0000","last_peered":"2024-05-09T00:08:46.988234+0000","last_clean":"2024-05-09T00:08:46.988234+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:46.988234+0000","last_undegraded":"2024-05-09T00:08:46.988234+0000","last_fullsized":"2024-05-09T00:08:46.988234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103475+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:46.103475+0000","last_peered":"2024-05-09T00:08:46.103475+0000","last_clean":"2024-05-09T00:08:46.103475+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:46.103475+0000","last_undegraded":"2024-05-09T00:08:46.103475+0000","last_fullsized":"2024-05-09T00:08:46.103475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114351+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:46.114351+0000","last_peered":"2024-05-09T00:08:46.114351+0000","last_clean":"2024-05-09T00:08:46.114351+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:46.114351+0000","last_undegraded":"2024-05-09T00:08:46.114351+0000","last_fullsized":"2024-05-09T00:08:46.114351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986667+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:46.986667+0000","last_peered":"2024-05-09T00:08:46.986667+0000","last_clean":"2024-05-09T00:08:46.986667+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:46.986667+0000","last_undegraded":"2024-05-09T00:08:46.986667+0000","last_fullsized":"2024-05-09T00:08:46.986667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100870+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:46.100870+0000","last_peered":"2024-05-09T00:08:46.100870+0000","last_clean":"2024-05-09T00:08:46.100870+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:46.100870+0000","last_undegraded":"2024-05-09T00:08:46.100870+0000","last_fullsized":"2024-05-09T00:08:46.100870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.098760+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:46.098760+0000","last_peered":"2024-05-09T00:08:46.098760+0000","last_clean":"2024-05-09T00:08:46.098760+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:46.098760+0000","last_undegraded":"2024-05-09T00:08:46.098760+0000","last_fullsized":"2024-05-09T00:08:46.098760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386319+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:46.386319+0000","last_peered":"2024-05-09T00:08:46.386319+0000","last_clean":"2024-05-09T00:08:46.386319+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:46.386319+0000","last_undegraded":"2024-05-09T00:08:46.386319+0000","last_fullsized":"2024-05-09T00:08:46.386319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986929+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:46.986929+0000","last_peered":"2024-05-09T00:08:46.986929+0000","last_clean":"2024-05-09T00:08:46.986929+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:46.986929+0000","last_undegraded":"2024-05-09T00:08:46.986929+0000","last_fullsized":"2024-05-09T00:08:46.986929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988066+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:46.988066+0000","last_peered":"2024-05-09T00:08:46.988066+0000","last_clean":"2024-05-09T00:08:46.988066+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:46.988066+0000","last_undegraded":"2024-05-09T00:08:46.988066+0000","last_fullsized":"2024-05-09T00:08:46.988066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988509+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:46.988509+0000","last_peered":"2024-05-09T00:08:46.988509+0000","last_clean":"2024-05-09T00:08:46.988509+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:46.988509+0000","last_undegraded":"2024-05-09T00:08:46.988509+0000","last_fullsized":"2024-05-09T00:08:46.988509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988570+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:46.988570+0000","last_peered":"2024-05-09T00:08:46.988570+0000","last_clean":"2024-05-09T00:08:46.988570+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:46.988570+0000","last_undegraded":"2024-05-09T00:08:46.988570+0000","last_fullsized":"2024-05-09T00:08:46.988570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115929+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:46.115929+0000","last_peered":"2024-05-09T00:08:46.115929+0000","last_clean":"2024-05-09T00:08:46.115929+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:46.115929+0000","last_undegraded":"2024-05-09T00:08:46.115929+0000","last_fullsized":"2024-05-09T00:08:46.115929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.095930+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:46.095930+0000","last_peered":"2024-05-09T00:08:46.095930+0000","last_clean":"2024-05-09T00:08:46.095930+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:46.095930+0000","last_undegraded":"2024-05-09T00:08:46.095930+0000","last_fullsized":"2024-05-09T00:08:46.095930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115292+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:46.115292+0000","last_peered":"2024-05-09T00:08:46.115292+0000","last_clean":"2024-05-09T00:08:46.115292+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:46.115292+0000","last_undegraded":"2024-05-09T00:08:46.115292+0000","last_fullsized":"2024-05-09T00:08:46.115292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104902+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:46.104902+0000","last_peered":"2024-05-09T00:08:46.104902+0000","last_clean":"2024-05-09T00:08:46.104902+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:46.104902+0000","last_undegraded":"2024-05-09T00:08:46.104902+0000","last_fullsized":"2024-05-09T00:08:46.104902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104984+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:46.104984+0000","last_peered":"2024-05-09T00:08:46.104984+0000","last_clean":"2024-05-09T00:08:46.104984+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:46.104984+0000","last_undegraded":"2024-05-09T00:08:46.104984+0000","last_fullsized":"2024-05-09T00:08:46.104984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104813+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:46.104813+0000","last_peered":"2024-05-09T00:08:46.104813+0000","last_clean":"2024-05-09T00:08:46.104813+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:46.104813+0000","last_undegraded":"2024-05-09T00:08:46.104813+0000","last_fullsized":"2024-05-09T00:08:46.104813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104869+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:46.104869+0000","last_peered":"2024-05-09T00:08:46.104869+0000","last_clean":"2024-05-09T00:08:46.104869+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:46.104869+0000","last_undegraded":"2024-05-09T00:08:46.104869+0000","last_fullsized":"2024-05-09T00:08:46.104869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":78488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:08:50.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:08:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.072+0000 7f61cb200640 1 Processor -- start 2024-05-09T00:08:51.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.072+0000 7f61cb200640 1 -- start start 2024-05-09T00:08:51.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61cb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f61cc0accb0 0x7f61cc0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61cb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 0x7f61cc0af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61cb200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61cc0ad0c0 con 0x7f61cc0aba00 2024-05-09T00:08:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61cb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f61cc156260 con 0x7f61cc0accb0 2024-05-09T00:08:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61cb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61cc0ad340 con 0x7f61cc0aed60 2024-05-09T00:08:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61c9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f61cc0aba00 0x7f61cc1566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40562/0 (socket says 172.21.15.114:40562) 2024-05-09T00:08:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.074+0000 7f61c9e00640 1 -- 172.21.15.114:0/2513562868 learned_addr learned my addr 172.21.15.114:0/2513562868 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:51.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63756964 0 0) 0x7f61bc001490 con 0x7f61cc0aba00 2024-05-09T00:08:51.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61b0003520 con 0x7f61cc0aba00 2024-05-09T00:08:51.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61ca800640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 0x7f61cc0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c9400640 1 --2- 172.21.15.114:0/2513562868 >> v2:172.21.15.153:3300/0 conn(0x7f61cc0accb0 0x7f61cc0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996240384 0 0) 0x7f61b0003520 con 0x7f61cc0aba00 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 msgr2=0x7f61cc0af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 0x7f61cc0af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 >> v2:172.21.15.153:3300/0 conn(0x7f61cc0accb0 msgr2=0x7f61cc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 --2- 172.21.15.114:0/2513562868 >> v2:172.21.15.153:3300/0 conn(0x7f61cc0accb0 0x7f61cc0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc155f10 con 0x7f61cc0aba00 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f61bc001c40 con 0x7f61cc0aba00 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 >> v1:172.21.15.114:6789/0 conn(0x7f61cc0aba00 legacy=0x7f61cc1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61b0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0004800 0x7f61b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 0x7f61b00052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc156260 con 0x7f61b0003a50 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc0ad340 con 0x7f61b0004800 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.075+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61b000bc00 con 0x7f61cc0aed60 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9e00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61b0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9400640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0004800 0x7f61b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61ca800640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 0x7f61b00052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9e00640 1 -- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 msgr2=0x7f61b00052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9e00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc0aed60 0x7f61b00052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9e00640 1 -- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0004800 msgr2=0x7f61b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9e00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0004800 0x7f61b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.076+0000 7f61c9e00640 1 -- 172.21.15.114:0/2513562868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b0003520 con 0x7f61b0003a50 2024-05-09T00:08:51.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.077+0000 7f61c9e00640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61b0003ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61cc071ba0 tx=0x7f61b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f219a23d198b4a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:51.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00a5f0 con 0x7f61b0003a50 2024-05-09T00:08:51.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc02f070 con 0x7f61b0003a50 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61c8a00640 1 -- 172.21.15.114:0/2513562868 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc02bd40 con 0x7f61b0003a50 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61cb200640 1 -- 172.21.15.114:0/2513562868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 msgr2=0x7f61b0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61cb200640 1 --2- 172.21.15.114:0/2513562868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61b0003ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61cc071ba0 tx=0x7f61b0005830 comp rx=0 tx=0).stop 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61ca800640 1 -- 172.21.15.114:0/2513562868 reap_dead start 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.078+0000 7f61cb200640 1 -- 172.21.15.114:0/2513562868 shutdown_connections 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.079+0000 7f61cb200640 1 -- 172.21.15.114:0/2513562868 >> 172.21.15.114:0/2513562868 conn(0x7f61cc0c9730 msgr2=0x7f61cc0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.079+0000 7f61cb200640 1 -- 172.21.15.114:0/2513562868 shutdown_connections 2024-05-09T00:08:51.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.079+0000 7f61cb200640 1 -- 172.21.15.114:0/2513562868 wait complete. 2024-05-09T00:08:51.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.081+0000 7f61cb200640 1 Processor -- start 2024-05-09T00:08:51.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.081+0000 7f61cb200640 1 -- start start 2024-05-09T00:08:51.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.082+0000 7f61cb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61cc13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.082+0000 7f61cb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc13cfe0 0x7f61cc0721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.082+0000 7f61cb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc072730 0x7f61cc152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.082+0000 7f61cb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc0c5220 con 0x7f61b0003a50 2024-05-09T00:08:51.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.082+0000 7f61cb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc0c4f40 con 0x7f61cc13cfe0 2024-05-09T00:08:51.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.082+0000 7f61cb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61cc0c4920 con 0x7f61cc072730 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61cc13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61cc13caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56754/0 (socket says 172.21.15.114:56754) 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 -- 172.21.15.114:0/903990187 learned_addr learned my addr 172.21.15.114:0/903990187 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61ca800640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc072730 0x7f61cc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 -- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc072730 msgr2=0x7f61cc152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc072730 0x7f61cc152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 -- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc13cfe0 msgr2=0x7f61cc0721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc13cfe0 0x7f61cc0721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 -- 172.21.15.114:0/903990187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc153440 con 0x7f61b0003a50 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.083+0000 7f61c9e00640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61cc13caa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00aa60 tx=0x7f61cc0ad4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.084+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00a5f0 con 0x7f61b0003a50 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.084+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc02bcf0 con 0x7f61b0003a50 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.084+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc034690 con 0x7f61b0003a50 2024-05-09T00:08:51.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.084+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc153720 con 0x7f61b0003a50 2024-05-09T00:08:51.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.084+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc073f70 con 0x7f61b0003a50 2024-05-09T00:08:51.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.085+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61cc078430 con 0x7f61b0003a50 2024-05-09T00:08:51.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.086+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f61bc034830 con 0x7f61b0003a50 2024-05-09T00:08:51.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.087+0000 7f61c2000640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f61a80762d0 0x7f61a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.087+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f61bc0b7940 con 0x7f61b0003a50 2024-05-09T00:08:51.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.087+0000 7f61c9400640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f61a80762d0 0x7f61a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.088+0000 7f61c9400640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f61a80762d0 0x7f61a80787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ac5e0 tx=0x7f61b400f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:51.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.092+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f61cc0ad0c0 con 0x7f61b0003a50 2024-05-09T00:08:51.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.293+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61cc0c4b80 con 0x7f61a80762d0 2024-05-09T00:08:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.313+0000 7f61c2000640 1 -- 172.21.15.114:0/903990187 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7f61cc0c4b80 con 0x7f61a80762d0 2024-05-09T00:08:51.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:08:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f61a80762d0 msgr2=0x7f61a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f61a80762d0 0x7f61a80787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ac5e0 tx=0x7f61b400f040 comp rx=0 tx=0).stop 2024-05-09T00:08:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 msgr2=0x7f61cc13caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61cc13caa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00aa60 tx=0x7f61cc0ad4c0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 shutdown_connections 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f61a80762d0 0x7f61a80787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61cc072730 0x7f61cc152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc13cfe0 0x7f61cc0721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 --2- 172.21.15.114:0/903990187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b0003a50 0x7f61cc13caa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.317+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 >> 172.21.15.114:0/903990187 conn(0x7f61cc0c9730 msgr2=0x7f61cc06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.318+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 shutdown_connections 2024-05-09T00:08:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.318+0000 7f61cb200640 1 -- 172.21.15.114:0/903990187 wait complete. 2024-05-09T00:08:51.338 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-09T00:08:50.287385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":3022848,"data_stored":1795188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.227297"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115519+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:46.115519+0000","last_peered":"2024-05-09T00:08:46.115519+0000","last_clean":"2024-05-09T00:08:46.115519+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:46.115519+0000","last_undegraded":"2024-05-09T00:08:46.115519+0000","last_fullsized":"2024-05-09T00:08:46.115519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104304+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:46.104304+0000","last_peered":"2024-05-09T00:08:46.104304+0000","last_clean":"2024-05-09T00:08:46.104304+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:46.104304+0000","last_undegraded":"2024-05-09T00:08:46.104304+0000","last_fullsized":"2024-05-09T00:08:46.104304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104069+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:46.104069+0000","last_peered":"2024-05-09T00:08:46.104069+0000","last_clean":"2024-05-09T00:08:46.104069+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:46.104069+0000","last_undegraded":"2024-05-09T00:08:46.104069+0000","last_fullsized":"2024-05-09T00:08:46.104069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987271+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:46.987271+0000","last_peered":"2024-05-09T00:08:46.987271+0000","last_clean":"2024-05-09T00:08:46.987271+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:46.987271+0000","last_undegraded":"2024-05-09T00:08:46.987271+0000","last_fullsized":"2024-05-09T00:08:46.987271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115093+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:46.115093+0000","last_peered":"2024-05-09T00:08:46.115093+0000","last_clean":"2024-05-09T00:08:46.115093+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:46.115093+0000","last_undegraded":"2024-05-09T00:08:46.115093+0000","last_fullsized":"2024-05-09T00:08:46.115093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987061+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:46.987061+0000","last_peered":"2024-05-09T00:08:46.987061+0000","last_clean":"2024-05-09T00:08:46.987061+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:46.987061+0000","last_undegraded":"2024-05-09T00:08:46.987061+0000","last_fullsized":"2024-05-09T00:08:46.987061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114955+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:46.114955+0000","last_peered":"2024-05-09T00:08:46.114955+0000","last_clean":"2024-05-09T00:08:46.114955+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:46.114955+0000","last_undegraded":"2024-05-09T00:08:46.114955+0000","last_fullsized":"2024-05-09T00:08:46.114955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.099918+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:46.099918+0000","last_peered":"2024-05-09T00:08:46.099918+0000","last_clean":"2024-05-09T00:08:46.099918+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:46.099918+0000","last_undegraded":"2024-05-09T00:08:46.099918+0000","last_fullsized":"2024-05-09T00:08:46.099918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.095596+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:46.095596+0000","last_peered":"2024-05-09T00:08:46.095596+0000","last_clean":"2024-05-09T00:08:46.095596+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:46.095596+0000","last_undegraded":"2024-05-09T00:08:46.095596+0000","last_fullsized":"2024-05-09T00:08:46.095596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115465+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:46.115465+0000","last_peered":"2024-05-09T00:08:46.115465+0000","last_clean":"2024-05-09T00:08:46.115465+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:46.115465+0000","last_undegraded":"2024-05-09T00:08:46.115465+0000","last_fullsized":"2024-05-09T00:08:46.115465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115214+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:46.115214+0000","last_peered":"2024-05-09T00:08:46.115214+0000","last_clean":"2024-05-09T00:08:46.115214+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:46.115214+0000","last_undegraded":"2024-05-09T00:08:46.115214+0000","last_fullsized":"2024-05-09T00:08:46.115214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115060+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:46.115060+0000","last_peered":"2024-05-09T00:08:46.115060+0000","last_clean":"2024-05-09T00:08:46.115060+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:46.115060+0000","last_undegraded":"2024-05-09T00:08:46.115060+0000","last_fullsized":"2024-05-09T00:08:46.115060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386080+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:46.386080+0000","last_peered":"2024-05-09T00:08:46.386080+0000","last_clean":"2024-05-09T00:08:46.386080+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:46.386080+0000","last_undegraded":"2024-05-09T00:08:46.386080+0000","last_fullsized":"2024-05-09T00:08:46.386080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.385973+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:46.385973+0000","last_peered":"2024-05-09T00:08:46.385973+0000","last_clean":"2024-05-09T00:08:46.385973+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:46.385973+0000","last_undegraded":"2024-05-09T00:08:46.385973+0000","last_fullsized":"2024-05-09T00:08:46.385973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100679+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:46.100679+0000","last_peered":"2024-05-09T00:08:46.100679+0000","last_clean":"2024-05-09T00:08:46.100679+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:46.100679+0000","last_undegraded":"2024-05-09T00:08:46.100679+0000","last_fullsized":"2024-05-09T00:08:46.100679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986032+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:46.986032+0000","last_peered":"2024-05-09T00:08:46.986032+0000","last_clean":"2024-05-09T00:08:46.986032+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:46.986032+0000","last_undegraded":"2024-05-09T00:08:46.986032+0000","last_fullsized":"2024-05-09T00:08:46.986032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988309+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:46.988309+0000","last_peered":"2024-05-09T00:08:46.988309+0000","last_clean":"2024-05-09T00:08:46.988309+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:46.988309+0000","last_undegraded":"2024-05-09T00:08:46.988309+0000","last_fullsized":"2024-05-09T00:08:46.988309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987488+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:46.987488+0000","last_peered":"2024-05-09T00:08:46.987488+0000","last_clean":"2024-05-09T00:08:46.987488+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:46.987488+0000","last_undegraded":"2024-05-09T00:08:46.987488+0000","last_fullsized":"2024-05-09T00:08:46.987488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988109+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:46.988109+0000","last_peered":"2024-05-09T00:08:46.988109+0000","last_clean":"2024-05-09T00:08:46.988109+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:46.988109+0000","last_undegraded":"2024-05-09T00:08:46.988109+0000","last_fullsized":"2024-05-09T00:08:46.988109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115712+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:46.115712+0000","last_peered":"2024-05-09T00:08:46.115712+0000","last_clean":"2024-05-09T00:08:46.115712+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:46.115712+0000","last_undegraded":"2024-05-09T00:08:46.115712+0000","last_fullsized":"2024-05-09T00:08:46.115712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.101010+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:46.101010+0000","last_peered":"2024-05-09T00:08:46.101010+0000","last_clean":"2024-05-09T00:08:46.101010+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:46.101010+0000","last_undegraded":"2024-05-09T00:08:46.101010+0000","last_fullsized":"2024-05-09T00:08:46.101010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094633+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:46.094633+0000","last_peered":"2024-05-09T00:08:46.094633+0000","last_clean":"2024-05-09T00:08:46.094633+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:46.094633+0000","last_undegraded":"2024-05-09T00:08:46.094633+0000","last_fullsized":"2024-05-09T00:08:46.094633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100309+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:46.100309+0000","last_peered":"2024-05-09T00:08:46.100309+0000","last_clean":"2024-05-09T00:08:46.100309+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:46.100309+0000","last_undegraded":"2024-05-09T00:08:46.100309+0000","last_fullsized":"2024-05-09T00:08:46.100309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986048+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:46.986048+0000","last_peered":"2024-05-09T00:08:46.986048+0000","last_clean":"2024-05-09T00:08:46.986048+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:46.986048+0000","last_undegraded":"2024-05-09T00:08:46.986048+0000","last_fullsized":"2024-05-09T00:08:46.986048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104435+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:46.104435+0000","last_peered":"2024-05-09T00:08:46.104435+0000","last_clean":"2024-05-09T00:08:46.104435+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:46.104435+0000","last_undegraded":"2024-05-09T00:08:46.104435+0000","last_fullsized":"2024-05-09T00:08:46.104435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987254+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:46.987254+0000","last_peered":"2024-05-09T00:08:46.987254+0000","last_clean":"2024-05-09T00:08:46.987254+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:46.987254+0000","last_undegraded":"2024-05-09T00:08:46.987254+0000","last_fullsized":"2024-05-09T00:08:46.987254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.387002+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:46.387002+0000","last_peered":"2024-05-09T00:08:46.387002+0000","last_clean":"2024-05-09T00:08:46.387002+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:46.387002+0000","last_undegraded":"2024-05-09T00:08:46.387002+0000","last_fullsized":"2024-05-09T00:08:46.387002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386155+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:46.386155+0000","last_peered":"2024-05-09T00:08:46.386155+0000","last_clean":"2024-05-09T00:08:46.386155+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:46.386155+0000","last_undegraded":"2024-05-09T00:08:46.386155+0000","last_fullsized":"2024-05-09T00:08:46.386155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103450+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:46.103450+0000","last_peered":"2024-05-09T00:08:46.103450+0000","last_clean":"2024-05-09T00:08:46.103450+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:46.103450+0000","last_undegraded":"2024-05-09T00:08:46.103450+0000","last_fullsized":"2024-05-09T00:08:46.103450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987128+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:46.987128+0000","last_peered":"2024-05-09T00:08:46.987128+0000","last_clean":"2024-05-09T00:08:46.987128+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:46.987128+0000","last_undegraded":"2024-05-09T00:08:46.987128+0000","last_fullsized":"2024-05-09T00:08:46.987128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987180+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:46.987180+0000","last_peered":"2024-05-09T00:08:46.987180+0000","last_clean":"2024-05-09T00:08:46.987180+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:46.987180+0000","last_undegraded":"2024-05-09T00:08:46.987180+0000","last_fullsized":"2024-05-09T00:08:46.987180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986291+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:46.986291+0000","last_peered":"2024-05-09T00:08:46.986291+0000","last_clean":"2024-05-09T00:08:46.986291+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:46.986291+0000","last_undegraded":"2024-05-09T00:08:46.986291+0000","last_fullsized":"2024-05-09T00:08:46.986291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094811+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:46.094811+0000","last_peered":"2024-05-09T00:08:46.094811+0000","last_clean":"2024-05-09T00:08:46.094811+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:46.094811+0000","last_undegraded":"2024-05-09T00:08:46.094811+0000","last_fullsized":"2024-05-09T00:08:46.094811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103185+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:46.103185+0000","last_peered":"2024-05-09T00:08:46.103185+0000","last_clean":"2024-05-09T00:08:46.103185+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:46.103185+0000","last_undegraded":"2024-05-09T00:08:46.103185+0000","last_fullsized":"2024-05-09T00:08:46.103185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.101355+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:46.101355+0000","last_peered":"2024-05-09T00:08:46.101355+0000","last_clean":"2024-05-09T00:08:46.101355+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:46.101355+0000","last_undegraded":"2024-05-09T00:08:46.101355+0000","last_fullsized":"2024-05-09T00:08:46.101355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987856+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:46.987856+0000","last_peered":"2024-05-09T00:08:46.987856+0000","last_clean":"2024-05-09T00:08:46.987856+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:46.987856+0000","last_undegraded":"2024-05-09T00:08:46.987856+0000","last_fullsized":"2024-05-09T00:08:46.987856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.385405+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:46.385405+0000","last_peered":"2024-05-09T00:08:46.385405+0000","last_clean":"2024-05-09T00:08:46.385405+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:46.385405+0000","last_undegraded":"2024-05-09T00:08:46.385405+0000","last_fullsized":"2024-05-09T00:08:46.385405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100403+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:46.100403+0000","last_peered":"2024-05-09T00:08:46.100403+0000","last_clean":"2024-05-09T00:08:46.100403+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:46.100403+0000","last_undegraded":"2024-05-09T00:08:46.100403+0000","last_fullsized":"2024-05-09T00:08:46.100403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986171+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:46.986171+0000","last_peered":"2024-05-09T00:08:46.986171+0000","last_clean":"2024-05-09T00:08:46.986171+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:46.986171+0000","last_undegraded":"2024-05-09T00:08:46.986171+0000","last_fullsized":"2024-05-09T00:08:46.986171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.099082+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:46.099082+0000","last_peered":"2024-05-09T00:08:46.099082+0000","last_clean":"2024-05-09T00:08:46.099082+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:46.099082+0000","last_undegraded":"2024-05-09T00:08:46.099082+0000","last_fullsized":"2024-05-09T00:08:46.099082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.095493+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:46.095493+0000","last_peered":"2024-05-09T00:08:46.095493+0000","last_clean":"2024-05-09T00:08:46.095493+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:46.095493+0000","last_undegraded":"2024-05-09T00:08:46.095493+0000","last_fullsized":"2024-05-09T00:08:46.095493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987382+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:46.987382+0000","last_peered":"2024-05-09T00:08:46.987382+0000","last_clean":"2024-05-09T00:08:46.987382+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:46.987382+0000","last_undegraded":"2024-05-09T00:08:46.987382+0000","last_fullsized":"2024-05-09T00:08:46.987382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115300+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:46.115300+0000","last_peered":"2024-05-09T00:08:46.115300+0000","last_clean":"2024-05-09T00:08:46.115300+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:46.115300+0000","last_undegraded":"2024-05-09T00:08:46.115300+0000","last_fullsized":"2024-05-09T00:08:46.115300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104784+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:46.104784+0000","last_peered":"2024-05-09T00:08:46.104784+0000","last_clean":"2024-05-09T00:08:46.104784+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:46.104784+0000","last_undegraded":"2024-05-09T00:08:46.104784+0000","last_fullsized":"2024-05-09T00:08:46.104784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987000+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:46.987000+0000","last_peered":"2024-05-09T00:08:46.987000+0000","last_clean":"2024-05-09T00:08:46.987000+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:46.987000+0000","last_undegraded":"2024-05-09T00:08:46.987000+0000","last_fullsized":"2024-05-09T00:08:46.987000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987804+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:46.987804+0000","last_peered":"2024-05-09T00:08:46.987804+0000","last_clean":"2024-05-09T00:08:46.987804+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:46.987804+0000","last_undegraded":"2024-05-09T00:08:46.987804+0000","last_fullsized":"2024-05-09T00:08:46.987804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987493+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:08:46.987493+0000","last_peered":"2024-05-09T00:08:46.987493+0000","last_clean":"2024-05-09T00:08:46.987493+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:08:46.987493+0000","last_undegraded":"2024-05-09T00:08:46.987493+0000","last_fullsized":"2024-05-09T00:08:46.987493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115953+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:46.115953+0000","last_peered":"2024-05-09T00:08:46.115953+0000","last_clean":"2024-05-09T00:08:46.115953+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:46.115953+0000","last_undegraded":"2024-05-09T00:08:46.115953+0000","last_fullsized":"2024-05-09T00:08:46.115953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986764+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:46.986764+0000","last_peered":"2024-05-09T00:08:46.986764+0000","last_clean":"2024-05-09T00:08:46.986764+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:46.986764+0000","last_undegraded":"2024-05-09T00:08:46.986764+0000","last_fullsized":"2024-05-09T00:08:46.986764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386483+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:46.386483+0000","last_peered":"2024-05-09T00:08:46.386483+0000","last_clean":"2024-05-09T00:08:46.386483+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:46.386483+0000","last_undegraded":"2024-05-09T00:08:46.386483+0000","last_fullsized":"2024-05-09T00:08:46.386483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988086+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:46.988086+0000","last_peered":"2024-05-09T00:08:46.988086+0000","last_clean":"2024-05-09T00:08:46.988086+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:46.988086+0000","last_undegraded":"2024-05-09T00:08:46.988086+0000","last_fullsized":"2024-05-09T00:08:46.988086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988578+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:46.988578+0000","last_peered":"2024-05-09T00:08:46.988578+0000","last_clean":"2024-05-09T00:08:46.988578+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:46.988578+0000","last_undegraded":"2024-05-09T00:08:46.988578+0000","last_fullsized":"2024-05-09T00:08:46.988578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114745+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:46.114745+0000","last_peered":"2024-05-09T00:08:46.114745+0000","last_clean":"2024-05-09T00:08:46.114745+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:46.114745+0000","last_undegraded":"2024-05-09T00:08:46.114745+0000","last_fullsized":"2024-05-09T00:08:46.114745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094963+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:46.094963+0000","last_peered":"2024-05-09T00:08:46.094963+0000","last_clean":"2024-05-09T00:08:46.094963+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:46.094963+0000","last_undegraded":"2024-05-09T00:08:46.094963+0000","last_fullsized":"2024-05-09T00:08:46.094963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.098591+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:46.098591+0000","last_peered":"2024-05-09T00:08:46.098591+0000","last_clean":"2024-05-09T00:08:46.098591+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:46.098591+0000","last_undegraded":"2024-05-09T00:08:46.098591+0000","last_fullsized":"2024-05-09T00:08:46.098591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986549+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:46.986549+0000","last_peered":"2024-05-09T00:08:46.986549+0000","last_clean":"2024-05-09T00:08:46.986549+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:46.986549+0000","last_undegraded":"2024-05-09T00:08:46.986549+0000","last_fullsized":"2024-05-09T00:08:46.986549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.116279+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:46.116279+0000","last_peered":"2024-05-09T00:08:46.116279+0000","last_clean":"2024-05-09T00:08:46.116279+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:46.116279+0000","last_undegraded":"2024-05-09T00:08:46.116279+0000","last_fullsized":"2024-05-09T00:08:46.116279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987592+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:46.987592+0000","last_peered":"2024-05-09T00:08:46.987592+0000","last_clean":"2024-05-09T00:08:46.987592+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:46.987592+0000","last_undegraded":"2024-05-09T00:08:46.987592+0000","last_fullsized":"2024-05-09T00:08:46.987592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103753+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:46.103753+0000","last_peered":"2024-05-09T00:08:46.103753+0000","last_clean":"2024-05-09T00:08:46.103753+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:46.103753+0000","last_undegraded":"2024-05-09T00:08:46.103753+0000","last_fullsized":"2024-05-09T00:08:46.103753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115977+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:46.115977+0000","last_peered":"2024-05-09T00:08:46.115977+0000","last_clean":"2024-05-09T00:08:46.115977+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:46.115977+0000","last_undegraded":"2024-05-09T00:08:46.115977+0000","last_fullsized":"2024-05-09T00:08:46.115977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103767+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:46.103767+0000","last_peered":"2024-05-09T00:08:46.103767+0000","last_clean":"2024-05-09T00:08:46.103767+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:46.103767+0000","last_undegraded":"2024-05-09T00:08:46.103767+0000","last_fullsized":"2024-05-09T00:08:46.103767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115744+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:46.115744+0000","last_peered":"2024-05-09T00:08:46.115744+0000","last_clean":"2024-05-09T00:08:46.115744+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:46.115744+0000","last_undegraded":"2024-05-09T00:08:46.115744+0000","last_fullsized":"2024-05-09T00:08:46.115744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386619+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:46.386619+0000","last_peered":"2024-05-09T00:08:46.386619+0000","last_clean":"2024-05-09T00:08:46.386619+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:46.386619+0000","last_undegraded":"2024-05-09T00:08:46.386619+0000","last_fullsized":"2024-05-09T00:08:46.386619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.987423+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:46.987423+0000","last_peered":"2024-05-09T00:08:46.987423+0000","last_clean":"2024-05-09T00:08:46.987423+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:46.987423+0000","last_undegraded":"2024-05-09T00:08:46.987423+0000","last_fullsized":"2024-05-09T00:08:46.987423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.094413+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:46.094413+0000","last_peered":"2024-05-09T00:08:46.094413+0000","last_clean":"2024-05-09T00:08:46.094413+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:46.094413+0000","last_undegraded":"2024-05-09T00:08:46.094413+0000","last_fullsized":"2024-05-09T00:08:46.094413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988343+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:46.988343+0000","last_peered":"2024-05-09T00:08:46.988343+0000","last_clean":"2024-05-09T00:08:46.988343+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:46.988343+0000","last_undegraded":"2024-05-09T00:08:46.988343+0000","last_fullsized":"2024-05-09T00:08:46.988343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.102471+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:46.102471+0000","last_peered":"2024-05-09T00:08:46.102471+0000","last_clean":"2024-05-09T00:08:46.102471+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:46.102471+0000","last_undegraded":"2024-05-09T00:08:46.102471+0000","last_fullsized":"2024-05-09T00:08:46.102471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986235+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:46.986235+0000","last_peered":"2024-05-09T00:08:46.986235+0000","last_clean":"2024-05-09T00:08:46.986235+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:46.986235+0000","last_undegraded":"2024-05-09T00:08:46.986235+0000","last_fullsized":"2024-05-09T00:08:46.986235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.385779+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:46.385779+0000","last_peered":"2024-05-09T00:08:46.385779+0000","last_clean":"2024-05-09T00:08:46.385779+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:46.385779+0000","last_undegraded":"2024-05-09T00:08:46.385779+0000","last_fullsized":"2024-05-09T00:08:46.385779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986452+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:46.986452+0000","last_peered":"2024-05-09T00:08:46.986452+0000","last_clean":"2024-05-09T00:08:46.986452+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:46.986452+0000","last_undegraded":"2024-05-09T00:08:46.986452+0000","last_fullsized":"2024-05-09T00:08:46.986452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100160+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:46.100160+0000","last_peered":"2024-05-09T00:08:46.100160+0000","last_clean":"2024-05-09T00:08:46.100160+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:46.100160+0000","last_undegraded":"2024-05-09T00:08:46.100160+0000","last_fullsized":"2024-05-09T00:08:46.100160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988289+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:46.988289+0000","last_peered":"2024-05-09T00:08:46.988289+0000","last_clean":"2024-05-09T00:08:46.988289+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:46.988289+0000","last_undegraded":"2024-05-09T00:08:46.988289+0000","last_fullsized":"2024-05-09T00:08:46.988289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114884+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:46.114884+0000","last_peered":"2024-05-09T00:08:46.114884+0000","last_clean":"2024-05-09T00:08:46.114884+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:46.114884+0000","last_undegraded":"2024-05-09T00:08:46.114884+0000","last_fullsized":"2024-05-09T00:08:46.114884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103632+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:46.103632+0000","last_peered":"2024-05-09T00:08:46.103632+0000","last_clean":"2024-05-09T00:08:46.103632+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:46.103632+0000","last_undegraded":"2024-05-09T00:08:46.103632+0000","last_fullsized":"2024-05-09T00:08:46.103632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986408+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:46.986408+0000","last_peered":"2024-05-09T00:08:46.986408+0000","last_clean":"2024-05-09T00:08:46.986408+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:46.986408+0000","last_undegraded":"2024-05-09T00:08:46.986408+0000","last_fullsized":"2024-05-09T00:08:46.986408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988267+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:46.988267+0000","last_peered":"2024-05-09T00:08:46.988267+0000","last_clean":"2024-05-09T00:08:46.988267+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:46.988267+0000","last_undegraded":"2024-05-09T00:08:46.988267+0000","last_fullsized":"2024-05-09T00:08:46.988267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386596+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:46.386596+0000","last_peered":"2024-05-09T00:08:46.386596+0000","last_clean":"2024-05-09T00:08:46.386596+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:46.386596+0000","last_undegraded":"2024-05-09T00:08:46.386596+0000","last_fullsized":"2024-05-09T00:08:46.386596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.113024+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:46.113024+0000","last_peered":"2024-05-09T00:08:46.113024+0000","last_clean":"2024-05-09T00:08:46.113024+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:46.113024+0000","last_undegraded":"2024-05-09T00:08:46.113024+0000","last_fullsized":"2024-05-09T00:08:46.113024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104328+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:46.104328+0000","last_peered":"2024-05-09T00:08:46.104328+0000","last_clean":"2024-05-09T00:08:46.104328+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:46.104328+0000","last_undegraded":"2024-05-09T00:08:46.104328+0000","last_fullsized":"2024-05-09T00:08:46.104328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988234+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:46.988234+0000","last_peered":"2024-05-09T00:08:46.988234+0000","last_clean":"2024-05-09T00:08:46.988234+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:46.988234+0000","last_undegraded":"2024-05-09T00:08:46.988234+0000","last_fullsized":"2024-05-09T00:08:46.988234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.103475+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:46.103475+0000","last_peered":"2024-05-09T00:08:46.103475+0000","last_clean":"2024-05-09T00:08:46.103475+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:46.103475+0000","last_undegraded":"2024-05-09T00:08:46.103475+0000","last_fullsized":"2024-05-09T00:08:46.103475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.114351+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:46.114351+0000","last_peered":"2024-05-09T00:08:46.114351+0000","last_clean":"2024-05-09T00:08:46.114351+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:46.114351+0000","last_undegraded":"2024-05-09T00:08:46.114351+0000","last_fullsized":"2024-05-09T00:08:46.114351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986667+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:46.986667+0000","last_peered":"2024-05-09T00:08:46.986667+0000","last_clean":"2024-05-09T00:08:46.986667+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:46.986667+0000","last_undegraded":"2024-05-09T00:08:46.986667+0000","last_fullsized":"2024-05-09T00:08:46.986667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.100870+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:46.100870+0000","last_peered":"2024-05-09T00:08:46.100870+0000","last_clean":"2024-05-09T00:08:46.100870+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:46.100870+0000","last_undegraded":"2024-05-09T00:08:46.100870+0000","last_fullsized":"2024-05-09T00:08:46.100870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.098760+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:46.098760+0000","last_peered":"2024-05-09T00:08:46.098760+0000","last_clean":"2024-05-09T00:08:46.098760+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:46.098760+0000","last_undegraded":"2024-05-09T00:08:46.098760+0000","last_fullsized":"2024-05-09T00:08:46.098760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.386319+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:46.386319+0000","last_peered":"2024-05-09T00:08:46.386319+0000","last_clean":"2024-05-09T00:08:46.386319+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:46.386319+0000","last_undegraded":"2024-05-09T00:08:46.386319+0000","last_fullsized":"2024-05-09T00:08:46.386319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.986929+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:46.986929+0000","last_peered":"2024-05-09T00:08:46.986929+0000","last_clean":"2024-05-09T00:08:46.986929+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:46.986929+0000","last_undegraded":"2024-05-09T00:08:46.986929+0000","last_fullsized":"2024-05-09T00:08:46.986929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988066+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:46.988066+0000","last_peered":"2024-05-09T00:08:46.988066+0000","last_clean":"2024-05-09T00:08:46.988066+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:46.988066+0000","last_undegraded":"2024-05-09T00:08:46.988066+0000","last_fullsized":"2024-05-09T00:08:46.988066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988509+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:46.988509+0000","last_peered":"2024-05-09T00:08:46.988509+0000","last_clean":"2024-05-09T00:08:46.988509+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:46.988509+0000","last_undegraded":"2024-05-09T00:08:46.988509+0000","last_fullsized":"2024-05-09T00:08:46.988509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.988570+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:46.988570+0000","last_peered":"2024-05-09T00:08:46.988570+0000","last_clean":"2024-05-09T00:08:46.988570+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:46.988570+0000","last_undegraded":"2024-05-09T00:08:46.988570+0000","last_fullsized":"2024-05-09T00:08:46.988570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115929+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:46.115929+0000","last_peered":"2024-05-09T00:08:46.115929+0000","last_clean":"2024-05-09T00:08:46.115929+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:46.115929+0000","last_undegraded":"2024-05-09T00:08:46.115929+0000","last_fullsized":"2024-05-09T00:08:46.115929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.095930+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:46.095930+0000","last_peered":"2024-05-09T00:08:46.095930+0000","last_clean":"2024-05-09T00:08:46.095930+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:46.095930+0000","last_undegraded":"2024-05-09T00:08:46.095930+0000","last_fullsized":"2024-05-09T00:08:46.095930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.115292+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:46.115292+0000","last_peered":"2024-05-09T00:08:46.115292+0000","last_clean":"2024-05-09T00:08:46.115292+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:46.115292+0000","last_undegraded":"2024-05-09T00:08:46.115292+0000","last_fullsized":"2024-05-09T00:08:46.115292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104902+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:46.104902+0000","last_peered":"2024-05-09T00:08:46.104902+0000","last_clean":"2024-05-09T00:08:46.104902+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:46.104902+0000","last_undegraded":"2024-05-09T00:08:46.104902+0000","last_fullsized":"2024-05-09T00:08:46.104902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104984+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:46.104984+0000","last_peered":"2024-05-09T00:08:46.104984+0000","last_clean":"2024-05-09T00:08:46.104984+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:46.104984+0000","last_undegraded":"2024-05-09T00:08:46.104984+0000","last_fullsized":"2024-05-09T00:08:46.104984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104813+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:46.104813+0000","last_peered":"2024-05-09T00:08:46.104813+0000","last_clean":"2024-05-09T00:08:46.104813+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:46.104813+0000","last_undegraded":"2024-05-09T00:08:46.104813+0000","last_fullsized":"2024-05-09T00:08:46.104813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T00:08:46.104869+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:46.104869+0000","last_peered":"2024-05-09T00:08:46.104869+0000","last_clean":"2024-05-09T00:08:46.104869+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:46.104869+0000","last_undegraded":"2024-05-09T00:08:46.104869+0000","last_fullsized":"2024-05-09T00:08:46.104869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":78488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:08:51.342 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T00:08:51.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T00:08:51.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.651+0000 7f3acea00640 1 Processor -- start 2024-05-09T00:08:51.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.651+0000 7f3acea00640 1 -- start start 2024-05-09T00:08:51.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3acea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ac8072720 0x7f3ac80c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3acea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ac81585c0 0x7f3ac81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3acea00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac8074040 con 0x7f3ac8073800 2024-05-09T00:08:51.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3acea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac8073df0 con 0x7f3ac8072720 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3acea00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac80c5f40 con 0x7f3ac81585c0 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3abfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ac8072720 0x7f3ac80c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.653+0000 7f3abfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ac8072720 0x7f3ac80c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56766/0 (socket says 172.21.15.114:56766) 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.654+0000 7f3abfe00640 1 -- 172.21.15.114:0/1302614955 learned_addr learned my addr 172.21.15.114:0/1302614955 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.654+0000 7f3abfe00640 1 -- 172.21.15.114:0/1302614955 >> v2:172.21.15.153:3300/0 conn(0x7f3ac81585c0 msgr2=0x7f3ac81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.654+0000 7f3abfe00640 1 --2- 172.21.15.114:0/1302614955 >> v2:172.21.15.153:3300/0 conn(0x7f3ac81585c0 0x7f3ac81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.654+0000 7f3abfe00640 1 -- 172.21.15.114:0/1302614955 >> v1:172.21.15.153:6789/0 conn(0x7f3ac8073800 legacy=0x7f3ac80c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.654+0000 7f3abfe00640 1 -- 172.21.15.114:0/1302614955 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac80c58f0 con 0x7f3ac8072720 2024-05-09T00:08:51.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.655+0000 7f3abfe00640 1 --2- 172.21.15.114:0/1302614955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac8072720 0x7f3ac80c63d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ac806d740 tx=0x7f3ab002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52ba69894e0e832 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.655+0000 7f3ac7400640 1 -- 172.21.15.114:0/1302614955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0037070 con 0x7f3ac8072720 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.655+0000 7f3ac7400640 1 -- 172.21.15.114:0/1302614955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab0032440 con 0x7f3ac8072720 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.655+0000 7f3ac7400640 1 -- 172.21.15.114:0/1302614955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0032810 con 0x7f3ac8072720 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 -- 172.21.15.114:0/1302614955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac8072720 msgr2=0x7f3ac80c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 --2- 172.21.15.114:0/1302614955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac8072720 0x7f3ac80c63d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ac806d740 tx=0x7f3ab002a1e0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 -- 172.21.15.114:0/1302614955 shutdown_connections 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 --2- 172.21.15.114:0/1302614955 >> v2:172.21.15.153:3300/0 conn(0x7f3ac81585c0 0x7f3ac81589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 --2- 172.21.15.114:0/1302614955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac8072720 0x7f3ac80c63d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 -- 172.21.15.114:0/1302614955 >> 172.21.15.114:0/1302614955 conn(0x7f3ac806c680 msgr2=0x7f3ac806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 -- 172.21.15.114:0/1302614955 shutdown_connections 2024-05-09T00:08:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.656+0000 7f3acea00640 1 -- 172.21.15.114:0/1302614955 wait complete. 2024-05-09T00:08:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.658+0000 7f3acea00640 1 Processor -- start 2024-05-09T00:08:51.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.658+0000 7f3acea00640 1 -- start start 2024-05-09T00:08:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ac8072720 0x7f3ac81ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac8073800 0x7f3ac8142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 0x7f3ac8143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8074320 con 0x7f3ac81585c0 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8072b30 con 0x7f3ac8073800 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac8143a50 con 0x7f3ac8072720 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 0x7f3ac8143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 0x7f3ac8143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56782/0 (socket says 172.21.15.114:56782) 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 -- 172.21.15.114:0/3129281322 learned_addr learned my addr 172.21.15.114:0/3129281322 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 -- 172.21.15.114:0/3129281322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ac8072720 msgr2=0x7f3ac81ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ac8072720 0x7f3ac81ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 -- 172.21.15.114:0/3129281322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac8073800 msgr2=0x7f3ac8142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac8073800 0x7f3ac8142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 -- 172.21.15.114:0/3129281322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac814fc60 con 0x7f3ac81585c0 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.660+0000 7f3acca00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 0x7f3ac8143510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000b970 tx=0x7f3ac000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.661+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0019070 con 0x7f3ac81585c0 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.661+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac000cb60 con 0x7f3ac81585c0 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.661+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac814ff40 con 0x7f3ac81585c0 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.661+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0014440 con 0x7f3ac81585c0 2024-05-09T00:08:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.661+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac81edbf0 con 0x7f3ac81585c0 2024-05-09T00:08:51.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.662+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac8077430 con 0x7f3ac81585c0 2024-05-09T00:08:51.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.663+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ac001c070 con 0x7f3ac81585c0 2024-05-09T00:08:51.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.664+0000 7f3ac4c00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3aa4076300 0x7f3aa4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:51.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.664+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f3ac0097370 con 0x7f3ac81585c0 2024-05-09T00:08:51.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.665+0000 7f3ac7e00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3aa4076300 0x7f3aa4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:51.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.665+0000 7f3ac7e00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3aa4076300 0x7f3aa4078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009650 tx=0x7f3ab8006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:51.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.669+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ac0060c40 con 0x7f3ac81585c0 2024-05-09T00:08:51.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.861+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ac8150110 con 0x7f3ac81585c0 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.862+0000 7f3ac4c00640 1 -- 172.21.15.114:0/3129281322 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) ==== 84+0+197 (secure 0 0 0) 0x7f3ac0060540 con 0x7f3ac81585c0 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-05-09T00:08:51.858 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 2, 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "a_metadata" 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 3, 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "a_data" 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-05-09T00:08:51.859 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-05-09T00:08:51.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3aa4076300 msgr2=0x7f3aa4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3aa4076300 0x7f3aa4078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009650 tx=0x7f3ab8006ba0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 msgr2=0x7f3ac8143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 0x7f3ac8143510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000b970 tx=0x7f3ac000be30 comp rx=0 tx=0).stop 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 shutdown_connections 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3aa4076300 0x7f3aa4078810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ac81585c0 0x7f3ac8143510 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac8073800 0x7f3ac8142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 --2- 172.21.15.114:0/3129281322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ac8072720 0x7f3ac81ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 >> 172.21.15.114:0/3129281322 conn(0x7f3ac806c680 msgr2=0x7f3ac8153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 shutdown_connections 2024-05-09T00:08:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:51.865+0000 7f3acea00640 1 -- 172.21.15.114:0/3129281322 wait complete. 2024-05-09T00:08:51.885 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-05-09T00:08:51.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-05-09T00:08:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.167+0000 7fdb08400640 1 Processor -- start 2024-05-09T00:08:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.167+0000 7fdb08400640 1 -- start start 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.169+0000 7fdb08400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb000ac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.169+0000 7fdb08400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb00156910 0x7fdb00153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.169+0000 7fdb08400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb000ae8f0 0x7fdb000aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.169+0000 7fdb08400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdb00153980 con 0x7fdb000ae8f0 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.169+0000 7fdb08400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0006ecf0 con 0x7fdb00156910 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.169+0000 7fdb08400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb00070270 con 0x7fdb0006f770 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb000ae8f0 0x7fdb000aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb000ae8f0 0x7fdb000aed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56796/0 (socket says 172.21.15.114:56796) 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 -- 172.21.15.114:0/3758846553 learned_addr learned my addr 172.21.15.114:0/3758846553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb05a00640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb000ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb05000640 1 --2- 172.21.15.114:0/3758846553 >> v2:172.21.15.153:3300/0 conn(0x7fdb00156910 0x7fdb00153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 -- 172.21.15.114:0/3758846553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 msgr2=0x7fdb000ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb000ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 -- 172.21.15.114:0/3758846553 >> v2:172.21.15.153:3300/0 conn(0x7fdb00156910 msgr2=0x7fdb00153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 --2- 172.21.15.114:0/3758846553 >> v2:172.21.15.153:3300/0 conn(0x7fdb00156910 0x7fdb00153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb06400640 1 -- 172.21.15.114:0/3758846553 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0006ff90 con 0x7fdb000ae8f0 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb05a00640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb000ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.170+0000 7fdb05000640 1 --2- 172.21.15.114:0/3758846553 >> v2:172.21.15.153:3300/0 conn(0x7fdb00156910 0x7fdb00153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.171+0000 7fdb06400640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb000ae8f0 0x7fdb000aed00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdb000c5d30 tx=0x7fdaf802a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b1f71fb4e72a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.171+0000 7fdaffe00640 1 -- 172.21.15.114:0/3758846553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8036070 con 0x7fdb000ae8f0 2024-05-09T00:08:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.171+0000 7fdaffe00640 1 -- 172.21.15.114:0/3758846553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf8031600 con 0x7fdb000ae8f0 2024-05-09T00:08:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.171+0000 7fdaffe00640 1 -- 172.21.15.114:0/3758846553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80319d0 con 0x7fdb000ae8f0 2024-05-09T00:08:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 -- 172.21.15.114:0/3758846553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb000ae8f0 msgr2=0x7fdb000aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb000ae8f0 0x7fdb000aed00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdb000c5d30 tx=0x7fdaf802a690 comp rx=0 tx=0).stop 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 -- 172.21.15.114:0/3758846553 shutdown_connections 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb000ae8f0 0x7fdb000aed00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 --2- 172.21.15.114:0/3758846553 >> v2:172.21.15.153:3300/0 conn(0x7fdb00156910 0x7fdb00153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 --2- 172.21.15.114:0/3758846553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb000ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 -- 172.21.15.114:0/3758846553 >> 172.21.15.114:0/3758846553 conn(0x7fdb0006ca70 msgr2=0x7fdb0006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.172+0000 7fdb08400640 1 -- 172.21.15.114:0/3758846553 shutdown_connections 2024-05-09T00:08:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.173+0000 7fdb08400640 1 -- 172.21.15.114:0/3758846553 wait complete. 2024-05-09T00:08:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.175+0000 7fdb08400640 1 Processor -- start 2024-05-09T00:08:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.175+0000 7fdb08400640 1 -- start start 2024-05-09T00:08:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb08400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb001e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb08400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb000ae8f0 0x7fdb00154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb08400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 0x7fdb001e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb08400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0006ef40 con 0x7fdb00156910 2024-05-09T00:08:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb08400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb000af710 con 0x7fdb000ae8f0 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb08400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb000706e0 con 0x7fdb0006f770 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb06400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 0x7fdb001e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb06400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 0x7fdb001e34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56802/0 (socket says 172.21.15.114:56802) 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.177+0000 7fdb06400640 1 -- 172.21.15.114:0/1061799825 learned_addr learned my addr 172.21.15.114:0/1061799825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb05a00640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb001e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb05000640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb000ae8f0 0x7fdb00154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb06400640 1 -- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 msgr2=0x7fdb001e1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb06400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb001e1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb06400640 1 -- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb000ae8f0 msgr2=0x7fdb00154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb06400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb000ae8f0 0x7fdb00154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb06400640 1 -- 172.21.15.114:0/1061799825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00153d40 con 0x7fdb00156910 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb05a00640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb001e1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb05000640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb000ae8f0 0x7fdb00154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb06400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 0x7fdb001e34c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009f40 tx=0x7fdaf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8036050 con 0x7fdb00156910 2024-05-09T00:08:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf8042070 con 0x7fdb00156910 2024-05-09T00:08:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8009510 con 0x7fdb00156910 2024-05-09T00:08:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.178+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0014e480 con 0x7fdb00156910 2024-05-09T00:08:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.179+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0014e720 con 0x7fdb00156910 2024-05-09T00:08:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.180+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb00077430 con 0x7fdb00156910 2024-05-09T00:08:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.181+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdaf8007bd0 con 0x7fdb00156910 2024-05-09T00:08:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.182+0000 7fdafd600640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdae0076300 0x7fdae0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.182+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fdaf80b85d0 con 0x7fdb00156910 2024-05-09T00:08:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.182+0000 7fdb05a00640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdae0076300 0x7fdae0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:52.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.183+0000 7fdb05a00640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdae0076300 0x7fdae0078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4006fd0 tx=0x7fdaf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.187+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdaf8081f30 con 0x7fdb00156910 2024-05-09T00:08:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:52.392+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7fdb0006ead0 con 0x7fdb00156910 2024-05-09T00:08:53.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.161+0000 7fdafd600640 1 -- 172.21.15.114:0/1061799825 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v23) ==== 128+0+0 (secure 0 0 0) 0x7fdaf8081830 con 0x7fdb00156910 2024-05-09T00:08:53.157 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'b_metadata' created 2024-05-09T00:08:53.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdae0076300 msgr2=0x7fdae0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:53.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdae0076300 0x7fdae0078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4006fd0 tx=0x7fdaf4008040 comp rx=0 tx=0).stop 2024-05-09T00:08:53.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 msgr2=0x7fdb001e34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:53.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 0x7fdb001e34c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009f40 tx=0x7fdaf8004a40 comp rx=0 tx=0).stop 2024-05-09T00:08:53.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 shutdown_connections 2024-05-09T00:08:53.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdae0076300 0x7fdae0078810 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4006fd0 tx=0x7fdaf4008040 comp rx=0 tx=0).stop 2024-05-09T00:08:53.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb00156910 0x7fdb001e34c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb000ae8f0 0x7fdb00154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 --2- 172.21.15.114:0/1061799825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb0006f770 0x7fdb001e1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.166+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 >> 172.21.15.114:0/1061799825 conn(0x7fdb0006ca70 msgr2=0x7fdb000aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:53.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.167+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 shutdown_connections 2024-05-09T00:08:53.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.167+0000 7fdb08400640 1 -- 172.21.15.114:0/1061799825 wait complete. 2024-05-09T00:08:53.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T00:08:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.459+0000 7f45d7000640 1 Processor -- start 2024-05-09T00:08:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.459+0000 7f45d7000640 1 -- start start 2024-05-09T00:08:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d7000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d006d820 0x7f45d006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d7000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45d0155890 0x7f45d00cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d7000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45d00cc970 0x7f45d00c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d7000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f45d015c530 con 0x7f45d0155890 2024-05-09T00:08:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d7000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f45d008f130 con 0x7f45d00cc970 2024-05-09T00:08:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d7000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f45d015c1c0 con 0x7f45d006d820 2024-05-09T00:08:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45d0155890 0x7f45d00cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45d0155890 0x7f45d00cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56810/0 (socket says 172.21.15.114:56810) 2024-05-09T00:08:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 -- 172.21.15.114:0/1580075409 learned_addr learned my addr 172.21.15.114:0/1580075409 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d6600640 1 --2- 172.21.15.114:0/1580075409 >> v2:172.21.15.153:3300/0 conn(0x7f45d00cc970 0x7f45d00c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5c00640 1 --2- 172.21.15.114:0/1580075409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d006d820 0x7f45d006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 -- 172.21.15.114:0/1580075409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d006d820 msgr2=0x7f45d006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 --2- 172.21.15.114:0/1580075409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d006d820 0x7f45d006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 -- 172.21.15.114:0/1580075409 >> v2:172.21.15.153:3300/0 conn(0x7f45d00cc970 msgr2=0x7f45d00c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 --2- 172.21.15.114:0/1580075409 >> v2:172.21.15.153:3300/0 conn(0x7f45d00cc970 0x7f45d00c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.461+0000 7f45d5200640 1 -- 172.21.15.114:0/1580075409 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d00afbe0 con 0x7f45d0155890 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.462+0000 7f45d6600640 1 --2- 172.21.15.114:0/1580075409 >> v2:172.21.15.153:3300/0 conn(0x7f45d00cc970 0x7f45d00c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.462+0000 7f45d5200640 1 --2- 172.21.15.114:0/1580075409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d0155890 0x7f45d00cc430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45d008f630 tx=0x7f45bc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59c1c4ee1a069e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:53.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.463+0000 7f45cfe00640 1 -- 172.21.15.114:0/1580075409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc036070 con 0x7f45d0155890 2024-05-09T00:08:53.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.463+0000 7f45cfe00640 1 -- 172.21.15.114:0/1580075409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc031600 con 0x7f45d0155890 2024-05-09T00:08:53.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.463+0000 7f45cfe00640 1 -- 172.21.15.114:0/1580075409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0319d0 con 0x7f45d0155890 2024-05-09T00:08:53.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.463+0000 7f45d7000640 1 -- 172.21.15.114:0/1580075409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d0155890 msgr2=0x7f45d00cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:53.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.463+0000 7f45d7000640 1 --2- 172.21.15.114:0/1580075409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d0155890 0x7f45d00cc430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45d008f630 tx=0x7f45bc02a610 comp rx=0 tx=0).stop 2024-05-09T00:08:53.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 -- 172.21.15.114:0/1580075409 shutdown_connections 2024-05-09T00:08:53.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 --2- 172.21.15.114:0/1580075409 >> v2:172.21.15.153:3300/0 conn(0x7f45d00cc970 0x7f45d00c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 --2- 172.21.15.114:0/1580075409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d0155890 0x7f45d00cc430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 --2- 172.21.15.114:0/1580075409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d006d820 0x7f45d006df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 -- 172.21.15.114:0/1580075409 >> 172.21.15.114:0/1580075409 conn(0x7f45d00ca5d0 msgr2=0x7f45d00af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:53.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 -- 172.21.15.114:0/1580075409 shutdown_connections 2024-05-09T00:08:53.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.464+0000 7f45d7000640 1 -- 172.21.15.114:0/1580075409 wait complete. 2024-05-09T00:08:53.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.466+0000 7f45d7000640 1 Processor -- start 2024-05-09T00:08:53.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.466+0000 7f45d7000640 1 -- start start 2024-05-09T00:08:53.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.467+0000 7f45d7000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45d006d820 0x7f45d00c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.467+0000 7f45d7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 0x7f45d01f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.467+0000 7f45d7000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d0155890 0x7f45d01f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.467+0000 7f45d7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f45d006d1f0 con 0x7f45d00cc970 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.467+0000 7f45d7000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00c8630 con 0x7f45d006d820 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.467+0000 7f45d7000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f45d006d370 con 0x7f45d0155890 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 0x7f45d01f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 0x7f45d01f1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56822/0 (socket says 172.21.15.114:56822) 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 -- 172.21.15.114:0/2096506633 learned_addr learned my addr 172.21.15.114:0/2096506633 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5c00640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45d006d820 0x7f45d00c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d6600640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d0155890 0x7f45d01f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 -- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d0155890 msgr2=0x7f45d01f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d0155890 0x7f45d01f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 -- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45d006d820 msgr2=0x7f45d00c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45d006d820 0x7f45d00c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 -- 172.21.15.114:0/2096506633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d0157b10 con 0x7f45d00cc970 2024-05-09T00:08:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d6600640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d0155890 0x7f45d01f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:53.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.468+0000 7f45d5200640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 0x7f45d01f1650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45bc034040 tx=0x7f45bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:53.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.469+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc03f020 con 0x7f45d00cc970 2024-05-09T00:08:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.469+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc037040 con 0x7f45d00cc970 2024-05-09T00:08:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.469+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc036070 con 0x7f45d00cc970 2024-05-09T00:08:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.469+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d0157df0 con 0x7f45d00cc970 2024-05-09T00:08:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.469+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d0152530 con 0x7f45d00cc970 2024-05-09T00:08:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.470+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d00784d0 con 0x7f45d00cc970 2024-05-09T00:08:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.471+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45bc042020 con 0x7f45d00cc970 2024-05-09T00:08:53.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.472+0000 7f45cd600640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45b0076300 0x7f45b0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:53.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.472+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6054+0+0 (secure 0 0 0) 0x7f45bc0b81e0 con 0x7f45d00cc970 2024-05-09T00:08:53.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.472+0000 7f45d5c00640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45b0076300 0x7f45b0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:53.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.473+0000 7f45d5c00640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45b0076300 0x7f45b0078810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45c0006fd0 tx=0x7f45c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.476+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45bc049030 con 0x7f45d00cc970 2024-05-09T00:08:53.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:53.679+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f45d00af9c0 con 0x7f45d00cc970 2024-05-09T00:08:54.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.179+0000 7f45cd600640 1 -- 172.21.15.114:0/2096506633 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v24) ==== 160+0+0 (secure 0 0 0) 0x7f45bc0819c0 con 0x7f45d00cc970 2024-05-09T00:08:54.175 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'b_data' created 2024-05-09T00:08:54.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45b0076300 msgr2=0x7f45b0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45b0076300 0x7f45b0078810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45c0006fd0 tx=0x7f45c0008040 comp rx=0 tx=0).stop 2024-05-09T00:08:54.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 msgr2=0x7f45d01f1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 0x7f45d01f1650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45bc034040 tx=0x7f45bc004a40 comp rx=0 tx=0).stop 2024-05-09T00:08:54.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 shutdown_connections 2024-05-09T00:08:54.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45b0076300 0x7f45b0078810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45d0155890 0x7f45d01f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45d00cc970 0x7f45d01f1650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 --2- 172.21.15.114:0/2096506633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45d006d820 0x7f45d00c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 >> 172.21.15.114:0/2096506633 conn(0x7f45d00ca5d0 msgr2=0x7f45d00ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 shutdown_connections 2024-05-09T00:08:54.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.184+0000 7f45d7000640 1 -- 172.21.15.114:0/2096506633 wait complete. 2024-05-09T00:08:54.225 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-05-09T00:08:54.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.478+0000 7f123de00640 1 Processor -- start 2024-05-09T00:08:54.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.478+0000 7f123de00640 1 -- start start 2024-05-09T00:08:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f123de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1238159170 0x7f12380b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f123de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 0x7f12380cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f123de00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12380c8a50 con 0x7f12380ce360 2024-05-09T00:08:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f123de00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f123815c770 con 0x7f1238159170 2024-05-09T00:08:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f123de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12380c8d30 con 0x7f123815c360 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f1237400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f12380ce360 0x7f12380cc2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40564/0 (socket says 172.21.15.114:40564) 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f1237400640 1 -- 172.21.15.114:0/3385194254 learned_addr learned my addr 172.21.15.114:0/3385194254 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f1236a00640 1 --2- 172.21.15.114:0/3385194254 >> v2:172.21.15.153:3300/0 conn(0x7f1238159170 0x7f12380b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.480+0000 7f122fe00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 0x7f12380cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291948375 0 0) 0x7f12380c8a50 con 0x7f12380ce360 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1218003520 con 0x7f12380ce360 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 352725029 0 0) 0x7f1218003520 con 0x7f12380ce360 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 msgr2=0x7f12380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 0x7f12380cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 >> v2:172.21.15.153:3300/0 conn(0x7f1238159170 msgr2=0x7f12380b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 --2- 172.21.15.114:0/3385194254 >> v2:172.21.15.153:3300/0 conn(0x7f1238159170 0x7f12380b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12380cbad0 con 0x7f12380ce360 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f1230001a70 con 0x7f12380ce360 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 >> v1:172.21.15.114:6789/0 conn(0x7f12380ce360 legacy=0x7f12380cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1218003a00 0x7f1218003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 0x7f1218004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218004d40 0x7f1218005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f123815c770 con 0x7f1218003a00 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12380c8d30 con 0x7f1218004d40 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.481+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f121800bbd0 con 0x7f123815c360 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f1236a00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1218003a00 0x7f1218003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f122fe00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 0x7f1218004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f1236a00640 1 -- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 msgr2=0x7f1218004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f1236a00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815c360 0x7f1218004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f1236a00640 1 -- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218004d40 msgr2=0x7f1218005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f1236a00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218004d40 0x7f1218005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.482+0000 7f1236a00640 1 -- 172.21.15.114:0/3385194254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218003520 con 0x7f1218003a00 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.483+0000 7f1236a00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1218003a00 0x7f1218003e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f123808ec20 tx=0x7f1218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5ef9220cf3383d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228036070 con 0x7f1218003a00 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1228031400 con 0x7f1218003a00 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f1236000640 1 -- 172.21.15.114:0/3385194254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228009690 con 0x7f1218003a00 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f123de00640 1 -- 172.21.15.114:0/3385194254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1218003a00 msgr2=0x7f1218003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f123de00640 1 --2- 172.21.15.114:0/3385194254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1218003a00 0x7f1218003e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f123808ec20 tx=0x7f1218005830 comp rx=0 tx=0).stop 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f1237400640 1 -- 172.21.15.114:0/3385194254 reap_dead start 2024-05-09T00:08:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f123de00640 1 -- 172.21.15.114:0/3385194254 shutdown_connections 2024-05-09T00:08:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.484+0000 7f123de00640 1 -- 172.21.15.114:0/3385194254 >> 172.21.15.114:0/3385194254 conn(0x7f12380af930 msgr2=0x7f12380cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.485+0000 7f123de00640 1 -- 172.21.15.114:0/3385194254 shutdown_connections 2024-05-09T00:08:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.485+0000 7f123de00640 1 -- 172.21.15.114:0/3385194254 wait complete. 2024-05-09T00:08:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.487+0000 7f123de00640 1 Processor -- start 2024-05-09T00:08:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.487+0000 7f123de00640 1 -- start start 2024-05-09T00:08:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.488+0000 7f123de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218003a00 0x7f12381f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.488+0000 7f123de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 0x7f123815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.488+0000 7f123de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815a990 0x7f1238157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.488+0000 7f123de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f12380c9fb0 con 0x7f123814b870 2024-05-09T00:08:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.488+0000 7f123de00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12380c9e30 con 0x7f1218003a00 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.488+0000 7f123de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12380cde20 con 0x7f123815a990 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 0x7f123815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 0x7f123815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56840/0 (socket says 172.21.15.114:56840) 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 -- 172.21.15.114:0/888891222 learned_addr learned my addr 172.21.15.114:0/888891222 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f1236a00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218003a00 0x7f12381f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f1237400640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815a990 0x7f1238157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 -- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815a990 msgr2=0x7f1238157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815a990 0x7f1238157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 -- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218003a00 msgr2=0x7f12381f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218003a00 0x7f12381f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 -- 172.21.15.114:0/888891222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12381557f0 con 0x7f123814b870 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f1237400640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815a990 0x7f1238157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.489+0000 7f122fe00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 0x7f123815a450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1220010890 tx=0x7f1220010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.490+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000f040 con 0x7f123814b870 2024-05-09T00:08:54.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.490+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122000eb60 con 0x7f123814b870 2024-05-09T00:08:54.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.490+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122001c400 con 0x7f123814b870 2024-05-09T00:08:54.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.490+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123815bd60 con 0x7f123814b870 2024-05-09T00:08:54.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.490+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381f2550 con 0x7f123814b870 2024-05-09T00:08:54.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.491+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1238077430 con 0x7f123814b870 2024-05-09T00:08:54.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.492+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f122001c5a0 con 0x7f123814b870 2024-05-09T00:08:54.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.493+0000 7f122f400640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1214076300 0x7f1214078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.494+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6431+0+0 (secure 0 0 0) 0x7f12200981f0 con 0x7f123814b870 2024-05-09T00:08:54.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.494+0000 7f1236a00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1214076300 0x7f1214078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.494+0000 7f1236a00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1214076300 0x7f1214078810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1228033000 tx=0x7f1228008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.498+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1220018030 con 0x7f123814b870 2024-05-09T00:08:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:54.744+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f12380ce140 con 0x7f123814b870 2024-05-09T00:08:55.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.184+0000 7f122f400640 1 -- 172.21.15.114:0/888891222 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) ==== 157+0+0 (secure 0 0 0) 0x7f12200618f0 con 0x7f123814b870 2024-05-09T00:08:55.180 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 4 and data pool 5 2024-05-09T00:08:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1214076300 msgr2=0x7f1214078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1214076300 0x7f1214078810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1228033000 tx=0x7f1228008030 comp rx=0 tx=0).stop 2024-05-09T00:08:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 msgr2=0x7f123815a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 0x7f123815a450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1220010890 tx=0x7f1220010d50 comp rx=0 tx=0).stop 2024-05-09T00:08:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 shutdown_connections 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1214076300 0x7f1214078810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f123815a990 0x7f1238157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f123814b870 0x7f123815a450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 --2- 172.21.15.114:0/888891222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1218003a00 0x7f12381f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 >> 172.21.15.114:0/888891222 conn(0x7f12380af930 msgr2=0x7f12380cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 shutdown_connections 2024-05-09T00:08:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.188+0000 7f123de00640 1 -- 172.21.15.114:0/888891222 wait complete. 2024-05-09T00:08:55.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:55.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.481+0000 7fbbcb200640 1 Processor -- start 2024-05-09T00:08:55.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.481+0000 7fbbcb200640 1 -- start start 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbcb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbbc408ed30 0x7fbbc40cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbcb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 0x7fbbc406cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbcb200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc406ed40 con 0x7fbbc40c4080 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbcb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc4158e00 con 0x7fbbc408ed30 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbcb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc406dec0 con 0x7fbbc41589f0 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbc9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbbc40c4080 0x7fbbc406e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40570/0 (socket says 172.21.15.114:40570) 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.483+0000 7fbbc9e00640 1 -- 172.21.15.114:0/3259980258 learned_addr learned my addr 172.21.15.114:0/3259980258 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 149159800 0 0) 0x7fbbc406ed40 con 0x7fbbc40c4080 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbca800640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 0x7fbbc406cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbac003520 con 0x7fbbc40c4080 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc9400640 1 --2- 172.21.15.114:0/3259980258 >> v2:172.21.15.153:3300/0 conn(0x7fbbc408ed30 0x7fbbc40cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1170222298 0 0) 0x7fbbac003520 con 0x7fbbc40c4080 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 msgr2=0x7fbbc406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 0x7fbbc406cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 >> v2:172.21.15.153:3300/0 conn(0x7fbbc408ed30 msgr2=0x7fbbc40cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 --2- 172.21.15.114:0/3259980258 >> v2:172.21.15.153:3300/0 conn(0x7fbbc408ed30 0x7fbbc40cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc40c8a50 con 0x7fbbc40c4080 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fbbb8001710 con 0x7fbbc40c4080 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 >> v1:172.21.15.114:6789/0 conn(0x7fbbc40c4080 legacy=0x7fbbc406e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.484+0000 7fbbc8a00640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 0x7fbbac003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc8a00640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc8a00640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac004d40 0x7fbbac005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4158e00 con 0x7fbbac003fd0 2024-05-09T00:08:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc406dec0 con 0x7fbbac004d40 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac00bb50 con 0x7fbbc41589f0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9400640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9e00640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 0x7fbbac003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9400640 1 -- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 msgr2=0x7fbbac003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9400640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc41589f0 0x7fbbac003a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9400640 1 -- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac004d40 msgr2=0x7fbbac005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9400640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac004d40 0x7fbbac005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.485+0000 7fbbc9400640 1 -- 172.21.15.114:0/3259980258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac003520 con 0x7fbbac003fd0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.486+0000 7fbbc9400640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400ba30 tx=0x7fbbac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a0d5b91bddd25f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4030070 con 0x7fbbac003fd0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb402ae10 con 0x7fbbac003fd0 2024-05-09T00:08:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbc8a00640 1 -- 172.21.15.114:0/3259980258 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400b600 con 0x7fbbac003fd0 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbcb200640 1 -- 172.21.15.114:0/3259980258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 msgr2=0x7fbbac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbcb200640 1 --2- 172.21.15.114:0/3259980258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400ba30 tx=0x7fbbac005830 comp rx=0 tx=0).stop 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbca800640 1 -- 172.21.15.114:0/3259980258 reap_dead start 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbcb200640 1 -- 172.21.15.114:0/3259980258 shutdown_connections 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.487+0000 7fbbcb200640 1 -- 172.21.15.114:0/3259980258 >> 172.21.15.114:0/3259980258 conn(0x7fbbc40cd8e0 msgr2=0x7fbbc40cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.488+0000 7fbbcb200640 1 -- 172.21.15.114:0/3259980258 shutdown_connections 2024-05-09T00:08:55.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.488+0000 7fbbcb200640 1 -- 172.21.15.114:0/3259980258 wait complete. 2024-05-09T00:08:55.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.490+0000 7fbbcb200640 1 Processor -- start 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.490+0000 7fbbcb200640 1 -- start start 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.491+0000 7fbbcb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbc41eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.491+0000 7fbbcb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc40add70 0x7fbbc4149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.491+0000 7fbbcb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbc4152f90 0x7fbbc41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.491+0000 7fbbcb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40c8330 con 0x7fbbac003fd0 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.491+0000 7fbbcb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc406e1a0 con 0x7fbbc4152f90 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.491+0000 7fbbcb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc406cfb0 con 0x7fbbc40add70 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbc41eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbc41eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56856/0 (socket says 172.21.15.114:56856) 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 -- 172.21.15.114:0/275465631 learned_addr learned my addr 172.21.15.114:0/275465631 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9400640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc40add70 0x7fbbc4149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbca800640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbc4152f90 0x7fbbc41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 -- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc40add70 msgr2=0x7fbbc4149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc40add70 0x7fbbc4149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 -- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbc4152f90 msgr2=0x7fbbc41533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbc4152f90 0x7fbbc41533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 -- 172.21.15.114:0/275465631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc41ee110 con 0x7fbbac003fd0 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9400640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc40add70 0x7fbbc4149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbca800640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbc4152f90 0x7fbbc41533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.492+0000 7fbbc9e00640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbc41eebd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800d7a0 tx=0x7fbbb800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.493+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80074e0 con 0x7fbbac003fd0 2024-05-09T00:08:55.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.493+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb800de50 con 0x7fbbac003fd0 2024-05-09T00:08:55.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.493+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8004a00 con 0x7fbbac003fd0 2024-05-09T00:08:55.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.493+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc41f2130 con 0x7fbbac003fd0 2024-05-09T00:08:55.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.493+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc41ee3d0 con 0x7fbbac003fd0 2024-05-09T00:08:55.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.494+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc40c78f0 con 0x7fbbac003fd0 2024-05-09T00:08:55.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.495+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbbb801b020 con 0x7fbbac003fd0 2024-05-09T00:08:55.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.496+0000 7fbbbe000640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbba8076300 0x7fbba8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.496+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbbb80975e0 con 0x7fbbac003fd0 2024-05-09T00:08:55.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.497+0000 7fbbc9400640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbba8076300 0x7fbba8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.497+0000 7fbbc9400640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbba8076300 0x7fbba8078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400ba00 tx=0x7fbbb4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:55.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.502+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbbb8060c10 con 0x7fbbac003fd0 2024-05-09T00:08:55.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.697+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbc4078430 con 0x7fbbac003fd0 2024-05-09T00:08:55.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.699+0000 7fbbbe000640 1 -- 172.21.15.114:0/275465631 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20348 (secure 0 0 0) 0x7fbbb8060510 con 0x7fbbac003fd0 2024-05-09T00:08:55.695 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":25,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:54.746366+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbba8076300 msgr2=0x7fbba8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbba8076300 0x7fbba8078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400ba00 tx=0x7fbbb4030000 comp rx=0 tx=0).stop 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 msgr2=0x7fbbc41eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbc41eebd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800d7a0 tx=0x7fbbb800dc60 comp rx=0 tx=0).stop 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 shutdown_connections 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbba8076300 0x7fbba8078810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbc4152f90 0x7fbbc41533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbc40add70 0x7fbbc4149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 --2- 172.21.15.114:0/275465631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbac003fd0 0x7fbbc41eebd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 >> 172.21.15.114:0/275465631 conn(0x7fbbc40cd8e0 msgr2=0x7fbbc4155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 shutdown_connections 2024-05-09T00:08:55.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.702+0000 7fbbcb200640 1 -- 172.21.15.114:0/275465631 wait complete. 2024-05-09T00:08:55.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:08:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.986+0000 7f2ca7000640 1 Processor -- start 2024-05-09T00:08:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.986+0000 7f2ca7000640 1 -- start start 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca7000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ca0155710 0x7f2ca0158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca7000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00cb800 0x7f2ca00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca7000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca008f550 con 0x7f2ca00c8730 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca7000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca00b3460 con 0x7f2ca0155710 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca7000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca0155b20 con 0x7f2ca00cb800 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ca0155710 0x7f2ca0158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ca0155710 0x7f2ca0158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56862/0 (socket says 172.21.15.114:56862) 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 -- 172.21.15.114:0/3812825618 learned_addr learned my addr 172.21.15.114:0/3812825618 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca6600640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00cb800 0x7f2ca00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 -- 172.21.15.114:0/3812825618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00cb800 msgr2=0x7f2ca00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00cb800 0x7f2ca00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 -- 172.21.15.114:0/3812825618 >> v1:172.21.15.153:6789/0 conn(0x7f2ca00c8730 legacy=0x7f2ca00ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca5200640 1 -- 172.21.15.114:0/3812825618 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca015b880 con 0x7f2ca0155710 2024-05-09T00:08:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.988+0000 7f2ca6600640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00cb800 0x7f2ca00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.989+0000 7f2ca5200640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca0158a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009870 tx=0x7f2c8c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d455291674a7ce4b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.990+0000 7f2c9fe00640 1 -- 172.21.15.114:0/3812825618 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c037070 con 0x7f2ca0155710 2024-05-09T00:08:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.990+0000 7f2c9fe00640 1 -- 172.21.15.114:0/3812825618 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8c02adf0 con 0x7f2ca0155710 2024-05-09T00:08:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.990+0000 7f2c9fe00640 1 -- 172.21.15.114:0/3812825618 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c032660 con 0x7f2ca0155710 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 -- 172.21.15.114:0/3812825618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 msgr2=0x7f2ca0158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca0158a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009870 tx=0x7f2c8c02a0a0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 -- 172.21.15.114:0/3812825618 shutdown_connections 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00cb800 0x7f2ca00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 --2- 172.21.15.114:0/3812825618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca0158a70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 -- 172.21.15.114:0/3812825618 >> 172.21.15.114:0/3812825618 conn(0x7f2ca00af450 msgr2=0x7f2ca00af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 -- 172.21.15.114:0/3812825618 shutdown_connections 2024-05-09T00:08:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.991+0000 7f2ca7000640 1 -- 172.21.15.114:0/3812825618 wait complete. 2024-05-09T00:08:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.993+0000 7f2ca7000640 1 Processor -- start 2024-05-09T00:08:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.994+0000 7f2ca7000640 1 -- start start 2024-05-09T00:08:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.995+0000 7f2ca7000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00c8730 0x7f2ca00c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.995+0000 7f2ca7000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca00cb800 0x7f2ca00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.995+0000 7f2ca7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca00c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.995+0000 7f2ca7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca015c1b0 con 0x7f2ca0155710 2024-05-09T00:08:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.995+0000 7f2ca7000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca015b630 con 0x7f2ca00cb800 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.995+0000 7f2ca7000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca015be40 con 0x7f2ca00c8730 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca00c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca00c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56874/0 (socket says 172.21.15.114:56874) 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 -- 172.21.15.114:0/2685875277 learned_addr learned my addr 172.21.15.114:0/2685875277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca5c00640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00c8730 0x7f2ca00c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca5200640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca00cb800 0x7f2ca00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 -- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00c8730 msgr2=0x7f2ca00c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00c8730 0x7f2ca00c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 -- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca00cb800 msgr2=0x7f2ca00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca00cb800 0x7f2ca00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 -- 172.21.15.114:0/2685875277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca00cbd50 con 0x7f2ca0155710 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca5200640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca00cb800 0x7f2ca00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2ca6600640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca00c48a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c5c0 tx=0x7f2c9800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.996+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98015070 con 0x7f2ca0155710 2024-05-09T00:08:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.997+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c98011820 con 0x7f2ca0155710 2024-05-09T00:08:55.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.997+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca01ee400 con 0x7f2ca0155710 2024-05-09T00:08:55.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.997+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98011c10 con 0x7f2ca0155710 2024-05-09T00:08:55.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.997+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca01ee9c0 con 0x7f2ca0155710 2024-05-09T00:08:55.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.998+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca01ee150 con 0x7f2ca0155710 2024-05-09T00:08:55.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:55.999+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c98018070 con 0x7f2ca0155710 2024-05-09T00:08:55.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.000+0000 7f2c9d600640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2c80076300 0x7f2c80078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:55.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.000+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2c98097850 con 0x7f2ca0155710 2024-05-09T00:08:55.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.000+0000 7f2ca5c00640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2c80076300 0x7f2c80078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:55.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.001+0000 7f2ca5c00640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2c80076300 0x7f2c80078810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00c0e90 tx=0x7f2c940094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:56.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.004+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c98060df0 con 0x7f2ca0155710 2024-05-09T00:08:56.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.199+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ca0078430 con 0x7f2ca0155710 2024-05-09T00:08:56.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.201+0000 7f2c9d600640 1 -- 172.21.15.114:0/2685875277 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7f2c980606f0 con 0x7f2ca0155710 2024-05-09T00:08:56.197 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2c80076300 msgr2=0x7f2c80078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2c80076300 0x7f2c80078810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00c0e90 tx=0x7f2c940094f0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 msgr2=0x7f2ca00c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca00c48a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c5c0 tx=0x7f2c9800ca80 comp rx=0 tx=0).stop 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 shutdown_connections 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2c80076300 0x7f2c80078810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca0155710 0x7f2ca00c48a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca00cb800 0x7f2ca00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 --2- 172.21.15.114:0/2685875277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00c8730 0x7f2ca00c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 >> 172.21.15.114:0/2685875277 conn(0x7f2ca00af450 msgr2=0x7f2ca01591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 shutdown_connections 2024-05-09T00:08:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.205+0000 7f2ca7000640 1 -- 172.21.15.114:0/2685875277 wait complete. 2024-05-09T00:08:56.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-05-09T00:08:56.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.485+0000 7f391e200640 1 Processor -- start 2024-05-09T00:08:56.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.486+0000 7f391e200640 1 -- start start 2024-05-09T00:08:56.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f391e200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f3918155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f391e200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39180cbf50 con 0x7f3918158b10 2024-05-09T00:08:56.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f391e200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391815b7f0 con 0x7f39180cb430 2024-05-09T00:08:56.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f391e200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f391815c5b0 con 0x7f39180c8760 2024-05-09T00:08:56.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f3917e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3918158b10 0x7f39180af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40578/0 (socket says 172.21.15.114:40578) 2024-05-09T00:08:56.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f3917e00640 1 -- 172.21.15.114:0/1726103949 learned_addr learned my addr 172.21.15.114:0/1726103949 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:56.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f391ce00640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f3918155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.488+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382544000 0 0) 0x7f39180cbf50 con 0x7f3918158b10 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38fc003520 con 0x7f3918158b10 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993191957 0 0) 0x7f391815b7f0 con 0x7f39180cb430 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39180cbf50 con 0x7f39180cb430 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2384516560 0 0) 0x7f38fc003520 con 0x7f3918158b10 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 msgr2=0x7f3918155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f3918155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 >> v1:172.21.15.153:6789/0 conn(0x7f39180cb430 legacy=0x7f39180cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391815bad0 con 0x7f3918158b10 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f39000016f0 con 0x7f3918158b10 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 >> v1:172.21.15.114:6789/0 conn(0x7f3918158b10 legacy=0x7f39180af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc003c10 0x7f38fc004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f38fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc004d90 0x7f38fc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f391815c5b0 con 0x7f38fc004d90 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc00bbd0 con 0x7f38fc003c10 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc00bdd0 con 0x7f39180c8760 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f391d800640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc004d90 0x7f38fc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.489+0000 7f391ce00640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc003c10 0x7f38fc004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f3917e00640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f38fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f391d800640 1 -- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 msgr2=0x7f38fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f391d800640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f38fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f391d800640 1 -- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc003c10 msgr2=0x7f38fc004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f391d800640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc003c10 0x7f38fc004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f391d800640 1 -- 172.21.15.114:0/1726103949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc003520 con 0x7f38fc004d90 2024-05-09T00:08:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f3917e00640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39180c8760 0x7f38fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:56.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.490+0000 7f391ce00640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc003c10 0x7f38fc004060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:56.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.491+0000 7f391d800640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc004d90 0x7f38fc005220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39100018d0 tx=0x7f38fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7957626acad37d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:56.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.491+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910001520 con 0x7f38fc004d90 2024-05-09T00:08:56.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.491+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391002acb0 con 0x7f38fc004d90 2024-05-09T00:08:56.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.491+0000 7f3917400640 1 -- 172.21.15.114:0/1726103949 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910005310 con 0x7f38fc004d90 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391e200640 1 -- 172.21.15.114:0/1726103949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc004d90 msgr2=0x7f38fc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391e200640 1 --2- 172.21.15.114:0/1726103949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc004d90 0x7f38fc005220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39100018d0 tx=0x7f38fc005830 comp rx=0 tx=0).stop 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391d800640 1 -- 172.21.15.114:0/1726103949 reap_dead start 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391e200640 1 -- 172.21.15.114:0/1726103949 shutdown_connections 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391e200640 1 -- 172.21.15.114:0/1726103949 >> 172.21.15.114:0/1726103949 conn(0x7f3918068ef0 msgr2=0x7f39180cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391e200640 1 -- 172.21.15.114:0/1726103949 shutdown_connections 2024-05-09T00:08:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.492+0000 7f391e200640 1 -- 172.21.15.114:0/1726103949 wait complete. 2024-05-09T00:08:56.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.494+0000 7f391e200640 1 Processor -- start 2024-05-09T00:08:56.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.494+0000 7f391e200640 1 -- start start 2024-05-09T00:08:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.495+0000 7f391e200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc004d90 0x7f39180c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.495+0000 7f391e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180c39e0 0x7f39180c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.495+0000 7f391e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 0x7f3918154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.495+0000 7f391e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f39180af740 con 0x7f3918154750 2024-05-09T00:08:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.495+0000 7f391e200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f391815c090 con 0x7f39180c39e0 2024-05-09T00:08:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.495+0000 7f391e200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f39180af8c0 con 0x7f38fc004d90 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 0x7f3918154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 0x7f3918154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56886/0 (socket says 172.21.15.114:56886) 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 -- 172.21.15.114:0/557160849 learned_addr learned my addr 172.21.15.114:0/557160849 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f3917e00640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180c39e0 0x7f39180c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391ce00640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc004d90 0x7f39180c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 -- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc004d90 msgr2=0x7f39180c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc004d90 0x7f39180c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 -- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180c39e0 msgr2=0x7f39180c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180c39e0 0x7f39180c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 -- 172.21.15.114:0/557160849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39180c1020 con 0x7f3918154750 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.496+0000 7f391d800640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 0x7f3918154b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39100018d0 tx=0x7f39100012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.497+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391002ae60 con 0x7f3918154750 2024-05-09T00:08:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.497+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39100074e0 con 0x7f3918154750 2024-05-09T00:08:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.497+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39180c1300 con 0x7f3918154750 2024-05-09T00:08:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.497+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910001520 con 0x7f3918154750 2024-05-09T00:08:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.497+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39180c18c0 con 0x7f3918154750 2024-05-09T00:08:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.498+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3918078430 con 0x7f3918154750 2024-05-09T00:08:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.499+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3910006a10 con 0x7f3918154750 2024-05-09T00:08:56.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.500+0000 7f3914c00640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38f4076300 0x7f38f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:56.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.500+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f39100b68a0 con 0x7f3918154750 2024-05-09T00:08:56.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.500+0000 7f391ce00640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38f4076300 0x7f38f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:56.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.501+0000 7f391ce00640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38f4076300 0x7f38f4078810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3908007330 tx=0x7f390800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:56.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.505+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f391007ff40 con 0x7f3918154750 2024-05-09T00:08:56.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:56.733+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f39180c73a0 con 0x7f3918154750 2024-05-09T00:08:57.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.234+0000 7f3914c00640 1 -- 172.21.15.114:0/557160849 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 113+0+0 (secure 0 0 0) 0x7f391007f840 con 0x7f3918154750 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38f4076300 msgr2=0x7f38f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38f4076300 0x7f38f4078810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3908007330 tx=0x7f390800b040 comp rx=0 tx=0).stop 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 msgr2=0x7f3918154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 0x7f3918154b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39100018d0 tx=0x7f39100012f0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 shutdown_connections 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38f4076300 0x7f38f4078810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3918154750 0x7f3918154b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180c39e0 0x7f39180c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 --2- 172.21.15.114:0/557160849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc004d90 0x7f39180c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 >> 172.21.15.114:0/557160849 conn(0x7f3918068ef0 msgr2=0x7f3918159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:57.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 shutdown_connections 2024-05-09T00:08:57.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.238+0000 7f391e200640 1 -- 172.21.15.114:0/557160849 wait complete. 2024-05-09T00:08:57.259 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-09T00:08:57.260 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-05-09T00:08:57.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.540+0000 7f7760a00640 1 Processor -- start 2024-05-09T00:08:57.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.540+0000 7f7760a00640 1 -- start start 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f7760a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f775c15c070 0x7f775c0c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f7760a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 0x7f775c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f7760a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c0741e0 con 0x7f775c158170 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f7760a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f775c06e9d0 con 0x7f775c15c070 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f7760a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f775c06ef90 con 0x7f775c1552e0 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f775b200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f775c158170 0x7f775c158580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40592/0 (socket says 172.21.15.114:40592) 2024-05-09T00:08:57.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.542+0000 7f775b200640 1 -- 172.21.15.114:0/1143550141 learned_addr learned my addr 172.21.15.114:0/1143550141 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:57.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f775a800640 1 --2- 172.21.15.114:0/1143550141 >> v2:172.21.15.153:3300/0 conn(0x7f775c15c070 0x7f775c0c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7751e00640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 0x7f775c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296722973 0 0) 0x7f775c0741e0 con 0x7f775c158170 2024-05-09T00:08:57.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7740003520 con 0x7f775c158170 2024-05-09T00:08:57.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 562816141 0 0) 0x7f7740003520 con 0x7f775c158170 2024-05-09T00:08:57.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 msgr2=0x7f775c1556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 0x7f775c1556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 >> v2:172.21.15.153:3300/0 conn(0x7f775c15c070 msgr2=0x7f775c0c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 --2- 172.21.15.114:0/1143550141 >> v2:172.21.15.153:3300/0 conn(0x7f775c15c070 0x7f775c0c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c0744c0 con 0x7f775c158170 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f7754001a70 con 0x7f775c158170 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.543+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 >> v1:172.21.15.114:6789/0 conn(0x7f775c158170 legacy=0x7f775c158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f7759e00640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7740003a00 0x7f7740003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f7759e00640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740004800 0x7f7740004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f7759e00640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 0x7f7740005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f775c06e9d0 con 0x7f7740003a00 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f775c06ef90 con 0x7f7740004800 2024-05-09T00:08:57.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f774000ba70 con 0x7f775c1552e0 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775a800640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7740003a00 0x7f7740003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775b200640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 0x7f7740005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775a800640 1 -- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 msgr2=0x7f7740005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775a800640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1552e0 0x7f7740005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775a800640 1 -- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740004800 msgr2=0x7f7740004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775a800640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740004800 0x7f7740004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.544+0000 7f775a800640 1 -- 172.21.15.114:0/1143550141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7740003520 con 0x7f7740003a00 2024-05-09T00:08:57.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.545+0000 7f775a800640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7740003a00 0x7f7740003e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f774c009a90 tx=0x7f7740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1244a80e69d8d77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:57.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.545+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c036070 con 0x7f7740003a00 2024-05-09T00:08:57.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.545+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c031400 con 0x7f7740003a00 2024-05-09T00:08:57.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.545+0000 7f7759e00640 1 -- 172.21.15.114:0/1143550141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c009690 con 0x7f7740003a00 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f7760a00640 1 -- 172.21.15.114:0/1143550141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7740003a00 msgr2=0x7f7740003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f7760a00640 1 --2- 172.21.15.114:0/1143550141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7740003a00 0x7f7740003e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f774c009a90 tx=0x7f7740005830 comp rx=0 tx=0).stop 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f775b200640 1 -- 172.21.15.114:0/1143550141 reap_dead start 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f7760a00640 1 -- 172.21.15.114:0/1143550141 shutdown_connections 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f7760a00640 1 -- 172.21.15.114:0/1143550141 >> 172.21.15.114:0/1143550141 conn(0x7f775c0c5ea0 msgr2=0x7f775c0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f7760a00640 1 -- 172.21.15.114:0/1143550141 shutdown_connections 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.546+0000 7f7760a00640 1 -- 172.21.15.114:0/1143550141 wait complete. 2024-05-09T00:08:57.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.549+0000 7f7760a00640 1 Processor -- start 2024-05-09T00:08:57.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.549+0000 7f7760a00640 1 -- start start 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f7760a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740003a00 0x7f775c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f7760a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1f1460 0x7f775c14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f7760a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 0x7f775c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f7760a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0c54d0 con 0x7f775c1f1870 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f7760a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f775c073eb0 con 0x7f7740003a00 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f7760a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f775c15c480 con 0x7f775c1f1460 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f775b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 0x7f775c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f775b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 0x7f775c159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56900/0 (socket says 172.21.15.114:56900) 2024-05-09T00:08:57.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.550+0000 7f775b200640 1 -- 172.21.15.114:0/2058264442 learned_addr learned my addr 172.21.15.114:0/2058264442 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775a800640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740003a00 0x7f775c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f7751e00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1f1460 0x7f775c14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775b200640 1 -- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1f1460 msgr2=0x7f775c14bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775b200640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1f1460 0x7f775c14bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775b200640 1 -- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740003a00 msgr2=0x7f775c0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775b200640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740003a00 0x7f775c0c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775b200640 1 -- 172.21.15.114:0/2058264442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c0c7000 con 0x7f775c1f1870 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775a800640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740003a00 0x7f775c0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f775b200640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 0x7f775c159230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77540012e0 tx=0x7f775400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754004d70 con 0x7f775c1f1870 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775400bb80 con 0x7f775c1f1870 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c0c9050 con 0x7f775c1f1870 2024-05-09T00:08:57.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.551+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754007110 con 0x7f775c1f1870 2024-05-09T00:08:57.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.552+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c1f1d30 con 0x7f775c1f1870 2024-05-09T00:08:57.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.552+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c0ae690 con 0x7f775c1f1870 2024-05-09T00:08:57.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.554+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f775401b020 con 0x7f775c1f1870 2024-05-09T00:08:57.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.555+0000 7f7753400640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7738076300 0x7f7738078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:57.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.555+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f7754097ae0 con 0x7f775c1f1870 2024-05-09T00:08:57.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.555+0000 7f775a800640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7738076300 0x7f7738078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:57.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.556+0000 7f775a800640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7738076300 0x7f7738078810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f774c009a90 tx=0x7f774c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:57.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.559+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f77540611a0 con 0x7f775c1f1870 2024-05-09T00:08:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:57.813+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f775c078430 con 0x7f775c1f1870 2024-05-09T00:08:58.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.246+0000 7f7753400640 1 -- 172.21.15.114:0/2058264442 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7f7754060aa0 con 0x7f775c1f1870 2024-05-09T00:08:58.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.251+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7738076300 msgr2=0x7f7738078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.251+0000 7f7760a00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7738076300 0x7f7738078810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f774c009a90 tx=0x7f774c008030 comp rx=0 tx=0).stop 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.251+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 msgr2=0x7f775c159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.251+0000 7f7760a00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 0x7f775c159230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77540012e0 tx=0x7f775400b4a0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.251+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 shutdown_connections 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7738076300 0x7f7738078810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c1f1870 0x7f775c159230 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f775c1f1460 0x7f775c14bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 --2- 172.21.15.114:0/2058264442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7740003a00 0x7f775c0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 >> 172.21.15.114:0/2058264442 conn(0x7f775c0c5ea0 msgr2=0x7f775c151bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 shutdown_connections 2024-05-09T00:08:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.252+0000 7f7760a00640 1 -- 172.21.15.114:0/2058264442 wait complete. 2024-05-09T00:08:58.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-05-09T00:08:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.561+0000 7f533b400640 1 Processor -- start 2024-05-09T00:08:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.562+0000 7f533b400640 1 -- start start 2024-05-09T00:08:58.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f533b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 0x7f5334159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f533b400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5334156bb0 con 0x7f53340ae940 2024-05-09T00:08:58.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f533b400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5334156e90 con 0x7f53340c43c0 2024-05-09T00:08:58.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f533b400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f53340ac710 con 0x7f5334153760 2024-05-09T00:08:58.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f5339400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f53340ae940 0x7f53340aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53104/0 (socket says 172.21.15.114:53104) 2024-05-09T00:08:58.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f5339400640 1 -- 172.21.15.114:0/1982669344 learned_addr learned my addr 172.21.15.114:0/1982669344 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:08:58.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f532be00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 0x7f5334159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414687891 0 0) 0x7f5334156bb0 con 0x7f53340ae940 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.564+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5318003520 con 0x7f53340ae940 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2372472392 0 0) 0x7f5318003520 con 0x7f53340ae940 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 msgr2=0x7f5334159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 0x7f5334159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 >> v1:172.21.15.153:6789/0 conn(0x7f53340c43c0 legacy=0x7f5334159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53340ac960 con 0x7f53340ae940 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f532c001a70 con 0x7f53340ae940 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 >> v1:172.21.15.114:6789/0 conn(0x7f53340ae940 legacy=0x7f53340aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 0x7f5318003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5318004000 0x7f5318004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53180051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f53340ac710 con 0x7f5318004d40 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f531800bc80 con 0x7f5318004000 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f531800be80 con 0x7f5334153760 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.565+0000 7f5339400640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53180051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f532be00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5318004000 0x7f5318004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f5338a00640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 0x7f5318003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f5339400640 1 -- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 msgr2=0x7f5318003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f5339400640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5334153760 0x7f5318003a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f5339400640 1 -- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5318004000 msgr2=0x7f5318004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f5339400640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5318004000 0x7f5318004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.566+0000 7f5339400640 1 -- 172.21.15.114:0/1982669344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5318003520 con 0x7f5318004d40 2024-05-09T00:08:58.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.567+0000 7f5339400640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53180051f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f532c0013d0 tx=0x7f5318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e71fa37bffd6d7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:58.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.567+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c00a480 con 0x7f5318004d40 2024-05-09T00:08:58.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.567+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c02f070 con 0x7f5318004d40 2024-05-09T00:08:58.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.567+0000 7f5333e00640 1 -- 172.21.15.114:0/1982669344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c02bb70 con 0x7f5318004d40 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f533b400640 1 -- 172.21.15.114:0/1982669344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 msgr2=0x7f53180051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f533b400640 1 --2- 172.21.15.114:0/1982669344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53180051f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f532c0013d0 tx=0x7f5318005830 comp rx=0 tx=0).stop 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f5339400640 1 -- 172.21.15.114:0/1982669344 reap_dead start 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f533b400640 1 -- 172.21.15.114:0/1982669344 shutdown_connections 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f533b400640 1 -- 172.21.15.114:0/1982669344 >> 172.21.15.114:0/1982669344 conn(0x7f533406c680 msgr2=0x7f533406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f533b400640 1 -- 172.21.15.114:0/1982669344 shutdown_connections 2024-05-09T00:08:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.568+0000 7f533b400640 1 -- 172.21.15.114:0/1982669344 wait complete. 2024-05-09T00:08:58.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.570+0000 7f533b400640 1 Processor -- start 2024-05-09T00:08:58.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.571+0000 7f533b400640 1 -- start start 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f533b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53340c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f533b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533414ea60 0x7f53341553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f533b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53341f14b0 0x7f53341f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f533b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f53340af460 con 0x7f5318004d40 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f533b400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53340ad3c0 con 0x7f533414ea60 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f533b400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f53340af5e0 con 0x7f53341f14b0 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f5338a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53340c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f5338a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53340c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59098/0 (socket says 172.21.15.114:59098) 2024-05-09T00:08:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.572+0000 7f5338a00640 1 -- 172.21.15.114:0/4178365892 learned_addr learned my addr 172.21.15.114:0/4178365892 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f532be00640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533414ea60 0x7f53341553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5339400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53341f14b0 0x7f53341f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5338a00640 1 -- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53341f14b0 msgr2=0x7f53341f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5338a00640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53341f14b0 0x7f53341f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5338a00640 1 -- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533414ea60 msgr2=0x7f53341553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5338a00640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533414ea60 0x7f53341553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5338a00640 1 -- 172.21.15.114:0/4178365892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533414dbc0 con 0x7f5318004d40 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5338a00640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53340c76a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f532400d7d0 tx=0x7f532400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324005270 con 0x7f5318004d40 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5324017070 con 0x7f5318004d40 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532400b6b0 con 0x7f5318004d40 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.573+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533414dea0 con 0x7f5318004d40 2024-05-09T00:08:58.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.574+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5334154bf0 con 0x7f5318004d40 2024-05-09T00:08:58.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.575+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5334077430 con 0x7f5318004d40 2024-05-09T00:08:58.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.576+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f532400b850 con 0x7f5318004d40 2024-05-09T00:08:58.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.577+0000 7f5331600640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f53100762d0 0x7f53100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:58.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.577+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f5324097840 con 0x7f5318004d40 2024-05-09T00:08:58.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.577+0000 7f532be00640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f53100762d0 0x7f53100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:58.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.578+0000 7f532be00640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f53100762d0 0x7f53100787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5334074260 tx=0x7f531c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:58.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.582+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5324060dd0 con 0x7f5318004d40 2024-05-09T00:08:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:58.823+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f53340c6ca0 con 0x7f5318004d40 2024-05-09T00:08:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.258+0000 7f5331600640 1 -- 172.21.15.114:0/4178365892 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v15) ==== 110+0+0 (secure 0 0 0) 0x7f53240606d0 con 0x7f5318004d40 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f53100762d0 msgr2=0x7f53100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f53100762d0 0x7f53100787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5334074260 tx=0x7f531c008040 comp rx=0 tx=0).stop 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 msgr2=0x7f53340c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53340c76a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f532400d7d0 tx=0x7f532400dc90 comp rx=0 tx=0).stop 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 shutdown_connections 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f53100762d0 0x7f53100787e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53341f14b0 0x7f53341f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533414ea60 0x7f53341553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 --2- 172.21.15.114:0/4178365892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5318004d40 0x7f53340c76a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.262+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 >> 172.21.15.114:0/4178365892 conn(0x7f533406c680 msgr2=0x7f533414bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.263+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 shutdown_connections 2024-05-09T00:08:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.263+0000 7f533b400640 1 -- 172.21.15.114:0/4178365892 wait complete. 2024-05-09T00:08:59.287 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-05-09T00:08:59.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:08:59.337 INFO:tasks.ceph.mds.d.smithi153.stderr:2024-05-09T00:08:59.340+0000 7fe047600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:08:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.553+0000 7f06ce800640 1 Processor -- start 2024-05-09T00:08:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.553+0000 7f06ce800640 1 -- start start 2024-05-09T00:08:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.555+0000 7f06ce800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c80aba00 0x7f06c80accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.555+0000 7f06ce800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06c81566f0 0x7f06c80ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.555+0000 7f06ce800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c80ad340 con 0x7f06c8156b00 2024-05-09T00:08:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.555+0000 7f06ce800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f06c8156260 con 0x7f06c81566f0 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.555+0000 7f06ce800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f06c8155f10 con 0x7f06c80aba00 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06c81566f0 0x7f06c80ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06c81566f0 0x7f06c80ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59104/0 (socket says 172.21.15.114:59104) 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 -- 172.21.15.114:0/3251089970 learned_addr learned my addr 172.21.15.114:0/3251089970 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cd400640 1 --2- 172.21.15.114:0/3251089970 >> v2:172.21.15.153:3300/0 conn(0x7f06c80aba00 0x7f06c80accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 -- 172.21.15.114:0/3251089970 >> v2:172.21.15.153:3300/0 conn(0x7f06c80aba00 msgr2=0x7f06c80accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 --2- 172.21.15.114:0/3251089970 >> v2:172.21.15.153:3300/0 conn(0x7f06c80aba00 0x7f06c80accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 -- 172.21.15.114:0/3251089970 >> v1:172.21.15.153:6789/0 conn(0x7f06c8156b00 legacy=0x7f06c80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.556+0000 7f06cca00640 1 -- 172.21.15.114:0/3251089970 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c80c4f40 con 0x7f06c81566f0 2024-05-09T00:08:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.558+0000 7f06cca00640 1 --2- 172.21.15.114:0/3251089970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c80ae820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f06c80707b0 tx=0x7f06b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e450e1ce62f16be0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.558+0000 7f06c7e00640 1 -- 172.21.15.114:0/3251089970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4037070 con 0x7f06c81566f0 2024-05-09T00:08:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.558+0000 7f06c7e00640 1 -- 172.21.15.114:0/3251089970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b4032440 con 0x7f06c81566f0 2024-05-09T00:08:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.558+0000 7f06c7e00640 1 -- 172.21.15.114:0/3251089970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4032810 con 0x7f06c81566f0 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 -- 172.21.15.114:0/3251089970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 msgr2=0x7f06c80ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 --2- 172.21.15.114:0/3251089970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c80ae820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f06c80707b0 tx=0x7f06b402a1e0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 -- 172.21.15.114:0/3251089970 shutdown_connections 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 --2- 172.21.15.114:0/3251089970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c80ae820 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 --2- 172.21.15.114:0/3251089970 >> v2:172.21.15.153:3300/0 conn(0x7f06c80aba00 0x7f06c80accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 -- 172.21.15.114:0/3251089970 >> 172.21.15.114:0/3251089970 conn(0x7f06c80c9730 msgr2=0x7f06c80c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 -- 172.21.15.114:0/3251089970 shutdown_connections 2024-05-09T00:08:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.559+0000 7f06ce800640 1 -- 172.21.15.114:0/3251089970 wait complete. 2024-05-09T00:08:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.561+0000 7f06ce800640 1 Processor -- start 2024-05-09T00:08:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.561+0000 7f06ce800640 1 -- start start 2024-05-09T00:08:59.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06ce800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c80aba00 0x7f06c81398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:59.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06ce800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:59.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06ce800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c8156b00 0x7f06c8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:59.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06ce800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80af470 con 0x7f06c81566f0 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06ce800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80c4920 con 0x7f06c8156b00 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06ce800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f06c813e830 con 0x7f06c80aba00 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06cca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06cca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c8159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59120/0 (socket says 172.21.15.114:59120) 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06cca00640 1 -- 172.21.15.114:0/3625846606 learned_addr learned my addr 172.21.15.114:0/3625846606 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06cd400640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c80aba00 0x7f06c81398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.563+0000 7f06cde00640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c8156b00 0x7f06c8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06cca00640 1 -- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c80aba00 msgr2=0x7f06c81398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06cca00640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c80aba00 0x7f06c81398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06cca00640 1 -- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c8156b00 msgr2=0x7f06c8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06cca00640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c8156b00 0x7f06c8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06cca00640 1 -- 172.21.15.114:0/3625846606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c81eca30 con 0x7f06c81566f0 2024-05-09T00:08:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06cca00640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c8159a80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06b4000c00 tx=0x7f06b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4041070 con 0x7f06c81566f0 2024-05-09T00:08:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b403c870 con 0x7f06c81566f0 2024-05-09T00:08:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4037040 con 0x7f06c81566f0 2024-05-09T00:08:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.564+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c81571f0 con 0x7f06c81566f0 2024-05-09T00:08:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.565+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81577b0 con 0x7f06c81566f0 2024-05-09T00:08:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.566+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c8078430 con 0x7f06c81566f0 2024-05-09T00:08:59.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.567+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06b4044070 con 0x7f06c81566f0 2024-05-09T00:08:59.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.568+0000 7f06c5600640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f06a80762d0 0x7f06a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:59.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.568+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f06b40b8480 con 0x7f06c81566f0 2024-05-09T00:08:59.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.568+0000 7f06cd400640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f06a80762d0 0x7f06a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:59.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.569+0000 7f06cd400640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f06a80762d0 0x7f06a80787e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06bc006fd0 tx=0x7f06bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:59.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.573+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06b4081a10 con 0x7f06c81566f0 2024-05-09T00:08:59.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.820+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06c80c4b80 con 0x7f06c81566f0 2024-05-09T00:08:59.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.821+0000 7f06c5600640 1 -- 172.21.15.114:0/3625846606 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f06b4081310 con 0x7f06c81566f0 2024-05-09T00:08:59.817 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:08:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:08:59.817 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:08:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.823+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f06a80762d0 msgr2=0x7f06a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.823+0000 7f06ce800640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f06a80762d0 0x7f06a80787e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06bc006fd0 tx=0x7f06bc008040 comp rx=0 tx=0).stop 2024-05-09T00:08:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.823+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 msgr2=0x7f06c8159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.823+0000 7f06ce800640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c8159a80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06b4000c00 tx=0x7f06b40046c0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 shutdown_connections 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f06a80762d0 0x7f06a80787e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c8156b00 0x7f06c8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c81566f0 0x7f06c8159a80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 --2- 172.21.15.114:0/3625846606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c80aba00 0x7f06c81398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 >> 172.21.15.114:0/3625846606 conn(0x7f06c80c9730 msgr2=0x7f06c813dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 shutdown_connections 2024-05-09T00:08:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:08:59.824+0000 7f06ce800640 1 -- 172.21.15.114:0/3625846606 wait complete. 2024-05-09T00:08:59.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:00.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.108+0000 7f8b83a00640 1 Processor -- start 2024-05-09T00:09:00.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.108+0000 7f8b83a00640 1 -- start start 2024-05-09T00:09:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.110+0000 7f8b83a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8b7c0c43c0 0x7f8b7c153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.110+0000 7f8b83a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b7c159830 0x7f8b7c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.110+0000 7f8b83a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7c156bb0 con 0x7f8b7c15a180 2024-05-09T00:09:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.110+0000 7f8b83a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7c0ac710 con 0x7f8b7c0c43c0 2024-05-09T00:09:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.110+0000 7f8b83a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7c156e90 con 0x7f8b7c159830 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8b7c0c43c0 0x7f8b7c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8b7c15a180 0x7f8b7c06f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53114/0 (socket says 172.21.15.114:53114) 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81a00640 1 -- 172.21.15.114:0/2914652326 learned_addr learned my addr 172.21.15.114:0/2914652326 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b73e00640 1 --2- 172.21.15.114:0/2914652326 >> v2:172.21.15.153:3300/0 conn(0x7f8b7c159830 0x7f8b7c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81000640 1 -- 172.21.15.114:0/2914652326 >> v2:172.21.15.153:3300/0 conn(0x7f8b7c159830 msgr2=0x7f8b7c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81000640 1 --2- 172.21.15.114:0/2914652326 >> v2:172.21.15.153:3300/0 conn(0x7f8b7c159830 0x7f8b7c159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81000640 1 -- 172.21.15.114:0/2914652326 >> v1:172.21.15.114:6789/0 conn(0x7f8b7c15a180 legacy=0x7f8b7c06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b7be00640 1 -- 172.21.15.114:0/2914652326 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168019351 0 0) 0x7f8b7c156bb0 con 0x7f8b7c15a180 2024-05-09T00:09:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.111+0000 7f8b81000640 1 -- 172.21.15.114:0/2914652326 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c0ac960 con 0x7f8b7c0c43c0 2024-05-09T00:09:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.113+0000 7f8b81000640 1 --2- 172.21.15.114:0/2914652326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c153760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0722f0 tx=0x7f8b6c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de81444e77691de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.113+0000 7f8b7be00640 1 -- 172.21.15.114:0/2914652326 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c037070 con 0x7f8b7c0c43c0 2024-05-09T00:09:00.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.113+0000 7f8b7be00640 1 -- 172.21.15.114:0/2914652326 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6c032440 con 0x7f8b7c0c43c0 2024-05-09T00:09:00.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.113+0000 7f8b7be00640 1 -- 172.21.15.114:0/2914652326 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c02ae60 con 0x7f8b7c0c43c0 2024-05-09T00:09:00.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 -- 172.21.15.114:0/2914652326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c0c43c0 msgr2=0x7f8b7c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 --2- 172.21.15.114:0/2914652326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c153760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0722f0 tx=0x7f8b6c02a110 comp rx=0 tx=0).stop 2024-05-09T00:09:00.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 -- 172.21.15.114:0/2914652326 shutdown_connections 2024-05-09T00:09:00.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 --2- 172.21.15.114:0/2914652326 >> v2:172.21.15.153:3300/0 conn(0x7f8b7c159830 0x7f8b7c159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 --2- 172.21.15.114:0/2914652326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c153760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 -- 172.21.15.114:0/2914652326 >> 172.21.15.114:0/2914652326 conn(0x7f8b7c06c680 msgr2=0x7f8b7c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:00.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 -- 172.21.15.114:0/2914652326 shutdown_connections 2024-05-09T00:09:00.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.114+0000 7f8b83a00640 1 -- 172.21.15.114:0/2914652326 wait complete. 2024-05-09T00:09:00.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.116+0000 7f8b83a00640 1 Processor -- start 2024-05-09T00:09:00.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.116+0000 7f8b83a00640 1 -- start start 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b83a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b83a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b7c159830 0x7f8b7c0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b83a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 0x7f8b7c148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b83a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c06fab0 con 0x7f8b7c15a180 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b83a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0ad3c0 con 0x7f8b7c0c43c0 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b83a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c06fc30 con 0x7f8b7c159830 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b81a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 0x7f8b7c148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b81a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 0x7f8b7c148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59142/0 (socket says 172.21.15.114:59142) 2024-05-09T00:09:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b81a00640 1 -- 172.21.15.114:0/3831213633 learned_addr learned my addr 172.21.15.114:0/3831213633 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b81000640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.118+0000 7f8b73e00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b7c159830 0x7f8b7c0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b81a00640 1 -- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b7c159830 msgr2=0x7f8b7c0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b81a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b7c159830 0x7f8b7c0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b81a00640 1 -- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b7c0c43c0 msgr2=0x7f8b7c155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b81a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b81a00640 1 -- 172.21.15.114:0/3831213633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c150a40 con 0x7f8b7c15a180 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b81a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 0x7f8b7c148790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c6b0 tx=0x7f8b7400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74018070 con 0x7f8b7c15a180 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b74004da0 con 0x7f8b7c15a180 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c1ebf90 con 0x7f8b7c15a180 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400a880 con 0x7f8b7c15a180 2024-05-09T00:09:00.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.119+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c155a30 con 0x7f8b7c15a180 2024-05-09T00:09:00.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.121+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c077430 con 0x7f8b7c15a180 2024-05-09T00:09:00.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.122+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b7401b070 con 0x7f8b7c15a180 2024-05-09T00:09:00.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.123+0000 7f8b79600640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b580762d0 0x7f8b580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.123+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f8b74096f40 con 0x7f8b7c15a180 2024-05-09T00:09:00.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.123+0000 7f8b81000640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b580762d0 0x7f8b580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.123+0000 7f8b81000640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b580762d0 0x7f8b580787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c034000 tx=0x7f8b6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:00.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.128+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8b74060570 con 0x7f8b7c15a180 2024-05-09T00:09:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.337+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b7c0c41a0 con 0x7f8b7c15a180 2024-05-09T00:09:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.339+0000 7f8b79600640 1 -- 172.21.15.114:0/3831213633 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7f8b7405fe70 con 0x7f8b7c15a180 2024-05-09T00:09:00.335 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b580762d0 msgr2=0x7f8b580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b580762d0 0x7f8b580787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c034000 tx=0x7f8b6c02e000 comp rx=0 tx=0).stop 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 msgr2=0x7f8b7c148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 0x7f8b7c148790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c6b0 tx=0x7f8b7400cb70 comp rx=0 tx=0).stop 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 shutdown_connections 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8b580762d0 0x7f8b580787e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b7c15a180 0x7f8b7c148790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b7c159830 0x7f8b7c0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 --2- 172.21.15.114:0/3831213633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b7c0c43c0 0x7f8b7c155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.342+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 >> 172.21.15.114:0/3831213633 conn(0x7f8b7c06c680 msgr2=0x7f8b7c152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.343+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 shutdown_connections 2024-05-09T00:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.343+0000 7f8b83a00640 1 -- 172.21.15.114:0/3831213633 wait complete. 2024-05-09T00:09:00.366 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T00:09:00.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:00.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.643+0000 7ff82ce00640 1 Processor -- start 2024-05-09T00:09:00.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.643+0000 7ff82ce00640 1 -- start start 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.645+0000 7ff82ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8280aba00 0x7ff8280accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.645+0000 7ff82ce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8280ad340 con 0x7ff828156b00 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.645+0000 7ff82ce00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff828155f10 con 0x7ff8281566f0 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.645+0000 7ff82ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff828156260 con 0x7ff8280aba00 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.646+0000 7ff827e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff828156b00 0x7ff8280aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53116/0 (socket says 172.21.15.114:53116) 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.646+0000 7ff827e00640 1 -- 172.21.15.114:0/1523129516 learned_addr learned my addr 172.21.15.114:0/1523129516 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:00.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.646+0000 7ff827400640 1 --2- 172.21.15.114:0/1523129516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8280aba00 0x7ff8280accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.646+0000 7ff826a00640 1 -- 172.21.15.114:0/1523129516 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261307386 0 0) 0x7ff8280ad340 con 0x7ff828156b00 2024-05-09T00:09:00.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.646+0000 7ff826a00640 1 -- 172.21.15.114:0/1523129516 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff80c003520 con 0x7ff828156b00 2024-05-09T00:09:00.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.647+0000 7ff827400640 1 -- 172.21.15.114:0/1523129516 >> v1:172.21.15.153:6789/0 conn(0x7ff8281566f0 legacy=0x7ff8280ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.647+0000 7ff827400640 1 -- 172.21.15.114:0/1523129516 >> v1:172.21.15.114:6789/0 conn(0x7ff828156b00 legacy=0x7ff8280aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.647+0000 7ff827400640 1 -- 172.21.15.114:0/1523129516 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8280c4f40 con 0x7ff8280aba00 2024-05-09T00:09:00.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.648+0000 7ff827400640 1 --2- 172.21.15.114:0/1523129516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8280aba00 0x7ff8280accb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8180097d0 tx=0x7ff81802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ebc67e42ba10b44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:00.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.649+0000 7ff826a00640 1 -- 172.21.15.114:0/1523129516 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818037070 con 0x7ff8280aba00 2024-05-09T00:09:00.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.649+0000 7ff826a00640 1 -- 172.21.15.114:0/1523129516 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff818032440 con 0x7ff8280aba00 2024-05-09T00:09:00.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.649+0000 7ff826a00640 1 -- 172.21.15.114:0/1523129516 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818032810 con 0x7ff8280aba00 2024-05-09T00:09:00.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 -- 172.21.15.114:0/1523129516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8280aba00 msgr2=0x7ff8280accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 --2- 172.21.15.114:0/1523129516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8280aba00 0x7ff8280accb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8180097d0 tx=0x7ff81802a200 comp rx=0 tx=0).stop 2024-05-09T00:09:00.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 -- 172.21.15.114:0/1523129516 shutdown_connections 2024-05-09T00:09:00.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 --2- 172.21.15.114:0/1523129516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8280aba00 0x7ff8280accb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 -- 172.21.15.114:0/1523129516 >> 172.21.15.114:0/1523129516 conn(0x7ff8280c9730 msgr2=0x7ff8280c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:00.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 -- 172.21.15.114:0/1523129516 shutdown_connections 2024-05-09T00:09:00.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.650+0000 7ff82ce00640 1 -- 172.21.15.114:0/1523129516 wait complete. 2024-05-09T00:09:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.652+0000 7ff82ce00640 1 Processor -- start 2024-05-09T00:09:00.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.652+0000 7ff82ce00640 1 -- start start 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff82ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8280aba00 0x7ff8281e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff82ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 0x7ff8281dff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff82ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff828156b00 0x7ff8281f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff82ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff82813e830 con 0x7ff8281566f0 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff82ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff8280c4920 con 0x7ff8280aba00 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff82ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff82813e9b0 con 0x7ff828156b00 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 0x7ff8281dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 0x7ff8281dff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59156/0 (socket says 172.21.15.114:59156) 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 -- 172.21.15.114:0/270350580 learned_addr learned my addr 172.21.15.114:0/270350580 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff827400640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8280aba00 0x7ff8281e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff827e00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff828156b00 0x7ff8281f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 -- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff828156b00 msgr2=0x7ff8281f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff828156b00 0x7ff8281f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 -- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8280aba00 msgr2=0x7ff8281e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8280aba00 0x7ff8281e1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff81ea00640 1 -- 172.21.15.114:0/270350580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8281e1e80 con 0x7ff8281566f0 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff827400640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8280aba00 0x7ff8281e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.654+0000 7ff827e00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff828156b00 0x7ff8281f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.655+0000 7ff81ea00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 0x7ff8281dff80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c3a0 tx=0x7ff81000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.655+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810017070 con 0x7ff8281566f0 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.655+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8100052d0 con 0x7ff8281566f0 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.655+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8281f2350 con 0x7ff8281566f0 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.655+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810003810 con 0x7ff8281566f0 2024-05-09T00:09:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.655+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8280c7070 con 0x7ff8281566f0 2024-05-09T00:09:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.656+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff828078430 con 0x7ff8281566f0 2024-05-09T00:09:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.657+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff81001a070 con 0x7ff8281566f0 2024-05-09T00:09:00.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.658+0000 7ff81fe00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff804076300 0x7ff804078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:00.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.659+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ff810096c40 con 0x7ff8281566f0 2024-05-09T00:09:00.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.659+0000 7ff827400640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff804076300 0x7ff804078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:00.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.659+0000 7ff827400640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff804076300 0x7ff804078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff818034000 tx=0x7ff81802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:00.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.663+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8281e1e80 con 0x7ff8281566f0 2024-05-09T00:09:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.869+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8280c4b80 con 0x7ff804076300 2024-05-09T00:09:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.912+0000 7ff81fe00640 1 -- 172.21.15.114:0/270350580 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490388 (secure 0 0 0) 0x7ff8280c4b80 con 0x7ff804076300 2024-05-09T00:09:00.914 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:00.918 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff804076300 msgr2=0x7ff804078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff804076300 0x7ff804078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff818034000 tx=0x7ff81802e000 comp rx=0 tx=0).stop 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 msgr2=0x7ff8281dff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 0x7ff8281dff80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c3a0 tx=0x7ff81000c860 comp rx=0 tx=0).stop 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 shutdown_connections 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff804076300 0x7ff804078810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff828156b00 0x7ff8281f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8281566f0 0x7ff8281dff80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 --2- 172.21.15.114:0/270350580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8280aba00 0x7ff8281e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 >> 172.21.15.114:0/270350580 conn(0x7ff8280c9730 msgr2=0x7ff82806fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 shutdown_connections 2024-05-09T00:09:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:00.923+0000 7ff82ce00640 1 -- 172.21.15.114:0/270350580 wait complete. 2024-05-09T00:09:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-09T00:09:00.290393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":351,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3457024,"data_stored":2013114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.108490"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.189983+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:55.189983+0000","last_peered":"2024-05-09T00:08:55.189983+0000","last_clean":"2024-05-09T00:08:55.189983+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:55.189983+0000","last_undegraded":"2024-05-09T00:08:55.189983+0000","last_fullsized":"2024-05-09T00:08:55.189983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.229701+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:55.229701+0000","last_peered":"2024-05-09T00:08:55.229701+0000","last_clean":"2024-05-09T00:08:55.229701+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:55.229701+0000","last_undegraded":"2024-05-09T00:08:55.229701+0000","last_fullsized":"2024-05-09T00:08:55.229701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190973+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:55.190973+0000","last_peered":"2024-05-09T00:08:55.190973+0000","last_clean":"2024-05-09T00:08:55.190973+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:55.190973+0000","last_undegraded":"2024-05-09T00:08:55.190973+0000","last_fullsized":"2024-05-09T00:08:55.190973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222008+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:55.222008+0000","last_peered":"2024-05-09T00:08:55.222008+0000","last_clean":"2024-05-09T00:08:55.222008+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:55.222008+0000","last_undegraded":"2024-05-09T00:08:55.222008+0000","last_fullsized":"2024-05-09T00:08:55.222008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:31.404880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222902+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:55.222902+0000","last_peered":"2024-05-09T00:08:55.222902+0000","last_clean":"2024-05-09T00:08:55.222902+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:55.222902+0000","last_undegraded":"2024-05-09T00:08:55.222902+0000","last_fullsized":"2024-05-09T00:08:55.222902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190547+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:55.190547+0000","last_peered":"2024-05-09T00:08:55.190547+0000","last_clean":"2024-05-09T00:08:55.190547+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:55.190547+0000","last_undegraded":"2024-05-09T00:08:55.190547+0000","last_fullsized":"2024-05-09T00:08:55.190547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222389+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:55.222389+0000","last_peered":"2024-05-09T00:08:55.222389+0000","last_clean":"2024-05-09T00:08:55.222389+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:55.222389+0000","last_undegraded":"2024-05-09T00:08:55.222389+0000","last_fullsized":"2024-05-09T00:08:55.222389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221765+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:55.221765+0000","last_peered":"2024-05-09T00:08:55.221765+0000","last_clean":"2024-05-09T00:08:55.221765+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:55.221765+0000","last_undegraded":"2024-05-09T00:08:55.221765+0000","last_fullsized":"2024-05-09T00:08:55.221765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.230490+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:55.230490+0000","last_peered":"2024-05-09T00:08:55.230490+0000","last_clean":"2024-05-09T00:08:55.230490+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:55.230490+0000","last_undegraded":"2024-05-09T00:08:55.230490+0000","last_fullsized":"2024-05-09T00:08:55.230490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190175+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:55.190175+0000","last_peered":"2024-05-09T00:08:55.190175+0000","last_clean":"2024-05-09T00:08:55.190175+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:55.190175+0000","last_undegraded":"2024-05-09T00:08:55.190175+0000","last_fullsized":"2024-05-09T00:08:55.190175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.246625+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:55.246625+0000","last_peered":"2024-05-09T00:08:55.246625+0000","last_clean":"2024-05-09T00:08:55.246625+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:55.246625+0000","last_undegraded":"2024-05-09T00:08:55.246625+0000","last_fullsized":"2024-05-09T00:08:55.246625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:22.647491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192589+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:55.192589+0000","last_peered":"2024-05-09T00:08:55.192589+0000","last_clean":"2024-05-09T00:08:55.192589+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:55.192589+0000","last_undegraded":"2024-05-09T00:08:55.192589+0000","last_fullsized":"2024-05-09T00:08:55.192589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221207+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:55.221207+0000","last_peered":"2024-05-09T00:08:55.221207+0000","last_clean":"2024-05-09T00:08:55.221207+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:55.221207+0000","last_undegraded":"2024-05-09T00:08:55.221207+0000","last_fullsized":"2024-05-09T00:08:55.221207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.239243+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:55.239243+0000","last_peered":"2024-05-09T00:08:55.239243+0000","last_clean":"2024-05-09T00:08:55.239243+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:55.239243+0000","last_undegraded":"2024-05-09T00:08:55.239243+0000","last_fullsized":"2024-05-09T00:08:55.239243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:02.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190557+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:55.190557+0000","last_peered":"2024-05-09T00:08:55.190557+0000","last_clean":"2024-05-09T00:08:55.190557+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:55.190557+0000","last_undegraded":"2024-05-09T00:08:55.190557+0000","last_fullsized":"2024-05-09T00:08:55.190557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222827+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:55.222827+0000","last_peered":"2024-05-09T00:08:55.222827+0000","last_clean":"2024-05-09T00:08:55.222827+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:55.222827+0000","last_undegraded":"2024-05-09T00:08:55.222827+0000","last_fullsized":"2024-05-09T00:08:55.222827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.228382+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:55.228382+0000","last_peered":"2024-05-09T00:08:55.228382+0000","last_clean":"2024-05-09T00:08:55.228382+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:55.228382+0000","last_undegraded":"2024-05-09T00:08:55.228382+0000","last_fullsized":"2024-05-09T00:08:55.228382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192215+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:55.192215+0000","last_peered":"2024-05-09T00:08:55.192215+0000","last_clean":"2024-05-09T00:08:55.192215+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:55.192215+0000","last_undegraded":"2024-05-09T00:08:55.192215+0000","last_fullsized":"2024-05-09T00:08:55.192215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.228525+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:55.228525+0000","last_peered":"2024-05-09T00:08:55.228525+0000","last_clean":"2024-05-09T00:08:55.228525+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:55.228525+0000","last_undegraded":"2024-05-09T00:08:55.228525+0000","last_fullsized":"2024-05-09T00:08:55.228525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.225157+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:55.225157+0000","last_peered":"2024-05-09T00:08:55.225157+0000","last_clean":"2024-05-09T00:08:55.225157+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:55.225157+0000","last_undegraded":"2024-05-09T00:08:55.225157+0000","last_fullsized":"2024-05-09T00:08:55.225157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391402+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:08:57.391402+0000","last_peered":"2024-05-09T00:08:57.391402+0000","last_clean":"2024-05-09T00:08:57.391402+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:08:57.391402+0000","last_undegraded":"2024-05-09T00:08:57.391402+0000","last_fullsized":"2024-05-09T00:08:57.391402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.229587+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:55.229587+0000","last_peered":"2024-05-09T00:08:55.229587+0000","last_clean":"2024-05-09T00:08:55.229587+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:55.229587+0000","last_undegraded":"2024-05-09T00:08:55.229587+0000","last_fullsized":"2024-05-09T00:08:55.229587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192517+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:08:55.192517+0000","last_peered":"2024-05-09T00:08:55.192517+0000","last_clean":"2024-05-09T00:08:55.192517+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:08:55.192517+0000","last_undegraded":"2024-05-09T00:08:55.192517+0000","last_fullsized":"2024-05-09T00:08:55.192517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.230324+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:55.230324+0000","last_peered":"2024-05-09T00:08:55.230324+0000","last_clean":"2024-05-09T00:08:55.230324+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:55.230324+0000","last_undegraded":"2024-05-09T00:08:55.230324+0000","last_fullsized":"2024-05-09T00:08:55.230324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.223235+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:55.223235+0000","last_peered":"2024-05-09T00:08:55.223235+0000","last_clean":"2024-05-09T00:08:55.223235+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:55.223235+0000","last_undegraded":"2024-05-09T00:08:55.223235+0000","last_fullsized":"2024-05-09T00:08:55.223235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.211732+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:55.211732+0000","last_peered":"2024-05-09T00:08:55.211732+0000","last_clean":"2024-05-09T00:08:55.211732+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:55.211732+0000","last_undegraded":"2024-05-09T00:08:55.211732+0000","last_fullsized":"2024-05-09T00:08:55.211732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:32.724716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192091+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:55.192091+0000","last_peered":"2024-05-09T00:08:55.192091+0000","last_clean":"2024-05-09T00:08:55.192091+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:55.192091+0000","last_undegraded":"2024-05-09T00:08:55.192091+0000","last_fullsized":"2024-05-09T00:08:55.192091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221947+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:55.221947+0000","last_peered":"2024-05-09T00:08:55.221947+0000","last_clean":"2024-05-09T00:08:55.221947+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:55.221947+0000","last_undegraded":"2024-05-09T00:08:55.221947+0000","last_fullsized":"2024-05-09T00:08:55.221947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:10.340338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.247580+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:55.247580+0000","last_peered":"2024-05-09T00:08:55.247580+0000","last_clean":"2024-05-09T00:08:55.247580+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:55.247580+0000","last_undegraded":"2024-05-09T00:08:55.247580+0000","last_fullsized":"2024-05-09T00:08:55.247580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:41.915326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.191066+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:55.191066+0000","last_peered":"2024-05-09T00:08:55.191066+0000","last_clean":"2024-05-09T00:08:55.191066+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:55.191066+0000","last_undegraded":"2024-05-09T00:08:55.191066+0000","last_fullsized":"2024-05-09T00:08:55.191066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.212704+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:55.212704+0000","last_peered":"2024-05-09T00:08:55.212704+0000","last_clean":"2024-05-09T00:08:55.212704+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:55.212704+0000","last_undegraded":"2024-05-09T00:08:55.212704+0000","last_fullsized":"2024-05-09T00:08:55.212704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:47.637987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.246599+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:55.246599+0000","last_peered":"2024-05-09T00:08:55.246599+0000","last_clean":"2024-05-09T00:08:55.246599+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:55.246599+0000","last_undegraded":"2024-05-09T00:08:55.246599+0000","last_fullsized":"2024-05-09T00:08:55.246599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:51.286363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.246773+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:55.246773+0000","last_peered":"2024-05-09T00:08:55.246773+0000","last_clean":"2024-05-09T00:08:55.246773+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:55.246773+0000","last_undegraded":"2024-05-09T00:08:55.246773+0000","last_fullsized":"2024-05-09T00:08:55.246773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:03.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.191974+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:55.191974+0000","last_peered":"2024-05-09T00:08:55.191974+0000","last_clean":"2024-05-09T00:08:55.191974+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:55.191974+0000","last_undegraded":"2024-05-09T00:08:55.191974+0000","last_fullsized":"2024-05-09T00:08:55.191974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222046+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:55.222046+0000","last_peered":"2024-05-09T00:08:55.222046+0000","last_clean":"2024-05-09T00:08:55.222046+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:55.222046+0000","last_undegraded":"2024-05-09T00:08:55.222046+0000","last_fullsized":"2024-05-09T00:08:55.222046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:59.415721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.239550+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:55.239550+0000","last_peered":"2024-05-09T00:08:55.239550+0000","last_clean":"2024-05-09T00:08:55.239550+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:55.239550+0000","last_undegraded":"2024-05-09T00:08:55.239550+0000","last_fullsized":"2024-05-09T00:08:55.239550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:08.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222698+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:55.222698+0000","last_peered":"2024-05-09T00:08:55.222698+0000","last_clean":"2024-05-09T00:08:55.222698+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:55.222698+0000","last_undegraded":"2024-05-09T00:08:55.222698+0000","last_fullsized":"2024-05-09T00:08:55.222698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.235994+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:55.235994+0000","last_peered":"2024-05-09T00:08:55.235994+0000","last_clean":"2024-05-09T00:08:55.235994+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:55.235994+0000","last_undegraded":"2024-05-09T00:08:55.235994+0000","last_fullsized":"2024-05-09T00:08:55.235994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:24.036346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.235138+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:55.235138+0000","last_peered":"2024-05-09T00:08:55.235138+0000","last_clean":"2024-05-09T00:08:55.235138+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:55.235138+0000","last_undegraded":"2024-05-09T00:08:55.235138+0000","last_fullsized":"2024-05-09T00:08:55.235138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:38.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222660+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:55.222660+0000","last_peered":"2024-05-09T00:08:55.222660+0000","last_clean":"2024-05-09T00:08:55.222660+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:55.222660+0000","last_undegraded":"2024-05-09T00:08:55.222660+0000","last_fullsized":"2024-05-09T00:08:55.222660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.229473+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:55.229473+0000","last_peered":"2024-05-09T00:08:55.229473+0000","last_clean":"2024-05-09T00:08:55.229473+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:55.229473+0000","last_undegraded":"2024-05-09T00:08:55.229473+0000","last_fullsized":"2024-05-09T00:08:55.229473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.244557+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:55.244557+0000","last_peered":"2024-05-09T00:08:55.244557+0000","last_clean":"2024-05-09T00:08:55.244557+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:55.244557+0000","last_undegraded":"2024-05-09T00:08:55.244557+0000","last_fullsized":"2024-05-09T00:08:55.244557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:38.628998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.223025+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:55.223025+0000","last_peered":"2024-05-09T00:08:55.223025+0000","last_clean":"2024-05-09T00:08:55.223025+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:55.223025+0000","last_undegraded":"2024-05-09T00:08:55.223025+0000","last_fullsized":"2024-05-09T00:08:55.223025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.238905+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:55.238905+0000","last_peered":"2024-05-09T00:08:55.238905+0000","last_clean":"2024-05-09T00:08:55.238905+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:55.238905+0000","last_undegraded":"2024-05-09T00:08:55.238905+0000","last_fullsized":"2024-05-09T00:08:55.238905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:11:02.273799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.241121+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:55.241121+0000","last_peered":"2024-05-09T00:08:55.241121+0000","last_clean":"2024-05-09T00:08:55.241121+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:55.241121+0000","last_undegraded":"2024-05-09T00:08:55.241121+0000","last_fullsized":"2024-05-09T00:08:55.241121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:23.121838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.225024+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:55.225024+0000","last_peered":"2024-05-09T00:08:55.225024+0000","last_clean":"2024-05-09T00:08:55.225024+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:55.225024+0000","last_undegraded":"2024-05-09T00:08:55.225024+0000","last_fullsized":"2024-05-09T00:08:55.225024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.191700+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:55.191700+0000","last_peered":"2024-05-09T00:08:55.191700+0000","last_clean":"2024-05-09T00:08:55.191700+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:55.191700+0000","last_undegraded":"2024-05-09T00:08:55.191700+0000","last_fullsized":"2024-05-09T00:08:55.191700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221488+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:55.221488+0000","last_peered":"2024-05-09T00:08:55.221488+0000","last_clean":"2024-05-09T00:08:55.221488+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:55.221488+0000","last_undegraded":"2024-05-09T00:08:55.221488+0000","last_fullsized":"2024-05-09T00:08:55.221488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192225+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:55.192225+0000","last_peered":"2024-05-09T00:08:55.192225+0000","last_clean":"2024-05-09T00:08:55.192225+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:55.192225+0000","last_undegraded":"2024-05-09T00:08:55.192225+0000","last_fullsized":"2024-05-09T00:08:55.192225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.203654+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:55.203654+0000","last_peered":"2024-05-09T00:08:55.203654+0000","last_clean":"2024-05-09T00:08:55.203654+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:55.203654+0000","last_undegraded":"2024-05-09T00:08:55.203654+0000","last_fullsized":"2024-05-09T00:08:55.203654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:22.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.220813+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:55.220813+0000","last_peered":"2024-05-09T00:08:55.220813+0000","last_clean":"2024-05-09T00:08:55.220813+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:55.220813+0000","last_undegraded":"2024-05-09T00:08:55.220813+0000","last_fullsized":"2024-05-09T00:08:55.220813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:33.386688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.228284+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:55.228284+0000","last_peered":"2024-05-09T00:08:55.228284+0000","last_clean":"2024-05-09T00:08:55.228284+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:55.228284+0000","last_undegraded":"2024-05-09T00:08:55.228284+0000","last_fullsized":"2024-05-09T00:08:55.228284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":106231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":97658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":307200,"data_stored":108537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:00.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:01.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.279+0000 7f2fe1c00640 1 Processor -- start 2024-05-09T00:09:01.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.279+0000 7f2fe1c00640 1 -- start start 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fe1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 0x7f2fdc155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fe1c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2fdc0c53b0 0x7f2fdc0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fe1c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc0c3280 con 0x7f2fdc0c96a0 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fe1c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2fdc0c3b70 con 0x7f2fdc0c53b0 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fe1c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2fdc0c3520 con 0x7f2fdc0c4070 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fdb400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2fdc0c96a0 0x7f2fdc15bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53124/0 (socket says 172.21.15.114:53124) 2024-05-09T00:09:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.281+0000 7f2fdb400640 1 -- 172.21.15.114:0/792419808 learned_addr learned my addr 172.21.15.114:0/792419808 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fdaa00640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 0x7f2fdc155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fda000640 1 --2- 172.21.15.114:0/792419808 >> v2:172.21.15.153:3300/0 conn(0x7f2fdc0c53b0 0x7f2fdc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002824100 0 0) 0x7f2fdc0c3280 con 0x7f2fdc0c96a0 2024-05-09T00:09:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc0003520 con 0x7f2fdc0c96a0 2024-05-09T00:09:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 599201562 0 0) 0x7f2fc0003520 con 0x7f2fdc0c96a0 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 msgr2=0x7f2fdc155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 0x7f2fdc155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 >> v2:172.21.15.153:3300/0 conn(0x7f2fdc0c53b0 msgr2=0x7f2fdc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 --2- 172.21.15.114:0/792419808 >> v2:172.21.15.153:3300/0 conn(0x7f2fdc0c53b0 0x7f2fdc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc0c3800 con 0x7f2fdc0c96a0 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f2fd40016f0 con 0x7f2fdc0c96a0 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 >> v1:172.21.15.114:6789/0 conn(0x7f2fdc0c96a0 legacy=0x7f2fdc15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc0003a50 0x7f2fc0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 0x7f2fc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.282+0000 7f2fd9600640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0004d40 0x7f2fc0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0c3b70 con 0x7f2fc0004d40 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0c3520 con 0x7f2fc0003a50 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc000bb40 con 0x7f2fdc0c4070 2024-05-09T00:09:01.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdb400640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0004d40 0x7f2fc0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdaa00640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc0003a50 0x7f2fc0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fda000640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 0x7f2fc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdb400640 1 -- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 msgr2=0x7f2fc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdb400640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fdc0c4070 0x7f2fc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdb400640 1 -- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc0003a50 msgr2=0x7f2fc0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdb400640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc0003a50 0x7f2fc0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.283+0000 7f2fdb400640 1 -- 172.21.15.114:0/792419808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc0003520 con 0x7f2fc0004d40 2024-05-09T00:09:01.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.284+0000 7f2fdb400640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0004d40 0x7f2fc0005150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0c4600 tx=0x7f2fc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bbc9b2aa7f3fb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:01.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.284+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4007ce0 con 0x7f2fc0004d40 2024-05-09T00:09:01.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.284+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4005af0 con 0x7f2fc0004d40 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.284+0000 7f2fd9600640 1 -- 172.21.15.114:0/792419808 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4007070 con 0x7f2fc0004d40 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.285+0000 7f2fe1c00640 1 -- 172.21.15.114:0/792419808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0004d40 msgr2=0x7f2fc0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.285+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/792419808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0004d40 0x7f2fc0005150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0c4600 tx=0x7f2fc0005830 comp rx=0 tx=0).stop 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.285+0000 7f2fdb400640 1 -- 172.21.15.114:0/792419808 reap_dead start 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.285+0000 7f2fe1c00640 1 -- 172.21.15.114:0/792419808 shutdown_connections 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.285+0000 7f2fe1c00640 1 -- 172.21.15.114:0/792419808 >> 172.21.15.114:0/792419808 conn(0x7f2fdc0ac3b0 msgr2=0x7f2fdc06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.285+0000 7f2fe1c00640 1 -- 172.21.15.114:0/792419808 shutdown_connections 2024-05-09T00:09:01.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.286+0000 7f2fe1c00640 1 -- 172.21.15.114:0/792419808 wait complete. 2024-05-09T00:09:01.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.288+0000 7f2fe1c00640 1 Processor -- start 2024-05-09T00:09:01.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.288+0000 7f2fe1c00640 1 -- start start 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.289+0000 7f2fe1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fc0004d40 0x7f2fdc1e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.289+0000 7f2fe1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fdc1e4340 0x7f2fdc14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.289+0000 7f2fe1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 0x7f2fdc0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.289+0000 7f2fe1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc06ed90 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.289+0000 7f2fe1c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc06ec10 con 0x7f2fdc1e4340 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.289+0000 7f2fe1c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2fdc155b00 con 0x7f2fc0004d40 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 0x7f2fdc0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 0x7f2fdc0af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59168/0 (socket says 172.21.15.114:59168) 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 -- 172.21.15.114:0/1630137352 learned_addr learned my addr 172.21.15.114:0/1630137352 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdaa00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fc0004d40 0x7f2fdc1e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fda000640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fdc1e4340 0x7f2fdc14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 -- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fc0004d40 msgr2=0x7f2fdc1e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fc0004d40 0x7f2fdc1e3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 -- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fdc1e4340 msgr2=0x7f2fdc14d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fdc1e4340 0x7f2fdc14d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 -- 172.21.15.114:0/1630137352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc1e4890 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fda000640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fdc1e4340 0x7f2fdc14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:01.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.290+0000 7f2fdb400640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 0x7f2fdc0af0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c2d0 tx=0x7f2fdc0c5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.291+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4037040 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.291+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4041070 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.291+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4001bf0 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.291+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc1e5240 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.291+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc156d50 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.292+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fdc1e3550 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.293+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fd40072b0 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.295+0000 7f2fd2a00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fb8076300 0x7f2fb8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.295+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f2fd40b7950 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.295+0000 7f2fdaa00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fb8076300 0x7f2fb8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.296+0000 7f2fdaa00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fb8076300 0x7f2fb8078810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0720f0 tx=0x7f2fc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:01.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.300+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fd4080f70 con 0x7f2fdc0aecc0 2024-05-09T00:09:01.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.505+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fdc077430 con 0x7f2fb8076300 2024-05-09T00:09:01.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.541+0000 7f2fd2a00640 1 -- 172.21.15.114:0/1630137352 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490388 (secure 0 0 0) 0x7f2fdc077430 con 0x7f2fb8076300 2024-05-09T00:09:01.543 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:01.546 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.548+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fb8076300 msgr2=0x7f2fb8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.548+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fb8076300 0x7f2fb8078810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0720f0 tx=0x7f2fc4008040 comp rx=0 tx=0).stop 2024-05-09T00:09:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.548+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 msgr2=0x7f2fdc0af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.548+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 0x7f2fdc0af0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c2d0 tx=0x7f2fdc0c5e00 comp rx=0 tx=0).stop 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 shutdown_connections 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fb8076300 0x7f2fb8078810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0aecc0 0x7f2fdc0af0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fdc1e4340 0x7f2fdc14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 --2- 172.21.15.114:0/1630137352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fc0004d40 0x7f2fdc1e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 >> 172.21.15.114:0/1630137352 conn(0x7f2fdc0ac3b0 msgr2=0x7f2fdc0c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 shutdown_connections 2024-05-09T00:09:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.551+0000 7f2fe1c00640 1 -- 172.21.15.114:0/1630137352 wait complete. 2024-05-09T00:09:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-09T00:09:00.290393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":351,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3457024,"data_stored":2013114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.108490"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.189983+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:55.189983+0000","last_peered":"2024-05-09T00:08:55.189983+0000","last_clean":"2024-05-09T00:08:55.189983+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:55.189983+0000","last_undegraded":"2024-05-09T00:08:55.189983+0000","last_fullsized":"2024-05-09T00:08:55.189983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.229701+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:55.229701+0000","last_peered":"2024-05-09T00:08:55.229701+0000","last_clean":"2024-05-09T00:08:55.229701+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:55.229701+0000","last_undegraded":"2024-05-09T00:08:55.229701+0000","last_fullsized":"2024-05-09T00:08:55.229701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190973+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:55.190973+0000","last_peered":"2024-05-09T00:08:55.190973+0000","last_clean":"2024-05-09T00:08:55.190973+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:55.190973+0000","last_undegraded":"2024-05-09T00:08:55.190973+0000","last_fullsized":"2024-05-09T00:08:55.190973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222008+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:55.222008+0000","last_peered":"2024-05-09T00:08:55.222008+0000","last_clean":"2024-05-09T00:08:55.222008+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:55.222008+0000","last_undegraded":"2024-05-09T00:08:55.222008+0000","last_fullsized":"2024-05-09T00:08:55.222008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:31.404880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222902+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:55.222902+0000","last_peered":"2024-05-09T00:08:55.222902+0000","last_clean":"2024-05-09T00:08:55.222902+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:55.222902+0000","last_undegraded":"2024-05-09T00:08:55.222902+0000","last_fullsized":"2024-05-09T00:08:55.222902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190547+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:55.190547+0000","last_peered":"2024-05-09T00:08:55.190547+0000","last_clean":"2024-05-09T00:08:55.190547+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:55.190547+0000","last_undegraded":"2024-05-09T00:08:55.190547+0000","last_fullsized":"2024-05-09T00:08:55.190547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222389+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:55.222389+0000","last_peered":"2024-05-09T00:08:55.222389+0000","last_clean":"2024-05-09T00:08:55.222389+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:55.222389+0000","last_undegraded":"2024-05-09T00:08:55.222389+0000","last_fullsized":"2024-05-09T00:08:55.222389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221765+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:55.221765+0000","last_peered":"2024-05-09T00:08:55.221765+0000","last_clean":"2024-05-09T00:08:55.221765+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:55.221765+0000","last_undegraded":"2024-05-09T00:08:55.221765+0000","last_fullsized":"2024-05-09T00:08:55.221765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.230490+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:55.230490+0000","last_peered":"2024-05-09T00:08:55.230490+0000","last_clean":"2024-05-09T00:08:55.230490+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:55.230490+0000","last_undegraded":"2024-05-09T00:08:55.230490+0000","last_fullsized":"2024-05-09T00:08:55.230490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190175+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:55.190175+0000","last_peered":"2024-05-09T00:08:55.190175+0000","last_clean":"2024-05-09T00:08:55.190175+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:55.190175+0000","last_undegraded":"2024-05-09T00:08:55.190175+0000","last_fullsized":"2024-05-09T00:08:55.190175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.246625+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:55.246625+0000","last_peered":"2024-05-09T00:08:55.246625+0000","last_clean":"2024-05-09T00:08:55.246625+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:55.246625+0000","last_undegraded":"2024-05-09T00:08:55.246625+0000","last_fullsized":"2024-05-09T00:08:55.246625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:22.647491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192589+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:55.192589+0000","last_peered":"2024-05-09T00:08:55.192589+0000","last_clean":"2024-05-09T00:08:55.192589+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:55.192589+0000","last_undegraded":"2024-05-09T00:08:55.192589+0000","last_fullsized":"2024-05-09T00:08:55.192589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221207+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:55.221207+0000","last_peered":"2024-05-09T00:08:55.221207+0000","last_clean":"2024-05-09T00:08:55.221207+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:55.221207+0000","last_undegraded":"2024-05-09T00:08:55.221207+0000","last_fullsized":"2024-05-09T00:08:55.221207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.239243+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:55.239243+0000","last_peered":"2024-05-09T00:08:55.239243+0000","last_clean":"2024-05-09T00:08:55.239243+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:55.239243+0000","last_undegraded":"2024-05-09T00:08:55.239243+0000","last_fullsized":"2024-05-09T00:08:55.239243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:02.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.190557+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:55.190557+0000","last_peered":"2024-05-09T00:08:55.190557+0000","last_clean":"2024-05-09T00:08:55.190557+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:55.190557+0000","last_undegraded":"2024-05-09T00:08:55.190557+0000","last_fullsized":"2024-05-09T00:08:55.190557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222827+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:55.222827+0000","last_peered":"2024-05-09T00:08:55.222827+0000","last_clean":"2024-05-09T00:08:55.222827+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:55.222827+0000","last_undegraded":"2024-05-09T00:08:55.222827+0000","last_fullsized":"2024-05-09T00:08:55.222827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.228382+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:55.228382+0000","last_peered":"2024-05-09T00:08:55.228382+0000","last_clean":"2024-05-09T00:08:55.228382+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:55.228382+0000","last_undegraded":"2024-05-09T00:08:55.228382+0000","last_fullsized":"2024-05-09T00:08:55.228382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192215+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:55.192215+0000","last_peered":"2024-05-09T00:08:55.192215+0000","last_clean":"2024-05-09T00:08:55.192215+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:55.192215+0000","last_undegraded":"2024-05-09T00:08:55.192215+0000","last_fullsized":"2024-05-09T00:08:55.192215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.228525+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:55.228525+0000","last_peered":"2024-05-09T00:08:55.228525+0000","last_clean":"2024-05-09T00:08:55.228525+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:55.228525+0000","last_undegraded":"2024-05-09T00:08:55.228525+0000","last_fullsized":"2024-05-09T00:08:55.228525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.225157+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:55.225157+0000","last_peered":"2024-05-09T00:08:55.225157+0000","last_clean":"2024-05-09T00:08:55.225157+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:55.225157+0000","last_undegraded":"2024-05-09T00:08:55.225157+0000","last_fullsized":"2024-05-09T00:08:55.225157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391402+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:08:57.391402+0000","last_peered":"2024-05-09T00:08:57.391402+0000","last_clean":"2024-05-09T00:08:57.391402+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:08:57.391402+0000","last_undegraded":"2024-05-09T00:08:57.391402+0000","last_fullsized":"2024-05-09T00:08:57.391402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.229587+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:55.229587+0000","last_peered":"2024-05-09T00:08:55.229587+0000","last_clean":"2024-05-09T00:08:55.229587+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:55.229587+0000","last_undegraded":"2024-05-09T00:08:55.229587+0000","last_fullsized":"2024-05-09T00:08:55.229587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192517+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:08:55.192517+0000","last_peered":"2024-05-09T00:08:55.192517+0000","last_clean":"2024-05-09T00:08:55.192517+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:08:55.192517+0000","last_undegraded":"2024-05-09T00:08:55.192517+0000","last_fullsized":"2024-05-09T00:08:55.192517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.230324+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:55.230324+0000","last_peered":"2024-05-09T00:08:55.230324+0000","last_clean":"2024-05-09T00:08:55.230324+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:55.230324+0000","last_undegraded":"2024-05-09T00:08:55.230324+0000","last_fullsized":"2024-05-09T00:08:55.230324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.223235+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:55.223235+0000","last_peered":"2024-05-09T00:08:55.223235+0000","last_clean":"2024-05-09T00:08:55.223235+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:55.223235+0000","last_undegraded":"2024-05-09T00:08:55.223235+0000","last_fullsized":"2024-05-09T00:08:55.223235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.211732+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:55.211732+0000","last_peered":"2024-05-09T00:08:55.211732+0000","last_clean":"2024-05-09T00:08:55.211732+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:55.211732+0000","last_undegraded":"2024-05-09T00:08:55.211732+0000","last_fullsized":"2024-05-09T00:08:55.211732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:32.724716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192091+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:55.192091+0000","last_peered":"2024-05-09T00:08:55.192091+0000","last_clean":"2024-05-09T00:08:55.192091+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:55.192091+0000","last_undegraded":"2024-05-09T00:08:55.192091+0000","last_fullsized":"2024-05-09T00:08:55.192091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221947+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:55.221947+0000","last_peered":"2024-05-09T00:08:55.221947+0000","last_clean":"2024-05-09T00:08:55.221947+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:55.221947+0000","last_undegraded":"2024-05-09T00:08:55.221947+0000","last_fullsized":"2024-05-09T00:08:55.221947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:10.340338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.247580+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:55.247580+0000","last_peered":"2024-05-09T00:08:55.247580+0000","last_clean":"2024-05-09T00:08:55.247580+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:55.247580+0000","last_undegraded":"2024-05-09T00:08:55.247580+0000","last_fullsized":"2024-05-09T00:08:55.247580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:41.915326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.191066+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:55.191066+0000","last_peered":"2024-05-09T00:08:55.191066+0000","last_clean":"2024-05-09T00:08:55.191066+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:55.191066+0000","last_undegraded":"2024-05-09T00:08:55.191066+0000","last_fullsized":"2024-05-09T00:08:55.191066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.212704+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:55.212704+0000","last_peered":"2024-05-09T00:08:55.212704+0000","last_clean":"2024-05-09T00:08:55.212704+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:55.212704+0000","last_undegraded":"2024-05-09T00:08:55.212704+0000","last_fullsized":"2024-05-09T00:08:55.212704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:47.637987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.246599+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:55.246599+0000","last_peered":"2024-05-09T00:08:55.246599+0000","last_clean":"2024-05-09T00:08:55.246599+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:55.246599+0000","last_undegraded":"2024-05-09T00:08:55.246599+0000","last_fullsized":"2024-05-09T00:08:55.246599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:51.286363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.246773+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:55.246773+0000","last_peered":"2024-05-09T00:08:55.246773+0000","last_clean":"2024-05-09T00:08:55.246773+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:55.246773+0000","last_undegraded":"2024-05-09T00:08:55.246773+0000","last_fullsized":"2024-05-09T00:08:55.246773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:03.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.191974+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:55.191974+0000","last_peered":"2024-05-09T00:08:55.191974+0000","last_clean":"2024-05-09T00:08:55.191974+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:55.191974+0000","last_undegraded":"2024-05-09T00:08:55.191974+0000","last_fullsized":"2024-05-09T00:08:55.191974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222046+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:55.222046+0000","last_peered":"2024-05-09T00:08:55.222046+0000","last_clean":"2024-05-09T00:08:55.222046+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:55.222046+0000","last_undegraded":"2024-05-09T00:08:55.222046+0000","last_fullsized":"2024-05-09T00:08:55.222046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:59.415721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.239550+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:55.239550+0000","last_peered":"2024-05-09T00:08:55.239550+0000","last_clean":"2024-05-09T00:08:55.239550+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:55.239550+0000","last_undegraded":"2024-05-09T00:08:55.239550+0000","last_fullsized":"2024-05-09T00:08:55.239550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:08.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222698+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:55.222698+0000","last_peered":"2024-05-09T00:08:55.222698+0000","last_clean":"2024-05-09T00:08:55.222698+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:55.222698+0000","last_undegraded":"2024-05-09T00:08:55.222698+0000","last_fullsized":"2024-05-09T00:08:55.222698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.235994+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:55.235994+0000","last_peered":"2024-05-09T00:08:55.235994+0000","last_clean":"2024-05-09T00:08:55.235994+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:55.235994+0000","last_undegraded":"2024-05-09T00:08:55.235994+0000","last_fullsized":"2024-05-09T00:08:55.235994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:24.036346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.235138+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:55.235138+0000","last_peered":"2024-05-09T00:08:55.235138+0000","last_clean":"2024-05-09T00:08:55.235138+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:55.235138+0000","last_undegraded":"2024-05-09T00:08:55.235138+0000","last_fullsized":"2024-05-09T00:08:55.235138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:38.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.222660+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:55.222660+0000","last_peered":"2024-05-09T00:08:55.222660+0000","last_clean":"2024-05-09T00:08:55.222660+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:55.222660+0000","last_undegraded":"2024-05-09T00:08:55.222660+0000","last_fullsized":"2024-05-09T00:08:55.222660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.229473+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:55.229473+0000","last_peered":"2024-05-09T00:08:55.229473+0000","last_clean":"2024-05-09T00:08:55.229473+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:55.229473+0000","last_undegraded":"2024-05-09T00:08:55.229473+0000","last_fullsized":"2024-05-09T00:08:55.229473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.244557+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:55.244557+0000","last_peered":"2024-05-09T00:08:55.244557+0000","last_clean":"2024-05-09T00:08:55.244557+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:55.244557+0000","last_undegraded":"2024-05-09T00:08:55.244557+0000","last_fullsized":"2024-05-09T00:08:55.244557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:38.628998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.223025+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:55.223025+0000","last_peered":"2024-05-09T00:08:55.223025+0000","last_clean":"2024-05-09T00:08:55.223025+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:55.223025+0000","last_undegraded":"2024-05-09T00:08:55.223025+0000","last_fullsized":"2024-05-09T00:08:55.223025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.238905+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:55.238905+0000","last_peered":"2024-05-09T00:08:55.238905+0000","last_clean":"2024-05-09T00:08:55.238905+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:55.238905+0000","last_undegraded":"2024-05-09T00:08:55.238905+0000","last_fullsized":"2024-05-09T00:08:55.238905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:11:02.273799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.241121+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:55.241121+0000","last_peered":"2024-05-09T00:08:55.241121+0000","last_clean":"2024-05-09T00:08:55.241121+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:55.241121+0000","last_undegraded":"2024-05-09T00:08:55.241121+0000","last_fullsized":"2024-05-09T00:08:55.241121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:23.121838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.225024+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:55.225024+0000","last_peered":"2024-05-09T00:08:55.225024+0000","last_clean":"2024-05-09T00:08:55.225024+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:55.225024+0000","last_undegraded":"2024-05-09T00:08:55.225024+0000","last_fullsized":"2024-05-09T00:08:55.225024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.191700+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:55.191700+0000","last_peered":"2024-05-09T00:08:55.191700+0000","last_clean":"2024-05-09T00:08:55.191700+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:55.191700+0000","last_undegraded":"2024-05-09T00:08:55.191700+0000","last_fullsized":"2024-05-09T00:08:55.191700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.221488+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:55.221488+0000","last_peered":"2024-05-09T00:08:55.221488+0000","last_clean":"2024-05-09T00:08:55.221488+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:55.221488+0000","last_undegraded":"2024-05-09T00:08:55.221488+0000","last_fullsized":"2024-05-09T00:08:55.221488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.192225+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:55.192225+0000","last_peered":"2024-05-09T00:08:55.192225+0000","last_clean":"2024-05-09T00:08:55.192225+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:55.192225+0000","last_undegraded":"2024-05-09T00:08:55.192225+0000","last_fullsized":"2024-05-09T00:08:55.192225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.203654+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:55.203654+0000","last_peered":"2024-05-09T00:08:55.203654+0000","last_clean":"2024-05-09T00:08:55.203654+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:55.203654+0000","last_undegraded":"2024-05-09T00:08:55.203654+0000","last_fullsized":"2024-05-09T00:08:55.203654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:22.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.220813+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:55.220813+0000","last_peered":"2024-05-09T00:08:55.220813+0000","last_clean":"2024-05-09T00:08:55.220813+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:55.220813+0000","last_undegraded":"2024-05-09T00:08:55.220813+0000","last_fullsized":"2024-05-09T00:08:55.220813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:33.386688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T00:08:55.228284+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:55.228284+0000","last_peered":"2024-05-09T00:08:55.228284+0000","last_clean":"2024-05-09T00:08:55.228284+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:55.228284+0000","last_undegraded":"2024-05-09T00:08:55.228284+0000","last_fullsized":"2024-05-09T00:08:55.228284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":106231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":97658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":307200,"data_stored":108537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:01.579 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T00:09:01.579 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T00:09:01.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T00:09:01.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T00:09:01.580 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T00:09:01.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.894+0000 7f1099200640 1 Processor -- start 2024-05-09T00:09:01.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.894+0000 7f1099200640 1 -- start start 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1099200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1094073510 0x7f109414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1099200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10940ae880 0x7f10940aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1099200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940ac210 con 0x7f10940af1d0 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1099200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1094073e20 con 0x7f1094073510 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1099200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f10940abf30 con 0x7f10940ae880 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1093400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1094073510 0x7f109414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1093400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1094073510 0x7f109414ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59182/0 (socket says 172.21.15.114:59182) 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1093400640 1 -- 172.21.15.114:0/3521891259 learned_addr learned my addr 172.21.15.114:0/3521891259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f108aa00640 1 --2- 172.21.15.114:0/3521891259 >> v2:172.21.15.153:3300/0 conn(0x7f10940ae880 0x7f10940aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1093400640 1 -- 172.21.15.114:0/3521891259 >> v2:172.21.15.153:3300/0 conn(0x7f10940ae880 msgr2=0x7f10940aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1093400640 1 --2- 172.21.15.114:0/3521891259 >> v2:172.21.15.153:3300/0 conn(0x7f10940ae880 0x7f10940aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.897+0000 7f1093400640 1 -- 172.21.15.114:0/3521891259 >> v1:172.21.15.153:6789/0 conn(0x7f10940af1d0 legacy=0x7f10940c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.898+0000 7f1093400640 1 -- 172.21.15.114:0/3521891259 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1094155830 con 0x7f1094073510 2024-05-09T00:09:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.899+0000 7f1093400640 1 --2- 172.21.15.114:0/3521891259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1094073510 0x7f109414ed80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1094071020 tx=0x7f108402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a620f71b63fcf666 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.899+0000 7f1092a00640 1 -- 172.21.15.114:0/3521891259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084037070 con 0x7f1094073510 2024-05-09T00:09:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.899+0000 7f1092a00640 1 -- 172.21.15.114:0/3521891259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108402ae00 con 0x7f1094073510 2024-05-09T00:09:01.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.899+0000 7f1092a00640 1 -- 172.21.15.114:0/3521891259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084032660 con 0x7f1094073510 2024-05-09T00:09:01.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 -- 172.21.15.114:0/3521891259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1094073510 msgr2=0x7f109414ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 --2- 172.21.15.114:0/3521891259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1094073510 0x7f109414ed80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1094071020 tx=0x7f108402a0b0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 -- 172.21.15.114:0/3521891259 shutdown_connections 2024-05-09T00:09:01.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 --2- 172.21.15.114:0/3521891259 >> v2:172.21.15.153:3300/0 conn(0x7f10940ae880 0x7f10940aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 --2- 172.21.15.114:0/3521891259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1094073510 0x7f109414ed80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 -- 172.21.15.114:0/3521891259 >> 172.21.15.114:0/3521891259 conn(0x7f10940c9730 msgr2=0x7f10940c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:01.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 -- 172.21.15.114:0/3521891259 shutdown_connections 2024-05-09T00:09:01.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.900+0000 7f1099200640 1 -- 172.21.15.114:0/3521891259 wait complete. 2024-05-09T00:09:01.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.902+0000 7f1099200640 1 Processor -- start 2024-05-09T00:09:01.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.902+0000 7f1099200640 1 -- start start 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1099200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1094073510 0x7f1094146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1099200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 0x7f1094157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1099200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10940af1d0 0x7f1094142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1099200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f10940c4420 con 0x7f10940ae880 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1099200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1094074070 con 0x7f10940af1d0 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1099200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f10940c45a0 con 0x7f1094073510 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 0x7f1094157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 0x7f1094157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59196/0 (socket says 172.21.15.114:59196) 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 -- 172.21.15.114:0/2487830571 learned_addr learned my addr 172.21.15.114:0/2487830571 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1093400640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1094073510 0x7f1094146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f1093e00640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10940af1d0 0x7f1094142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 -- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1094073510 msgr2=0x7f1094146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1094073510 0x7f1094146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 -- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10940af1d0 msgr2=0x7f1094142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10940af1d0 0x7f1094142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.904+0000 7f108aa00640 1 -- 172.21.15.114:0/2487830571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1094157770 con 0x7f10940ae880 2024-05-09T00:09:01.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.905+0000 7f108aa00640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 0x7f1094157e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f107c00d5d0 tx=0x7f107c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:01.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.905+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c0125f0 con 0x7f10940ae880 2024-05-09T00:09:01.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.905+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c019070 con 0x7f10940ae880 2024-05-09T00:09:01.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.905+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c0129b0 con 0x7f10940ae880 2024-05-09T00:09:01.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.905+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10941587d0 con 0x7f10940ae880 2024-05-09T00:09:01.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.905+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10941445a0 con 0x7f10940ae880 2024-05-09T00:09:01.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.906+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1094156100 con 0x7f10940ae880 2024-05-09T00:09:01.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.908+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f107c012b50 con 0x7f10940ae880 2024-05-09T00:09:01.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.909+0000 7f108be00640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1070076300 0x7f1070078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:01.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.910+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f107c097d30 con 0x7f10940ae880 2024-05-09T00:09:01.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.910+0000 7f1093400640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1070076300 0x7f1070078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:01.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.910+0000 7f1093400640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1070076300 0x7f1070078810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1084034000 tx=0x7f108402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:01.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:01.914+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f107c0612d0 con 0x7f10940ae880 2024-05-09T00:09:02.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.174+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1094078430 con 0x7f10940ae880 2024-05-09T00:09:02.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.183+0000 7f108be00640 1 -- 172.21.15.114:0/2487830571 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189524 (secure 0 0 0) 0x7f107c060bd0 con 0x7f10940ae880 2024-05-09T00:09:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1070076300 msgr2=0x7f1070078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1070076300 0x7f1070078810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1084034000 tx=0x7f108402e000 comp rx=0 tx=0).stop 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 msgr2=0x7f1094157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 0x7f1094157e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f107c00d5d0 tx=0x7f107c00da90 comp rx=0 tx=0).stop 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 shutdown_connections 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1070076300 0x7f1070078810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10940af1d0 0x7f1094142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10940ae880 0x7f1094157e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 --2- 172.21.15.114:0/2487830571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1094073510 0x7f1094146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.188+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 >> 172.21.15.114:0/2487830571 conn(0x7f10940c9730 msgr2=0x7f10940c3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.189+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 shutdown_connections 2024-05-09T00:09:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.189+0000 7f1099200640 1 -- 172.21.15.114:0/2487830571 wait complete. 2024-05-09T00:09:02.208 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":991477833},{"type":"v1","addr":"172.21.15.114:6833","nonce":991477833}]},"active_addr":"172.21.15.114:6833/991477833","active_change":"2024-05-09T00:08:30.270735+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2913852003}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3180900713}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3018450319}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":388379644}]}]} 2024-05-09T00:09:02.213 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T00:09:02.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T00:09:02.214 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:02.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.493+0000 7faa43e00640 1 Processor -- start 2024-05-09T00:09:02.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.494+0000 7faa43e00640 1 -- start start 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa43e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa3c155950 0x7faa3c0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa43e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa3c0abf40 0x7faa3c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa43e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa3c0c6820 con 0x7faa3c158360 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa43e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7faa3c0c5620 con 0x7faa3c0abf40 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa43e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faa3c0acf90 con 0x7faa3c155950 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa41e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa3c0abf40 0x7faa3c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa41e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa3c0abf40 0x7faa3c06c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59210/0 (socket says 172.21.15.114:59210) 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa41e00640 1 -- 172.21.15.114:0/4106633952 learned_addr learned my addr 172.21.15.114:0/4106633952 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:02.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.496+0000 7faa40a00640 1 --2- 172.21.15.114:0/4106633952 >> v2:172.21.15.153:3300/0 conn(0x7faa3c155950 0x7faa3c0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:02.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.497+0000 7faa41e00640 1 -- 172.21.15.114:0/4106633952 >> v2:172.21.15.153:3300/0 conn(0x7faa3c155950 msgr2=0x7faa3c0aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:02.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.497+0000 7faa41e00640 1 --2- 172.21.15.114:0/4106633952 >> v2:172.21.15.153:3300/0 conn(0x7faa3c155950 0x7faa3c0aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.497+0000 7faa41e00640 1 -- 172.21.15.114:0/4106633952 >> v1:172.21.15.153:6789/0 conn(0x7faa3c158360 legacy=0x7faa3c15c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:02.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.497+0000 7faa41e00640 1 -- 172.21.15.114:0/4106633952 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c0ad270 con 0x7faa3c0abf40 2024-05-09T00:09:02.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.498+0000 7faa41e00640 1 --2- 172.21.15.114:0/4106633952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c0abf40 0x7faa3c06c680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa3c072ca0 tx=0x7faa3402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185400358463ca92 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:02.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.498+0000 7faa3be00640 1 -- 172.21.15.114:0/4106633952 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34037070 con 0x7faa3c0abf40 2024-05-09T00:09:02.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.498+0000 7faa3be00640 1 -- 172.21.15.114:0/4106633952 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa34032440 con 0x7faa3c0abf40 2024-05-09T00:09:02.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.498+0000 7faa3be00640 1 -- 172.21.15.114:0/4106633952 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34032810 con 0x7faa3c0abf40 2024-05-09T00:09:02.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 -- 172.21.15.114:0/4106633952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c0abf40 msgr2=0x7faa3c06c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 --2- 172.21.15.114:0/4106633952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c0abf40 0x7faa3c06c680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa3c072ca0 tx=0x7faa3402a130 comp rx=0 tx=0).stop 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 -- 172.21.15.114:0/4106633952 shutdown_connections 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 --2- 172.21.15.114:0/4106633952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c0abf40 0x7faa3c06c680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 --2- 172.21.15.114:0/4106633952 >> v2:172.21.15.153:3300/0 conn(0x7faa3c155950 0x7faa3c0aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 -- 172.21.15.114:0/4106633952 >> 172.21.15.114:0/4106633952 conn(0x7faa3c0c7210 msgr2=0x7faa3c0c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 -- 172.21.15.114:0/4106633952 shutdown_connections 2024-05-09T00:09:02.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.499+0000 7faa43e00640 1 -- 172.21.15.114:0/4106633952 wait complete. 2024-05-09T00:09:02.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.501+0000 7faa43e00640 1 Processor -- start 2024-05-09T00:09:02.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.502+0000 7faa43e00640 1 -- start start 2024-05-09T00:09:02.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa43e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3c0abf40 0x7faa3c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:02.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa43e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3c155950 0x7faa3c1f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa43e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 0x7faa3c15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa43e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c06d3f0 con 0x7faa3c158360 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa43e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c155d60 con 0x7faa3c155950 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa43e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c06d570 con 0x7faa3c0abf40 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 0x7faa3c15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 0x7faa3c15a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59222/0 (socket says 172.21.15.114:59222) 2024-05-09T00:09:02.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.503+0000 7faa41e00640 1 -- 172.21.15.114:0/2418848441 learned_addr learned my addr 172.21.15.114:0/2418848441 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41400640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3c0abf40 0x7faa3c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa40a00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3c155950 0x7faa3c1f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41e00640 1 -- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3c0abf40 msgr2=0x7faa3c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3c0abf40 0x7faa3c15bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41e00640 1 -- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3c155950 msgr2=0x7faa3c1f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3c155950 0x7faa3c1f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41e00640 1 -- 172.21.15.114:0/2418848441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c0711a0 con 0x7faa3c158360 2024-05-09T00:09:02.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa41e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 0x7faa3c15a390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa3402a170 tx=0x7faa340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:02.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34041020 con 0x7faa3c158360 2024-05-09T00:09:02.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa340306e0 con 0x7faa3c158360 2024-05-09T00:09:02.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.504+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c071480 con 0x7faa3c158360 2024-05-09T00:09:02.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.505+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34037040 con 0x7faa3c158360 2024-05-09T00:09:02.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.505+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c15c250 con 0x7faa3c158360 2024-05-09T00:09:02.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.505+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c077430 con 0x7faa3c158360 2024-05-09T00:09:02.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.507+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa34044020 con 0x7faa3c158360 2024-05-09T00:09:02.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.508+0000 7faa39600640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7faa200762d0 0x7faa200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:02.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.508+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7faa340b85d0 con 0x7faa3c158360 2024-05-09T00:09:02.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.508+0000 7faa41400640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7faa200762d0 0x7faa200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:02.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.509+0000 7faa41400640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7faa200762d0 0x7faa200787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faa2c006fd0 tx=0x7faa2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:02.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.511+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa3404b030 con 0x7faa3c158360 2024-05-09T00:09:02.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.720+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa3c0aca50 con 0x7faa3c158360 2024-05-09T00:09:02.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.724+0000 7faa39600640 1 -- 172.21.15.114:0/2418848441 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7faa34081590 con 0x7faa3c158360 2024-05-09T00:09:02.720 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:02.720 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:02.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.726+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7faa200762d0 msgr2=0x7faa200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.726+0000 7faa43e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7faa200762d0 0x7faa200787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faa2c006fd0 tx=0x7faa2c008040 comp rx=0 tx=0).stop 2024-05-09T00:09:02.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.726+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 msgr2=0x7faa3c15a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:02.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.726+0000 7faa43e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 0x7faa3c15a390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa3402a170 tx=0x7faa340046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 shutdown_connections 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7faa200762d0 0x7faa200787e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa3c158360 0x7faa3c15a390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3c155950 0x7faa3c1f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 --2- 172.21.15.114:0/2418848441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3c0abf40 0x7faa3c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 >> 172.21.15.114:0/2418848441 conn(0x7faa3c0c7210 msgr2=0x7faa3c158980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 shutdown_connections 2024-05-09T00:09:02.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:02.727+0000 7faa43e00640 1 -- 172.21.15.114:0/2418848441 wait complete. 2024-05-09T00:09:02.747 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T00:09:02.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:03.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.016+0000 7f5fdfe00640 1 Processor -- start 2024-05-09T00:09:03.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.017+0000 7f5fdfe00640 1 -- start start 2024-05-09T00:09:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdfe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fe00c4140 0x7f5fe006cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe0158cf0 0x7f5fe01628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdfe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe0158100 con 0x7f5fe006d510 2024-05-09T00:09:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdfe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe006ed80 con 0x7f5fe00c4140 2024-05-09T00:09:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdfe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe00c7ee0 con 0x7f5fe0158cf0 2024-05-09T00:09:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fe00c4140 0x7f5fe006cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.019+0000 7f5fdf400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe0158cf0 0x7f5fe01628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fe00c4140 0x7f5fe006cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54144/0 (socket says 172.21.15.114:54144) 2024-05-09T00:09:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdea00640 1 -- 172.21.15.114:0/1420505187 learned_addr learned my addr 172.21.15.114:0/1420505187 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdea00640 1 -- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe0158cf0 msgr2=0x7f5fe01628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdea00640 1 --2- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe0158cf0 0x7f5fe01628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdea00640 1 -- 172.21.15.114:0/1420505187 >> v1:172.21.15.153:6789/0 conn(0x7f5fe006d510 legacy=0x7f5fe01585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdea00640 1 -- 172.21.15.114:0/1420505187 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe00c81c0 con 0x7f5fe00c4140 2024-05-09T00:09:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.020+0000 7f5fdf400640 1 --2- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe0158cf0 0x7f5fe01628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.022+0000 7f5fdea00640 1 --2- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe006cfd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009e50 tx=0x7f5fd002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753ee22111e6010c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.022+0000 7f5fdd600640 1 -- 172.21.15.114:0/1420505187 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0036070 con 0x7f5fe00c4140 2024-05-09T00:09:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.022+0000 7f5fdd600640 1 -- 172.21.15.114:0/1420505187 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd0031600 con 0x7f5fe00c4140 2024-05-09T00:09:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.022+0000 7f5fdd600640 1 -- 172.21.15.114:0/1420505187 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00319d0 con 0x7f5fe00c4140 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 -- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 msgr2=0x7f5fe006cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe006cfd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009e50 tx=0x7f5fd002a5f0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 -- 172.21.15.114:0/1420505187 shutdown_connections 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe0158cf0 0x7f5fe01628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/1420505187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe006cfd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 -- 172.21.15.114:0/1420505187 >> 172.21.15.114:0/1420505187 conn(0x7f5fe00cd8e0 msgr2=0x7f5fe00cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 -- 172.21.15.114:0/1420505187 shutdown_connections 2024-05-09T00:09:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.023+0000 7f5fdfe00640 1 -- 172.21.15.114:0/1420505187 wait complete. 2024-05-09T00:09:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.025+0000 7f5fdfe00640 1 Processor -- start 2024-05-09T00:09:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.026+0000 7f5fdfe00640 1 -- start start 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe006d510 0x7f5fe01eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 0x7f5fe0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00c8a60 con 0x7f5fe0158cf0 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdfe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00c88e0 con 0x7f5fe00c4140 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdfe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe015b560 con 0x7f5fe006d510 2024-05-09T00:09:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 0x7f5fe0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 0x7f5fe0159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59230/0 (socket says 172.21.15.114:59230) 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.027+0000 7f5fdf400640 1 -- 172.21.15.114:0/410582512 learned_addr learned my addr 172.21.15.114:0/410582512 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdea00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe006d510 0x7f5fe01eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fde000640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdf400640 1 -- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe006d510 msgr2=0x7f5fe01eeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdf400640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe006d510 0x7f5fe01eeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdf400640 1 -- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 msgr2=0x7f5fe0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdf400640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdf400640 1 -- 172.21.15.114:0/410582512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe015a9b0 con 0x7f5fe0158cf0 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdf400640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 0x7f5fe0159920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e860 tx=0x7f5fd800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8017070 con 0x7f5fe0158cf0 2024-05-09T00:09:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd800c8e0 con 0x7f5fe0158cf0 2024-05-09T00:09:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800ccb0 con 0x7f5fe0158cf0 2024-05-09T00:09:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.028+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe015ac90 con 0x7f5fe0158cf0 2024-05-09T00:09:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.029+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe0159400 con 0x7f5fe0158cf0 2024-05-09T00:09:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.030+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe0078430 con 0x7f5fe0158cf0 2024-05-09T00:09:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.031+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5fd801a070 con 0x7f5fe0158cf0 2024-05-09T00:09:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.032+0000 7f5fd6a00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5fc0076300 0x7f5fc0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.032+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f5fd8097af0 con 0x7f5fe0158cf0 2024-05-09T00:09:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.032+0000 7f5fdea00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5fc0076300 0x7f5fc0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.033+0000 7f5fdea00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5fc0076300 0x7f5fc0078810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0033000 tx=0x7f5fd0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.040+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5fd8061120 con 0x7f5fe0158cf0 2024-05-09T00:09:03.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.251+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fe008ec80 con 0x7f5fe0158cf0 2024-05-09T00:09:03.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.253+0000 7f5fd6a00640 1 -- 172.21.15.114:0/410582512 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7f5fd8060a20 con 0x7f5fe0158cf0 2024-05-09T00:09:03.249 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:03.249 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5fc0076300 msgr2=0x7f5fc0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5fc0076300 0x7f5fc0078810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0033000 tx=0x7f5fd0009000 comp rx=0 tx=0).stop 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 msgr2=0x7f5fe0159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 0x7f5fe0159920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e860 tx=0x7f5fd800ed20 comp rx=0 tx=0).stop 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 shutdown_connections 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5fc0076300 0x7f5fc0078810 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fe0158cf0 0x7f5fe0159920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fe00c4140 0x7f5fe0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 --2- 172.21.15.114:0/410582512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fe006d510 0x7f5fe01eeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 >> 172.21.15.114:0/410582512 conn(0x7f5fe00cd8e0 msgr2=0x7f5fe015ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 shutdown_connections 2024-05-09T00:09:03.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.256+0000 7f5fdfe00640 1 -- 172.21.15.114:0/410582512 wait complete. 2024-05-09T00:09:03.275 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T00:09:03.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T00:09:03.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T00:09:03.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T00:09:03.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T00:09:03.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T00:09:03.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T00:09:03.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T00:09:03.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.678+0000 7fd3ea800640 1 Processor -- start 2024-05-09T00:09:03.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.678+0000 7fd3ea800640 1 -- start start 2024-05-09T00:09:03.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.680+0000 7fd3ea800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd3dc007750 0x7fd3dc006d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.681+0000 7fd3e9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd3dc007750 0x7fd3dc006d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.681+0000 7fd3e9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd3dc007750 0x7fd3dc006d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59232/0 (socket says 172.21.15.114:59232) 2024-05-09T00:09:03.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.681+0000 7fd3e9400640 1 -- 172.21.15.114:0/3176919381 learned_addr learned my addr 172.21.15.114:0/3176919381 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.682+0000 7fd3ea800640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0466a0 0x7fd3dc00b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.682+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3dc046d90 con 0x7fd3dc0d4050 2024-05-09T00:09:03.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.682+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd3dc00bd70 con 0x7fd3dc007750 2024-05-09T00:09:03.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.683+0000 7fd3e8a00640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0466a0 0x7fd3dc00b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.683+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc0473a0 con 0x7fd3dc0466a0 2024-05-09T00:09:03.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.684+0000 7fd3e9400640 1 -- 172.21.15.114:0/3176919381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0466a0 msgr2=0x7fd3dc00b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.684+0000 7fd3e9400640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0466a0 0x7fd3dc00b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.684+0000 7fd3e9400640 1 -- 172.21.15.114:0/3176919381 >> v1:172.21.15.153:6789/0 conn(0x7fd3dc0d4050 legacy=0x7fd3dc0da240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.684+0000 7fd3e9400640 1 -- 172.21.15.114:0/3176919381 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc00ba90 con 0x7fd3dc007750 2024-05-09T00:09:03.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.685+0000 7f5512e00640 1 Processor -- start 2024-05-09T00:09:03.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.686+0000 7f5512e00640 1 -- start start 2024-05-09T00:09:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.686+0000 7fd3e9400640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc007750 0x7fd3dc006d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000b1e0 tx=0x7fd3d002a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9e2602512c0f5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.687+0000 7fd3e3e00640 1 -- 172.21.15.114:0/3176919381 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0007ae0 con 0x7fd3dc007750 2024-05-09T00:09:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.685+0000 7f7e68c00640 1 Processor -- start 2024-05-09T00:09:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.685+0000 7f7e68c00640 1 -- start start 2024-05-09T00:09:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f7e68c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7e5c04b020 0x7f7e5c0db230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f7e68c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7e5c0db770 0x7f7e5c04ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f7e68c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5c04b430 con 0x7f7e5c035530 2024-05-09T00:09:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f7e68c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5c00f0c0 con 0x7f7e5c04b020 2024-05-09T00:09:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f7e68c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5c00e4b0 con 0x7f7e5c0db770 2024-05-09T00:09:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.687+0000 7fd3e3e00640 1 -- 172.21.15.114:0/3176919381 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0035070 con 0x7fd3dc007750 2024-05-09T00:09:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f5512e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f5512e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f550c158b10 0x7f550c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f5512e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f550c15b7f0 con 0x7f550c0af570 2024-05-09T00:09:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f5512e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f550c15c5b0 con 0x7f550c158b10 2024-05-09T00:09:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7f5512e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f550c15bad0 con 0x7f550c0c8760 2024-05-09T00:09:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc007750 msgr2=0x7fd3dc006d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.689+0000 7f5512400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f550c0af570 0x7f550c0cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53136/0 (socket says 172.21.15.114:53136) 2024-05-09T00:09:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.689+0000 7f5512400640 1 -- 172.21.15.114:0/3468163882 learned_addr learned my addr 172.21.15.114:0/3468163882 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f7e63400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7e5c035530 0x7f7e5c0075b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:40740/0 (socket says 172.21.15.114:40740) 2024-05-09T00:09:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f7e63400640 1 -- 172.21.15.114:0/636611635 learned_addr learned my addr 172.21.15.114:0/636611635 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.689+0000 7f5511a00640 1 --2- 172.21.15.114:0/3468163882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f7e63e00640 1 --2- 172.21.15.114:0/636611635 >> v2:172.21.15.153:3300/0 conn(0x7f7e5c0db770 0x7f7e5c04ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f7e62a00640 1 --2- 172.21.15.114:0/636611635 >> v2:172.21.15.114:3300/0 conn(0x7f7e5c04b020 0x7f7e5c0db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.688+0000 7fd3ea800640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc007750 0x7fd3dc006d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000b1e0 tx=0x7fd3d002a940 comp rx=0 tx=0).stop 2024-05-09T00:09:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7fa0e7e00640 1 Processor -- start 2024-05-09T00:09:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7fa0e7e00640 1 -- start start 2024-05-09T00:09:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.691+0000 7f7e63e00640 1 -- 172.21.15.114:0/636611635 >> v2:172.21.15.114:3300/0 conn(0x7f7e5c04b020 msgr2=0x7f7e5c0db230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.689+0000 7f5511000640 1 --2- 172.21.15.114:0/3468163882 >> v2:172.21.15.114:3300/0 conn(0x7f550c158b10 0x7f550c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f5511a00640 1 -- 172.21.15.114:0/3468163882 >> v2:172.21.15.114:3300/0 conn(0x7f550c158b10 msgr2=0x7f550c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f5511a00640 1 --2- 172.21.15.114:0/3468163882 >> v2:172.21.15.114:3300/0 conn(0x7f550c158b10 0x7f550c0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.690+0000 7f5511a00640 1 -- 172.21.15.114:0/3468163882 >> v1:172.21.15.114:6789/0 conn(0x7f550c0af570 legacy=0x7f550c0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.691+0000 7f5511a00640 1 -- 172.21.15.114:0/3468163882 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c15bdb0 con 0x7f550c0c8760 2024-05-09T00:09:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.691+0000 7f7e63e00640 1 --2- 172.21.15.114:0/636611635 >> v2:172.21.15.114:3300/0 conn(0x7f7e5c04b020 0x7f7e5c0db230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.691+0000 7f7e63e00640 1 -- 172.21.15.114:0/636611635 >> v1:172.21.15.153:6789/0 conn(0x7f7e5c035530 legacy=0x7f7e5c0075b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 shutdown_connections 2024-05-09T00:09:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fd3ea800640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0466a0 0x7fd3dc00b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fd3ea800640 1 --2- 172.21.15.114:0/3176919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc007750 0x7fd3dc006d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 >> 172.21.15.114:0/3176919381 conn(0x7fd3dc006090 msgr2=0x7fd3dc0064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.691+0000 7f7e63e00640 1 -- 172.21.15.114:0/636611635 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c00e790 con 0x7f7e5c0db770 2024-05-09T00:09:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7f7e62a00640 1 --2- 172.21.15.114:0/636611635 >> v2:172.21.15.114:3300/0 conn(0x7f7e5c04b020 0x7f7e5c0db230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 shutdown_connections 2024-05-09T00:09:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fa0e7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0e0042f90 0x7fa0e00075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7f5511a00640 1 --2- 172.21.15.114:0/3468163882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c155740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f54f80097a0 tx=0x7f54f802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=709180ddff0295e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7f7e63e00640 1 --2- 172.21.15.114:0/636611635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c0db770 0x7f7e5c04ddd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e64066140 tx=0x7f7e640a7d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303662bbc43f7319 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e00e2ca0 0x7fa0e00e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.692+0000 7fd3ea800640 1 -- 172.21.15.114:0/3176919381 wait complete. 2024-05-09T00:09:03.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7f460fe00640 1 Processor -- start 2024-05-09T00:09:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e7e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e0042cb0 con 0x7fa0e0033240 2024-05-09T00:09:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7f7e62000640 1 -- 172.21.15.114:0/636611635 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e640b5070 con 0x7f7e5c0db770 2024-05-09T00:09:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e0042a60 con 0x7fa0e0042f90 2024-05-09T00:09:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e004b110 con 0x7fa0e00e2ca0 2024-05-09T00:09:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0e0042f90 0x7fa0e00075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0e0042f90 0x7fa0e00075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54164/0 (socket says 172.21.15.114:54164) 2024-05-09T00:09:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7fa0e6a00640 1 -- 172.21.15.114:0/3778347509 learned_addr learned my addr 172.21.15.114:0/3778347509 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7f7e62000640 1 -- 172.21.15.114:0/636611635 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e640a89c0 con 0x7f7e5c0db770 2024-05-09T00:09:03.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7f7e62000640 1 -- 172.21.15.114:0/636611635 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e640a8e30 con 0x7f7e5c0db770 2024-05-09T00:09:03.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7fa0e7400640 1 --2- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e00e2ca0 0x7fa0e00e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7f550be00640 1 -- 172.21.15.114:0/3468163882 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8037070 con 0x7f550c0c8760 2024-05-09T00:09:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7f550be00640 1 -- 172.21.15.114:0/3468163882 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f8032440 con 0x7f550c0c8760 2024-05-09T00:09:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7f550be00640 1 -- 172.21.15.114:0/3468163882 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8032810 con 0x7f550c0c8760 2024-05-09T00:09:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.693+0000 7f460fe00640 1 -- start start 2024-05-09T00:09:03.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 -- 172.21.15.114:0/636611635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c0db770 msgr2=0x7f7e5c04ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 --2- 172.21.15.114:0/636611635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c0db770 0x7f7e5c04ddd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e64066140 tx=0x7f7e640a7d80 comp rx=0 tx=0).stop 2024-05-09T00:09:03.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 -- 172.21.15.114:0/636611635 shutdown_connections 2024-05-09T00:09:03.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 --2- 172.21.15.114:0/636611635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c0db770 0x7f7e5c04ddd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 --2- 172.21.15.114:0/636611635 >> v2:172.21.15.114:3300/0 conn(0x7f7e5c04b020 0x7f7e5c0db230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 -- 172.21.15.114:0/636611635 >> 172.21.15.114:0/636611635 conn(0x7f7e5c04c830 msgr2=0x7f7e5c04cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 -- 172.21.15.114:0/636611635 shutdown_connections 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7fa0e6a00640 1 -- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e00e2ca0 msgr2=0x7fa0e00e30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7fa0e6a00640 1 --2- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e00e2ca0 0x7fa0e00e30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7fa0e6a00640 1 -- 172.21.15.114:0/3778347509 >> v1:172.21.15.153:6789/0 conn(0x7fa0e0033240 legacy=0x7fa0e0033650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.694+0000 7fa0e6a00640 1 -- 172.21.15.114:0/3778347509 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e004b360 con 0x7fa0e0042f90 2024-05-09T00:09:03.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7f5512e00640 1 -- 172.21.15.114:0/3468163882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 msgr2=0x7f550c155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7f5512e00640 1 --2- 172.21.15.114:0/3468163882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c155740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f54f80097a0 tx=0x7f54f802a180 comp rx=0 tx=0).stop 2024-05-09T00:09:03.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7fa0e6a00640 1 --2- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 0x7fa0e00075b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009870 tx=0x7fa0d402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676218c39508e54d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7fd3ea800640 1 Processor -- start 2024-05-09T00:09:03.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7fa0e5600640 1 -- 172.21.15.114:0/3778347509 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4037070 con 0x7fa0e0042f90 2024-05-09T00:09:03.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7fd3ea800640 1 -- start start 2024-05-09T00:09:03.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.695+0000 7f7e68c00640 1 -- 172.21.15.114:0/636611635 wait complete. 2024-05-09T00:09:03.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7f5512e00640 1 -- 172.21.15.114:0/3468163882 shutdown_connections 2024-05-09T00:09:03.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7f5512e00640 1 --2- 172.21.15.114:0/3468163882 >> v2:172.21.15.114:3300/0 conn(0x7f550c158b10 0x7f550c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7fa0e5600640 1 -- 172.21.15.114:0/3778347509 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d4032440 con 0x7fa0e0042f90 2024-05-09T00:09:03.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7f5512e00640 1 --2- 172.21.15.114:0/3468163882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c155740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7f5512e00640 1 -- 172.21.15.114:0/3468163882 >> 172.21.15.114:0/3468163882 conn(0x7f550c068ef0 msgr2=0x7f550c0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.696+0000 7fa0e5600640 1 -- 172.21.15.114:0/3778347509 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4032850 con 0x7fa0e0042f90 2024-05-09T00:09:03.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7f5512e00640 1 -- 172.21.15.114:0/3468163882 shutdown_connections 2024-05-09T00:09:03.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.697+0000 7f460fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f46100ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46100c5180 0x7f46100c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4610154080 0x7f4610154490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f46101581b0 con 0x7f4610154080 2024-05-09T00:09:03.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460fe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4610158490 con 0x7f46100c5180 2024-05-09T00:09:03.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f461006e240 con 0x7f46100aebf0 2024-05-09T00:09:03.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7fa0e7e00640 1 -- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 msgr2=0x7fa0e00075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7fa0e7e00640 1 --2- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 0x7fa0e00075b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009870 tx=0x7fa0d402a1e0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f46100ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460e000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46100c5180 0x7f46100c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f46100ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:49880/0 (socket says 172.21.15.114:49880) 2024-05-09T00:09:03.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.698+0000 7f460ea00640 1 -- 172.21.15.114:0/2566711526 learned_addr learned my addr 172.21.15.114:0/2566711526 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fa0e7e00640 1 -- 172.21.15.114:0/3778347509 shutdown_connections 2024-05-09T00:09:03.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fa0e7e00640 1 --2- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e00e2ca0 0x7fa0e00e30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fa0e7e00640 1 --2- 172.21.15.114:0/3778347509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 0x7fa0e00075b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fa0e7e00640 1 -- 172.21.15.114:0/3778347509 >> 172.21.15.114:0/3778347509 conn(0x7fa0e004c830 msgr2=0x7fa0e004cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460f400640 1 --2- 172.21.15.114:0/2566711526 >> v2:172.21.15.114:3300/0 conn(0x7f4610154080 0x7f4610154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f7e68c00640 1 Processor -- start 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f5512e00640 1 -- 172.21.15.114:0/3468163882 wait complete. 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fd3ea800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3dc0466a0 0x7fd3dc043ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fd3ea800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0d4050 0x7fd3dc0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fd3ea800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0451a0 0x7fd3dc0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fd3ea800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc0072d0 con 0x7fd3dc0451a0 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fd3ea800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc03f240 con 0x7fd3dc0466a0 2024-05-09T00:09:03.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fd3ea800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc0d4460 con 0x7fd3dc0d4050 2024-05-09T00:09:03.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fa0e7e00640 1 -- 172.21.15.114:0/3778347509 shutdown_connections 2024-05-09T00:09:03.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7fa0e7e00640 1 -- 172.21.15.114:0/3778347509 wait complete. 2024-05-09T00:09:03.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460ea00640 1 -- 172.21.15.114:0/2566711526 >> v2:172.21.15.153:3300/0 conn(0x7f46100c5180 msgr2=0x7f46100c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460ea00640 1 --2- 172.21.15.114:0/2566711526 >> v2:172.21.15.153:3300/0 conn(0x7f46100c5180 0x7f46100c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460ea00640 1 -- 172.21.15.114:0/2566711526 >> v2:172.21.15.114:3300/0 conn(0x7f4610154080 msgr2=0x7f4610154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460ea00640 1 --2- 172.21.15.114:0/2566711526 >> v2:172.21.15.114:3300/0 conn(0x7f4610154080 0x7f4610154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460ea00640 1 -- 172.21.15.114:0/2566711526 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461006e520 con 0x7f46100aebf0 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.699+0000 7f460f400640 1 --2- 172.21.15.114:0/2566711526 >> v2:172.21.15.114:3300/0 conn(0x7f4610154080 0x7f4610154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.700+0000 7fd3e9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0451a0 0x7fd3dc0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.701+0000 7fd3e9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0451a0 0x7fd3dc0ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59262/0 (socket says 172.21.15.114:59262) 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.701+0000 7fd3e9e00640 1 -- 172.21.15.114:0/2435398269 learned_addr learned my addr 172.21.15.114:0/2435398269 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.701+0000 7fd3e8a00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0d4050 0x7fd3dc0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.700+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3dc0466a0 0x7fd3dc043ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.700+0000 7f7e68c00640 1 -- start start 2024-05-09T00:09:03.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd3e8a00640 1 -- 172.21.15.114:0/2435398269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3dc0466a0 msgr2=0x7fd3dc043ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd3e8a00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3dc0466a0 0x7fd3dc043ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd3e8a00640 1 -- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0451a0 msgr2=0x7fd3dc0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd221c00640 1 Processor -- start 2024-05-09T00:09:03.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd3e8a00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0451a0 0x7fd3dc0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7f460ea00640 1 --2- 172.21.15.114:0/2566711526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f46100ae490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46100c6e30 tx=0x7f460002a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ef3cd3b1480e23b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd3e8a00640 1 -- 172.21.15.114:0/2435398269 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc031200 con 0x7fd3dc0d4050 2024-05-09T00:09:03.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd3e9e00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0451a0 0x7fd3dc0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:03.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f5512e00640 1 Processor -- start 2024-05-09T00:09:03.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7fd3e8a00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0d4050 0x7fd3dc0d3280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800d580 tx=0x7fd3d800da40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f5512e00640 1 -- start start 2024-05-09T00:09:03.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f7e68c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e5c035530 0x7f7e5c0488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7fa0e7e00640 1 Processor -- start 2024-05-09T00:09:03.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f460d600640 1 -- 172.21.15.114:0/2566711526 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600037070 con 0x7f46100aebf0 2024-05-09T00:09:03.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7f460d600640 1 -- 172.21.15.114:0/2566711526 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460002ae00 con 0x7f46100aebf0 2024-05-09T00:09:03.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8018020 con 0x7fd3dc0d4050 2024-05-09T00:09:03.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d8014620 con 0x7fd3dc0d4050 2024-05-09T00:09:03.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8014a10 con 0x7fd3dc0d4050 2024-05-09T00:09:03.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7f460d600640 1 -- 172.21.15.114:0/2566711526 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600032660 con 0x7f46100aebf0 2024-05-09T00:09:03.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f7e68c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c04b020 0x7f7e5c0d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f7e68c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e5c0db770 0x7f7e5c0d53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f7e68c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c04e310 con 0x7f7e5c0db770 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f7e68c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00ed50 con 0x7f7e5c04b020 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.703+0000 7f7e68c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5c04e490 con 0x7f7e5c035530 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7f7e63e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e5c0db770 0x7f7e5c0d53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7f7e63e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e5c0db770 0x7f7e5c0d53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59272/0 (socket says 172.21.15.114:59272) 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7f7e63e00640 1 -- 172.21.15.114:0/1620088958 learned_addr learned my addr 172.21.15.114:0/1620088958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7f7e63400640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e5c035530 0x7f7e5c0488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.702+0000 7fd221c00640 1 -- start start 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd221c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd21c072890 0x7fd21c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd221c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c15a190 con 0x7fd21c160600 2024-05-09T00:09:03.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd221c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c15fe20 con 0x7fd21c072d50 2024-05-09T00:09:03.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd221c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c160170 con 0x7fd21c072890 2024-05-09T00:09:03.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f7e63e00640 1 -- 172.21.15.114:0/1620088958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e5c035530 msgr2=0x7f7e5c0488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f7e63e00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e5c035530 0x7f7e5c0488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f7e63e00640 1 -- 172.21.15.114:0/1620088958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c04b020 msgr2=0x7f7e5c0d4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f7e63e00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e5c04b020 0x7f7e5c0d4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f7e63e00640 1 -- 172.21.15.114:0/1620088958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c167a00 con 0x7f7e5c0db770 2024-05-09T00:09:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7fd21a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd21c072890 0x7fd21c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7fd21a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd21c072890 0x7fd21c159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59276/0 (socket says 172.21.15.114:59276) 2024-05-09T00:09:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7fd21a000640 1 -- 172.21.15.114:0/3178485969 learned_addr learned my addr 172.21.15.114:0/3178485969 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc162960 con 0x7fd3dc0d4050 2024-05-09T00:09:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc162f20 con 0x7fd3dc0d4050 2024-05-09T00:09:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7f7e63e00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e5c0db770 0x7f7e5c0d53c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e64066140 tx=0x7f7e64078020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7fd21a000640 1 -- 172.21.15.114:0/3178485969 >> v1:172.21.15.153:6789/0 conn(0x7fd21c072d50 legacy=0x7fd21c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7fd21a000640 1 -- 172.21.15.114:0/3178485969 >> v1:172.21.15.114:6789/0 conn(0x7fd21c160600 legacy=0x7fd21c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e640bd070 con 0x7f7e5c0db770 2024-05-09T00:09:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e640b0b80 con 0x7f7e5c0db770 2024-05-09T00:09:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e640b5040 con 0x7f7e5c0db770 2024-05-09T00:09:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5c0d5900 con 0x7f7e5c0db770 2024-05-09T00:09:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.704+0000 7fa0e7e00640 1 -- start start 2024-05-09T00:09:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7fd21a000640 1 -- 172.21.15.114:0/3178485969 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15d1b0 con 0x7fd21c072890 2024-05-09T00:09:03.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3dc005570 con 0x7fd3dc0d4050 2024-05-09T00:09:03.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f460fe00640 1 -- 172.21.15.114:0/2566711526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 msgr2=0x7f46100ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.705+0000 7f460fe00640 1 --2- 172.21.15.114:0/2566711526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f46100ae490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46100c6e30 tx=0x7f460002a0b0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.706+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5c167ca0 con 0x7f7e5c0db770 2024-05-09T00:09:03.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.707+0000 7f460fe00640 1 -- 172.21.15.114:0/2566711526 shutdown_connections 2024-05-09T00:09:03.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.707+0000 7f460fe00640 1 --2- 172.21.15.114:0/2566711526 >> v2:172.21.15.114:3300/0 conn(0x7f4610154080 0x7f4610154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.707+0000 7f460fe00640 1 --2- 172.21.15.114:0/2566711526 >> v2:172.21.15.153:3300/0 conn(0x7f46100c5180 0x7f46100c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.707+0000 7fa0e7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e0033240 0x7fa0e000e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.707+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e5c005570 con 0x7f7e5c0db770 2024-05-09T00:09:03.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7fa0e7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 0x7fa0e0044640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f460fe00640 1 --2- 172.21.15.114:0/2566711526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f46100ae490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f5512e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0af570 0x7f550c0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f460fe00640 1 -- 172.21.15.114:0/2566711526 >> 172.21.15.114:0/2566711526 conn(0x7f46100c5ea0 msgr2=0x7f46100c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f9964e00640 1 Processor -- start 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f5512e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f5512e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c158b10 0x7f550c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5512e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0cd070 con 0x7f550c0af570 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5511a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0af570 0x7f550c0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5512e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f550c155c80 con 0x7f550c158b10 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5511a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0af570 0x7f550c0b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59290/0 (socket says 172.21.15.114:59290) 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5511a00640 1 -- 172.21.15.114:0/369643483 learned_addr learned my addr 172.21.15.114:0/369643483 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f550c0cd1f0 con 0x7f550c0c8760 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5512400640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c158b10 0x7f550c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7f5511000640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7fa0e6a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e0033240 0x7fa0e000e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7fa0e7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00e2ca0 0x7fa0e00e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7fa0e6a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e0033240 0x7fa0e000e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:49898/0 (socket says 172.21.15.114:49898) 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fa0e6a00640 1 -- 172.21.15.114:0/1269351102 learned_addr learned my addr 172.21.15.114:0/1269351102 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fa0e6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 0x7fa0e0044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e004a730 con 0x7fa0e00e2ca0 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e0035940 con 0x7fa0e0042f90 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e004c4d0 con 0x7fa0e0033240 2024-05-09T00:09:03.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7fd21a000640 1 --2- 172.21.15.114:0/3178485969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c159c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd204009870 tx=0x7fd20402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2390fe9f7ac641 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fd219600640 1 -- 172.21.15.114:0/3178485969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204037070 con 0x7fd21c072890 2024-05-09T00:09:03.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fd219600640 1 -- 172.21.15.114:0/3178485969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204032440 con 0x7fd21c072890 2024-05-09T00:09:03.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.709+0000 7fd219600640 1 -- 172.21.15.114:0/3178485969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204032810 con 0x7fd21c072890 2024-05-09T00:09:03.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.708+0000 7f9964e00640 1 -- start start 2024-05-09T00:09:03.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f460fe00640 1 -- 172.21.15.114:0/2566711526 shutdown_connections 2024-05-09T00:09:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7fa0e7400640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00e2ca0 0x7fa0e00e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f5511a00640 1 -- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 msgr2=0x7f550c0ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f460fe00640 1 -- 172.21.15.114:0/2566711526 wait complete. 2024-05-09T00:09:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f5511a00640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c0ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f5511a00640 1 -- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c158b10 msgr2=0x7f550c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 -- 172.21.15.114:0/3178485969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 msgr2=0x7fd21c159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 --2- 172.21.15.114:0/3178485969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c159c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd204009870 tx=0x7fd20402a1c0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd3d801b020 con 0x7fd3dc0d4050 2024-05-09T00:09:03.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 -- 172.21.15.114:0/3178485969 shutdown_connections 2024-05-09T00:09:03.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 --2- 172.21.15.114:0/3178485969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c159c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7fa0e6a00640 1 -- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 msgr2=0x7fa0e0044640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7fa0e6a00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0e0042f90 0x7fa0e0044640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7fa0e6a00640 1 -- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00e2ca0 msgr2=0x7fa0e00e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 -- 172.21.15.114:0/3178485969 >> 172.21.15.114:0/3178485969 conn(0x7fd21c06c680 msgr2=0x7fd21c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f5511a00640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c158b10 0x7f550c153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7fa0e6a00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00e2ca0 0x7fa0e00e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7fa0e6a00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e01752e0 con 0x7fa0e0033240 2024-05-09T00:09:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.710+0000 7f5511a00640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c154800 con 0x7f550c0af570 2024-05-09T00:09:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7f5511000640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f550c0c8760 0x7f550c0ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7f5511a00640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0af570 0x7f550c0b14c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54f80098c0 tx=0x7f54f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8042020 con 0x7f550c0af570 2024-05-09T00:09:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f803d730 con 0x7f550c0af570 2024-05-09T00:09:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8037040 con 0x7f550c0af570 2024-05-09T00:09:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1f1af0 con 0x7f550c0af570 2024-05-09T00:09:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7fa0e6a00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e0033240 0x7fa0e000e6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40090b0 tx=0x7fa0d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 -- 172.21.15.114:0/3178485969 shutdown_connections 2024-05-09T00:09:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.711+0000 7fd221c00640 1 -- 172.21.15.114:0/3178485969 wait complete. 2024-05-09T00:09:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f1747000640 1 Processor -- start 2024-05-09T00:09:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f1747000640 1 -- start start 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f9964e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9960072d50 0x7f99600c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f9964e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9960072890 0x7f9960159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f9964e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99600c4ca0 con 0x7f9960160600 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f9964e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9960160170 con 0x7f9960072890 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f9964e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f996015a190 con 0x7f9960072d50 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f995d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9960072890 0x7f9960159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f995de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9960072d50 0x7f99600c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f995de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9960072d50 0x7f99600c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54204/0 (socket says 172.21.15.114:54204) 2024-05-09T00:09:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.712+0000 7f995de00640 1 -- 172.21.15.114:0/2049039365 learned_addr learned my addr 172.21.15.114:0/2049039365 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c0b21c0 con 0x7f550c0af570 2024-05-09T00:09:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e640c0070 con 0x7f7e5c0db770 2024-05-09T00:09:03.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4041070 con 0x7fa0e0033240 2024-05-09T00:09:03.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d403c930 con 0x7fa0e0033240 2024-05-09T00:09:03.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4037040 con 0x7fa0e0033240 2024-05-09T00:09:03.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e0043b60 con 0x7fa0e0033240 2024-05-09T00:09:03.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f550c1f2010 con 0x7f550c0af570 2024-05-09T00:09:03.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fd3e1600640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd3c4076320 0x7fd3c4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fd3d8098370 con 0x7fd3dc0d4050 2024-05-09T00:09:03.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fd3e1600640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7fd3c4080c00 0x7fd3c4083050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 --> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3d8015e50 con 0x7fd3c4080c00 2024-05-09T00:09:03.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd3d8098720 con 0x7fd3dc0d4050 2024-05-09T00:09:03.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f460fe00640 1 Processor -- start 2024-05-09T00:09:03.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.714+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e0174fb0 con 0x7fa0e0033240 2024-05-09T00:09:03.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0e0005570 con 0x7fa0e0033240 2024-05-09T00:09:03.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7fd3e9e00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7fd3c4080c00 0x7fd3c4083050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7fd3e9400640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd3c4076320 0x7fd3c4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f1747000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17400c5fd0 0x7f174006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f1747000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17400cb2e0 con 0x7f1740158ff0 2024-05-09T00:09:03.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f1747000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174006e810 con 0x7f17400ca020 2024-05-09T00:09:03.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f1747000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f174006e5e0 con 0x7f17400c5fd0 2024-05-09T00:09:03.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f7e57400640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7e440763a0 0x7f7e440788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f7e64135680 con 0x7f7e5c0db770 2024-05-09T00:09:03.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f173fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17400c5fd0 0x7f174006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f173fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17400c5fd0 0x7f174006e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59306/0 (socket says 172.21.15.114:59306) 2024-05-09T00:09:03.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f173fe00640 1 -- 172.21.15.114:0/108212614 learned_addr learned my addr 172.21.15.114:0/108212614 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7fd221c00640 1 Processor -- start 2024-05-09T00:09:03.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f173fe00640 1 -- 172.21.15.114:0/108212614 >> v1:172.21.15.153:6789/0 conn(0x7f17400ca020 legacy=0x7f174015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f995de00640 1 -- 172.21.15.114:0/2049039365 >> v2:172.21.15.114:3300/0 conn(0x7f9960072890 msgr2=0x7f9960159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f995de00640 1 --2- 172.21.15.114:0/2049039365 >> v2:172.21.15.114:3300/0 conn(0x7f9960072890 0x7f9960159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f995de00640 1 -- 172.21.15.114:0/2049039365 >> v1:172.21.15.153:6789/0 conn(0x7f9960160600 legacy=0x7f99600c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.713+0000 7f995de00640 1 -- 172.21.15.114:0/2049039365 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996015fe20 con 0x7f9960072d50 2024-05-09T00:09:03.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f7e57400640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f7e44080c80 0x7f7e440830d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 --> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e440837a0 con 0x7f7e44080c80 2024-05-09T00:09:03.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e64135a70 con 0x7f7e5c0db770 2024-05-09T00:09:03.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7fd221c00640 1 -- start start 2024-05-09T00:09:03.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.716+0000 7f7e63400640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7e440763a0 0x7f7e440788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7f7e62a00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f7e44080c80 0x7f7e440830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7f173ea00640 1 -- 172.21.15.114:0/108212614 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887123812 0 0) 0x7f17400cb2e0 con 0x7f1740158ff0 2024-05-09T00:09:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7f173fe00640 1 -- 172.21.15.114:0/108212614 >> v1:172.21.15.114:6789/0 conn(0x7f1740158ff0 legacy=0x7f17400c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7f173fe00640 1 -- 172.21.15.114:0/108212614 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174006eaf0 con 0x7f17400c5fd0 2024-05-09T00:09:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f995de00640 1 --2- 172.21.15.114:0/2049039365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072d50 0x7f99600c4760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f996006d5c0 tx=0x7f995002a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=271c54734d67eda8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.715+0000 7f460fe00640 1 -- start start 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7f460fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f461013e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7f460fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46100c5180 0x7f461013f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f460fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4610154080 0x7f4610139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f460fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4610074450 con 0x7f4610154080 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f460fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46100742d0 con 0x7f46100c5180 2024-05-09T00:09:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f460fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f46100af2f0 con 0x7f46100aebf0 2024-05-09T00:09:03.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f7e63400640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7e440763a0 0x7f7e440788b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e50000f60 tx=0x7f7e50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.717+0000 7fd3e9e00640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7fd3c4080c00 0x7fd3c4083050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f460f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4610154080 0x7f4610139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f460f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4610154080 0x7f4610139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59316/0 (socket says 172.21.15.114:59316) 2024-05-09T00:09:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f995ca00640 1 -- 172.21.15.114:0/2049039365 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950037070 con 0x7f9960072d50 2024-05-09T00:09:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f995ca00640 1 -- 172.21.15.114:0/2049039365 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950032440 con 0x7f9960072d50 2024-05-09T00:09:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f995ca00640 1 -- 172.21.15.114:0/2049039365 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950032850 con 0x7f9960072d50 2024-05-09T00:09:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7f460f400640 1 -- 172.21.15.114:0/2782490593 learned_addr learned my addr 172.21.15.114:0/2782490593 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.718+0000 7f7e62a00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f7e44080c80 0x7f7e440830d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd221c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd221c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd21c072d50 0x7fd21c1f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd221c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd21c160600 0x7fd21c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd221c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0c6760 con 0x7fd21c072890 2024-05-09T00:09:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd221c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0c42e0 con 0x7fd21c160600 2024-05-09T00:09:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd221c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0c68e0 con 0x7fd21c072d50 2024-05-09T00:09:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd21aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7f460e000640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46100c5180 0x7f461013f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd21aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59322/0 (socket says 172.21.15.114:59322) 2024-05-09T00:09:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7fd21aa00640 1 -- 172.21.15.114:0/1404013683 learned_addr learned my addr 172.21.15.114:0/1404013683 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7f460ea00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f461013e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7f9964e00640 1 -- 172.21.15.114:0/2049039365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072d50 msgr2=0x7f99600c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7f9964e00640 1 --2- 172.21.15.114:0/2049039365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072d50 0x7f99600c4760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f996006d5c0 tx=0x7f995002a160 comp rx=0 tx=0).stop 2024-05-09T00:09:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.719+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f54f8045020 con 0x7f550c0af570 2024-05-09T00:09:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f9964e00640 1 -- 172.21.15.114:0/2049039365 shutdown_connections 2024-05-09T00:09:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f9964e00640 1 --2- 172.21.15.114:0/2049039365 >> v2:172.21.15.114:3300/0 conn(0x7f9960072890 0x7f9960159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f9964e00640 1 --2- 172.21.15.114:0/2049039365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072d50 0x7f99600c4760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f460f400640 1 -- 172.21.15.114:0/2782490593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 msgr2=0x7f461013e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f9964e00640 1 -- 172.21.15.114:0/2049039365 >> 172.21.15.114:0/2049039365 conn(0x7f996006c680 msgr2=0x7f996006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f460f400640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46100aebf0 0x7f461013e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f460f400640 1 -- 172.21.15.114:0/2782490593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46100c5180 msgr2=0x7f461013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f460f400640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46100c5180 0x7f461013f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f9964e00640 1 -- 172.21.15.114:0/2049039365 shutdown_connections 2024-05-09T00:09:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f9964e00640 1 -- 172.21.15.114:0/2049039365 wait complete. 2024-05-09T00:09:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f460f400640 1 -- 172.21.15.114:0/2782490593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461013aa40 con 0x7f4610154080 2024-05-09T00:09:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7fd21aa00640 1 -- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd21c072d50 msgr2=0x7fd21c1f3d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:09:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7f5509600640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f54ec076320 0x7f54ec078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7fd21aa00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd21c072d50 0x7fd21c1f3d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f54f80b89a0 con 0x7f550c0af570 2024-05-09T00:09:03.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7fd21aa00640 1 -- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd21c160600 msgr2=0x7fd21c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7fd21aa00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd21c160600 0x7fd21c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.720+0000 7fd21aa00640 1 -- 172.21.15.114:0/1404013683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1f6da0 con 0x7fd21c072890 2024-05-09T00:09:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f5511000640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f54ec076320 0x7f54ec078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f5509600640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7f54ec080c00 0x7f54ec083050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54f8032440 con 0x7f54ec080c00 2024-05-09T00:09:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f54f80b8d50 con 0x7f550c0af570 2024-05-09T00:09:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f460f400640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4610154080 0x7f4610139700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f460800cdb0 tx=0x7f460800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f173fe00640 1 --2- 172.21.15.114:0/108212614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17400c5fd0 0x7f174006e0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1730009e50 tx=0x7f173002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf774e3cc5b94f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa0d4044070 con 0x7fa0e0033240 2024-05-09T00:09:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f5512400640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7f54ec080c00 0x7f54ec083050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7fd21aa00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c152ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd21400b9c0 tx=0x7fd21400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f173ea00640 1 -- 172.21.15.114:0/108212614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730036070 con 0x7f17400c5fd0 2024-05-09T00:09:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7f173ea00640 1 -- 172.21.15.114:0/108212614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1730031600 con 0x7f17400c5fd0 2024-05-09T00:09:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7f173ea00640 1 -- 172.21.15.114:0/108212614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300319d0 con 0x7f17400c5fd0 2024-05-09T00:09:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== osd.1 v2:172.21.15.114:6822/3701738775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3d8015e50 con 0x7fd3c4080c00 2024-05-09T00:09:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.721+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== osd.0 v2:172.21.15.114:6816/694320788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e440837a0 con 0x7f7e44080c80 2024-05-09T00:09:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7f5512400640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7f54ec080c00 0x7f54ec083050 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7f5511000640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f54ec076320 0x7f54ec078830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f550c0b0c70 tx=0x7f550400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214003b70 con 0x7fd21c072890 2024-05-09T00:09:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1f5fe0 con 0x7fd21c072890 2024-05-09T00:09:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1f65a0 con 0x7fd21c072890 2024-05-09T00:09:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214003d10 con 0x7fd21c072890 2024-05-09T00:09:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214022060 con 0x7fd21c072890 2024-05-09T00:09:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fd3e9400640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd3c4076320 0x7fd3c4078830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0034000 tx=0x7fd3d0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fa0dea00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa0c8076320 0x7fa0c8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fa0d40b8a10 con 0x7fa0e0033240 2024-05-09T00:09:03.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== osd.2 v2:172.21.15.114:6800/1426654840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54f8032440 con 0x7f54ec080c00 2024-05-09T00:09:03.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.722+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460800f680 con 0x7f4610154080 2024-05-09T00:09:03.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4610140790 con 0x7f4610154080 2024-05-09T00:09:03.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101613a0 con 0x7f4610154080 2024-05-09T00:09:03.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460800f840 con 0x7f4610154080 2024-05-09T00:09:03.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460800fc30 con 0x7f4610154080 2024-05-09T00:09:03.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fa0e6000640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa0c8076320 0x7fa0c8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fa0dea00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7fa0c8080c10 0x7fa0c8083060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0d404cec0 con 0x7fa0c8080c10 2024-05-09T00:09:03.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa0d40b8dc0 con 0x7fa0e0033240 2024-05-09T00:09:03.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f1747000640 1 -- 172.21.15.114:0/108212614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17400c5fd0 msgr2=0x7f174006e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.723+0000 7f1747000640 1 --2- 172.21.15.114:0/108212614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17400c5fd0 0x7f174006e0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1730009e50 tx=0x7f173002a680 comp rx=0 tx=0).stop 2024-05-09T00:09:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.724+0000 7f1747000640 1 -- 172.21.15.114:0/108212614 shutdown_connections 2024-05-09T00:09:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.724+0000 7f1747000640 1 --2- 172.21.15.114:0/108212614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17400c5fd0 0x7f174006e0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.724+0000 7f1747000640 1 -- 172.21.15.114:0/108212614 >> 172.21.15.114:0/108212614 conn(0x7f17400cb7b0 msgr2=0x7f17400cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.724+0000 7fa0e7400640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7fa0c8080c10 0x7fa0c8083060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.725+0000 7f1747000640 1 -- 172.21.15.114:0/108212614 shutdown_connections 2024-05-09T00:09:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.725+0000 7f1747000640 1 -- 172.21.15.114:0/108212614 wait complete. 2024-05-09T00:09:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.725+0000 7f9964e00640 1 Processor -- start 2024-05-09T00:09:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.725+0000 7fa0e6000640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa0c8076320 0x7fa0c8078830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8006fd0 tx=0x7fa0d8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.726+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1f4001030 con 0x7fd21c072890 2024-05-09T00:09:03.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.728+0000 7fa0e7400640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7fa0c8080c10 0x7fa0c8083060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.728+0000 7f1747000640 1 Processor -- start 2024-05-09T00:09:03.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.728+0000 7f1747000640 1 -- start start 2024-05-09T00:09:03.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.726+0000 7f9964e00640 1 -- start start 2024-05-09T00:09:03.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.728+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45e8001030 con 0x7f4610154080 2024-05-09T00:09:03.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.728+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd21400cb40 con 0x7fd21c072890 2024-05-09T00:09:03.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f9964e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072890 0x7f996015f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f9964e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9960072d50 0x7f996015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f9964e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9960160600 0x7f99600ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f9964e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99600c42e0 con 0x7f9960072d50 2024-05-09T00:09:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f995d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9960072d50 0x7f996015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46080223f0 con 0x7f4610154080 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f9964e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f996015d490 con 0x7f9960072890 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.729+0000 7f995d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9960072d50 0x7f996015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59324/0 (socket says 172.21.15.114:59324) 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f9964e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f99600c6760 con 0x7f9960160600 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f995de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072890 0x7f996015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f995de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072890 0x7f996015f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54240/0 (socket says 172.21.15.114:54240) 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f995de00640 1 -- 172.21.15.114:0/578688324 learned_addr learned my addr 172.21.15.114:0/578688324 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f995e800640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9960160600 0x7f99600ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f1747000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17400c5fd0 0x7f17401f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f1747000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17400ca020 0x7f17400c1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f1747000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1740158ff0 0x7f1740152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f1747000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f174015c6d0 con 0x7f1740158ff0 2024-05-09T00:09:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f1747000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f174015baa0 con 0x7f17400c5fd0 2024-05-09T00:09:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f1747000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f17400c8530 con 0x7f17400ca020 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f4606a00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45f00764d0 0x7f45f00789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.730+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f460800f9f0 con 0x7f4610154080 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f460ea00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45f00764d0 0x7f45f00789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f4606a00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7f45f0080cb0 0x7f45f0083100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 --> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f460801fe80 con 0x7f45f0080cb0 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f460809f050 con 0x7f4610154080 2024-05-09T00:09:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7fd212a00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd1f80762d0 0x7fd1f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fd214097890 con 0x7fd21c072890 2024-05-09T00:09:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7fd212a00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fd1f8080b30 0x7fd1f8082f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 --> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd214011e50 con 0x7fd1f8080b30 2024-05-09T00:09:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd21409c2a0 con 0x7fd21c072890 2024-05-09T00:09:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f173fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17400c5fd0 0x7f17401f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f1745000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1740158ff0 0x7f1740152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f1745000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1740158ff0 0x7f1740152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59338/0 (socket says 172.21.15.114:59338) 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f1745000640 1 -- 172.21.15.114:0/2671829531 learned_addr learned my addr 172.21.15.114:0/2671829531 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f173f400640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17400ca020 0x7f17400c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f995de00640 1 -- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9960160600 msgr2=0x7f99600ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f995de00640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9960160600 0x7f99600ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.731+0000 7f995de00640 1 -- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9960072d50 msgr2=0x7f996015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f995de00640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9960072d50 0x7f996015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f995de00640 1 -- 172.21.15.114:0/578688324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99601e8420 con 0x7f9960072890 2024-05-09T00:09:03.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7fd21a000640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd1f80762d0 0x7fd1f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== osd.4 v2:172.21.15.153:6800/2251471129 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0d404cec0 con 0x7fa0c8080c10 2024-05-09T00:09:03.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f460e000640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7f45f0080cb0 0x7f45f0083100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f1745000640 1 -- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17400ca020 msgr2=0x7f17400c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f1745000640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17400ca020 0x7f17400c1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f1745000640 1 -- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17400c5fd0 msgr2=0x7f17401f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f1745000640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17400c5fd0 0x7f17401f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f1745000640 1 -- 172.21.15.114:0/2671829531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17401f6790 con 0x7f1740158ff0 2024-05-09T00:09:03.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.732+0000 7f995d400640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9960072d50 0x7f996015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:03.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.733+0000 7f460e000640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7f45f0080cb0 0x7f45f0083100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.733+0000 7fd21b400640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fd1f8080b30 0x7fd1f8082f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.733+0000 7f460ea00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45f00764d0 0x7f45f00789e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4600034000 tx=0x7f460002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.734+0000 7fd21a000640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd1f80762d0 0x7fd1f80787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd204034000 tx=0x7fd20402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.734+0000 7f1745000640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1740158ff0 0x7f1740152990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f173800c3c0 tx=0x7f173800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.734+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738017070 con 0x7f1740158ff0 2024-05-09T00:09:03.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.735+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17380035f0 con 0x7f1740158ff0 2024-05-09T00:09:03.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.735+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738017070 con 0x7f1740158ff0 2024-05-09T00:09:03.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.735+0000 7f995de00640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072890 0x7f996015f550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9950000c00 tx=0x7f99500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.735+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== osd.3 v2:172.21.15.114:6808/3419026789 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f460801fe80 con 0x7f45f0080cb0 2024-05-09T00:09:03.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.736+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950041020 con 0x7f9960072890 2024-05-09T00:09:03.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.735+0000 7f1747000640 1 -- 172.21.15.114:0/2671829531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17400abc30 con 0x7f1740158ff0 2024-05-09T00:09:03.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.735+0000 7f1747000640 1 -- 172.21.15.114:0/2671829531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17400c1000 con 0x7f1740158ff0 2024-05-09T00:09:03.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.736+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99601e9d10 con 0x7f9960072890 2024-05-09T00:09:03.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.736+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99500306c0 con 0x7f9960072890 2024-05-09T00:09:03.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.736+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950037040 con 0x7f9960072890 2024-05-09T00:09:03.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.737+0000 7fd21b400640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fd1f8080b30 0x7fd1f8082f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.739+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== osd.5 v2:172.21.15.153:6824/4042985411 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd214011e50 con 0x7fd1f8080b30 2024-05-09T00:09:03.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.738+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99601e9a30 con 0x7f9960072890 2024-05-09T00:09:03.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.740+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f173801a070 con 0x7f1740158ff0 2024-05-09T00:09:03.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.741+0000 7f1747000640 1 -- 172.21.15.114:0/2671829531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1740077430 con 0x7f1740158ff0 2024-05-09T00:09:03.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.742+0000 7f1737e00640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f171c0764d0 0x7f171c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f1738096770 con 0x7f1740158ff0 2024-05-09T00:09:03.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f1737e00640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f171c080db0 0x7f171c083200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 --> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f171c0838d0 con 0x7f171c080db0 2024-05-09T00:09:03.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.741+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9950044020 con 0x7f9960072890 2024-05-09T00:09:03.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.742+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9960077430 con 0x7f9960072890 2024-05-09T00:09:03.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f173809d050 con 0x7f1740158ff0 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f9956000640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f99400762d0 0x7f99400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f99500bc060 con 0x7f9960072890 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f9956000640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f9940080ac0 0x7f9940082f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 --> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9950043e50 con 0x7f9940080ac0 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.743+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f995007cb90 con 0x7f9960072890 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.744+0000 7f173f400640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f171c080db0 0x7f171c083200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.744+0000 7f173fe00640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f171c0764d0 0x7f171c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.744+0000 7f995d400640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f99400762d0 0x7f99400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.744+0000 7f995e800640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f9940080ac0 0x7f9940082f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.745+0000 7f173f400640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f171c080db0 0x7f171c083200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.745+0000 7f173fe00640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f171c0764d0 0x7f171c0789e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1730033000 tx=0x7f1730009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.745+0000 7f995d400640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f99400762d0 0x7f99400787e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f994c006fd0 tx=0x7f994c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.746+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 --> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f550c078430 con 0x7f54ec080c00 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.747+0000 7f5509600640 1 -- 172.21.15.114:0/369643483 <== osd.2 v2:172.21.15.114:6800/1426654840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f550c078430 con 0x7f54ec080c00 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7f54ec080c00 msgr2=0x7f54ec083050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7f54ec080c00 0x7f54ec083050 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f54ec076320 msgr2=0x7f54ec078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f54ec076320 0x7f54ec078830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f550c0b0c70 tx=0x7f550400b040 comp rx=0 tx=0).stop 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0af570 msgr2=0x7f550c0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 --2- 172.21.15.114:0/369643483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0af570 0x7f550c0b14c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54f80098c0 tx=0x7f54f80046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512400640 1 -- 172.21.15.114:0/369643483 reap_dead start 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f995e800640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f9940080ac0 0x7f9940082f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== osd.6 v2:172.21.15.153:6808/3084340676 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f171c0838d0 con 0x7f171c080db0 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 shutdown_connections 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.748+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 >> 172.21.15.114:0/369643483 conn(0x7f550c068ef0 msgr2=0x7f550c0cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.749+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 shutdown_connections 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.749+0000 7f5512e00640 1 -- 172.21.15.114:0/369643483 wait complete. 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.751+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 --> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd3dc00c5a0 con 0x7fd3c4080c00 2024-05-09T00:09:03.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.751+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== osd.7 v2:172.21.15.153:6816/3047453472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9950043e50 con 0x7f9940080ac0 2024-05-09T00:09:03.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.754+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 --> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e5c0d5c40 con 0x7f7e44080c80 2024-05-09T00:09:03.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.755+0000 7f7e57400640 1 -- 172.21.15.114:0/1620088958 <== osd.0 v2:172.21.15.114:6816/694320788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e5c0d5c40 con 0x7f7e44080c80 2024-05-09T00:09:03.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.753+0000 7fd3e1600640 1 -- 172.21.15.114:0/2435398269 <== osd.1 v2:172.21.15.114:6822/3701738775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd3dc00c5a0 con 0x7fd3c4080c00 2024-05-09T00:09:03.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.754+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7fd3c4080c00 msgr2=0x7fd3c4083050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.754+0000 7fd3ea800640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7fd3c4080c00 0x7fd3c4083050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.755+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd3c4076320 msgr2=0x7fd3c4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.755+0000 7fd3ea800640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd3c4076320 0x7fd3c4078830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0034000 tx=0x7fd3d0009000 comp rx=0 tx=0).stop 2024-05-09T00:09:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.755+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0d4050 msgr2=0x7fd3dc0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.755+0000 7fd3ea800640 1 --2- 172.21.15.114:0/2435398269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3dc0d4050 0x7fd3dc0d3280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800d580 tx=0x7fd3d800da40 comp rx=0 tx=0).stop 2024-05-09T00:09:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7fd3e9e00640 1 -- 172.21.15.114:0/2435398269 reap_dead start 2024-05-09T00:09:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f7e44080c80 msgr2=0x7f7e440830d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e68c00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f7e44080c80 0x7f7e440830d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 shutdown_connections 2024-05-09T00:09:03.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 >> 172.21.15.114:0/2435398269 conn(0x7fd3dc006090 msgr2=0x7fd3dc0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7e440763a0 msgr2=0x7f7e440788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e68c00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7e440763a0 0x7f7e440788b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e50000f60 tx=0x7f7e50009040 comp rx=0 tx=0).stop 2024-05-09T00:09:03.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e5c0db770 msgr2=0x7f7e5c0d53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e68c00640 1 --2- 172.21.15.114:0/1620088958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e5c0db770 0x7f7e5c0d53c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e64066140 tx=0x7f7e64078020 comp rx=0 tx=0).stop 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.756+0000 7f7e63e00640 1 -- 172.21.15.114:0/1620088958 reap_dead start 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.757+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 shutdown_connections 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.757+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 >> 172.21.15.114:0/1620088958 conn(0x7f7e5c04c830 msgr2=0x7f7e5c02f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.757+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 shutdown_connections 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.757+0000 7fd3ea800640 1 -- 172.21.15.114:0/2435398269 wait complete. 2024-05-09T00:09:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.757+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 shutdown_connections 2024-05-09T00:09:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.757+0000 7f7e68c00640 1 -- 172.21.15.114:0/1620088958 wait complete. 2024-05-09T00:09:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.767+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 --> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0e004dfa0 con 0x7fa0c8080c10 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.769+0000 7fa0dea00640 1 -- 172.21.15.114:0/1269351102 <== osd.4 v2:172.21.15.153:6800/2251471129 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa0e004dfa0 con 0x7fa0c8080c10 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.770+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7fa0c8080c10 msgr2=0x7fa0c8083060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.770+0000 7fa0e7e00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7fa0c8080c10 0x7fa0c8083060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.770+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa0c8076320 msgr2=0x7fa0c8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.770+0000 7fa0e7e00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa0c8076320 0x7fa0c8078830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8006fd0 tx=0x7fa0d8009060 comp rx=0 tx=0).stop 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.770+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e0033240 msgr2=0x7fa0e000e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.770+0000 7fa0e7e00640 1 --2- 172.21.15.114:0/1269351102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0e0033240 0x7fa0e000e6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40090b0 tx=0x7fa0d40046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.771+0000 7fa0e7400640 1 -- 172.21.15.114:0/1269351102 reap_dead start 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.771+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 shutdown_connections 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.771+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 >> 172.21.15.114:0/1269351102 conn(0x7fa0e004c830 msgr2=0x7fa0e0030810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.772+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 --> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45e8002dd0 con 0x7f45f0080cb0 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.773+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 shutdown_connections 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.773+0000 7fa0e7e00640 1 -- 172.21.15.114:0/1269351102 wait complete. 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.774+0000 7f4606a00640 1 -- 172.21.15.114:0/2782490593 <== osd.3 v2:172.21.15.114:6808/3419026789 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45e8002dd0 con 0x7f45f0080cb0 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.774+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 --> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd1f4002dd0 con 0x7fd1f8080b30 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.774+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7f45f0080cb0 msgr2=0x7f45f0083100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.774+0000 7f460fe00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7f45f0080cb0 0x7f45f0083100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.775+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45f00764d0 msgr2=0x7f45f00789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.775+0000 7f460fe00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f45f00764d0 0x7f45f00789e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4600034000 tx=0x7f460002e000 comp rx=0 tx=0).stop 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.775+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4610154080 msgr2=0x7f4610139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.775+0000 7f460fe00640 1 --2- 172.21.15.114:0/2782490593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4610154080 0x7f4610139700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f460800cdb0 tx=0x7f460800a650 comp rx=0 tx=0).stop 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.775+0000 7f460f400640 1 -- 172.21.15.114:0/2782490593 reap_dead start 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.776+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 shutdown_connections 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.776+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 >> 172.21.15.114:0/2782490593 conn(0x7f46100c5ea0 msgr2=0x7f46100ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.776+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 shutdown_connections 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.776+0000 7f460fe00640 1 -- 172.21.15.114:0/2782490593 wait complete. 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.776+0000 7fd212a00640 1 -- 172.21.15.114:0/1404013683 <== osd.5 v2:172.21.15.153:6824/4042985411 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd1f4002dd0 con 0x7fd1f8080b30 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.777+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fd1f8080b30 msgr2=0x7fd1f8082f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.777+0000 7fd221c00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fd1f8080b30 0x7fd1f8082f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd1f80762d0 msgr2=0x7fd1f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd1f80762d0 0x7fd1f80787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd204034000 tx=0x7fd20402e000 comp rx=0 tx=0).stop 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 msgr2=0x7fd21c152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 --2- 172.21.15.114:0/1404013683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c072890 0x7fd21c152ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd21400b9c0 tx=0x7fd21400be80 comp rx=0 tx=0).stop 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd21b400640 1 -- 172.21.15.114:0/1404013683 reap_dead start 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 shutdown_connections 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 >> 172.21.15.114:0/1404013683 conn(0x7fd21c06c680 msgr2=0x7fd21c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 shutdown_connections 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.778+0000 7fd221c00640 1 -- 172.21.15.114:0/1404013683 wait complete. 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.779+0000 7f1747000640 1 -- 172.21.15.114:0/2671829531 --> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f17400c9e00 con 0x7f171c080db0 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.782+0000 7f1737e00640 1 -- 172.21.15.114:0/2671829531 <== osd.6 v2:172.21.15.153:6808/3084340676 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f17400c9e00 con 0x7f171c080db0 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.782+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f171c080db0 msgr2=0x7f171c083200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.782+0000 7f1735600640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f171c080db0 0x7f171c083200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f171c0764d0 msgr2=0x7f171c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1735600640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f171c0764d0 0x7f171c0789e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1730033000 tx=0x7f1730009000 comp rx=0 tx=0).stop 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1740158ff0 msgr2=0x7f1740152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1735600640 1 --2- 172.21.15.114:0/2671829531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1740158ff0 0x7f1740152990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f173800c3c0 tx=0x7f173800c880 comp rx=0 tx=0).stop 2024-05-09T00:09:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1745000640 1 -- 172.21.15.114:0/2671829531 reap_dead start 2024-05-09T00:09:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 shutdown_connections 2024-05-09T00:09:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 --> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99600c4540 con 0x7f9940080ac0 2024-05-09T00:09:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.783+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 >> 172.21.15.114:0/2671829531 conn(0x7f17400cb7b0 msgr2=0x7f17401547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.785+0000 7f9956000640 1 -- 172.21.15.114:0/578688324 <== osd.7 v2:172.21.15.153:6816/3047453472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f99600c4540 con 0x7f9940080ac0 2024-05-09T00:09:03.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.785+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 shutdown_connections 2024-05-09T00:09:03.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.785+0000 7f1735600640 1 -- 172.21.15.114:0/2671829531 wait complete. 2024-05-09T00:09:03.813 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-05-09T00:09:03.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.786+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f9940080ac0 msgr2=0x7f9940082f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.786+0000 7f9964e00640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f9940080ac0 0x7f9940082f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.787+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f99400762d0 msgr2=0x7f99400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.787+0000 7f9964e00640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f99400762d0 0x7f99400787e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f994c006fd0 tx=0x7f994c008040 comp rx=0 tx=0).stop 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.787+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072890 msgr2=0x7f996015f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.787+0000 7f9964e00640 1 --2- 172.21.15.114:0/578688324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9960072890 0x7f996015f550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9950000c00 tx=0x7f99500046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.787+0000 7f995e800640 1 -- 172.21.15.114:0/578688324 reap_dead start 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.789+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 shutdown_connections 2024-05-09T00:09:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.789+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 >> 172.21.15.114:0/578688324 conn(0x7f996006c680 msgr2=0x7f996015c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.789+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 shutdown_connections 2024-05-09T00:09:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:03.789+0000 7f9964e00640 1 -- 172.21.15.114:0/578688324 wait complete. 2024-05-09T00:09:03.816 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-05-09T00:09:03.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T00:09:03.817 INFO:teuthology.orchestra.run.smithi114.stdout:64424509449 2024-05-09T00:09:03.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T00:09:03.818 INFO:teuthology.orchestra.run.smithi114.stdout:60129542152 2024-05-09T00:09:03.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T00:09:03.819 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-05-09T00:09:03.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T00:09:03.821 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-05-09T00:09:03.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T00:09:03.823 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-05-09T00:09:03.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi114.stdout:64424509449 2024-05-09T00:09:03.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.216+0000 7f77cb800640 1 Processor -- start 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.216+0000 7f77cb800640 1 -- start start 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.218+0000 7f80faa00640 1 Processor -- start 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.218+0000 7f80faa00640 1 -- start start 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.218+0000 7f77cb800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77c406e010 0x7f77c40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.218+0000 7f77cb800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c40c9e50 con 0x7f77c40c7a70 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.218+0000 7f77cb800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c40ca130 con 0x7f77c415fca0 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.219+0000 7f77cb800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f77c40c6060 con 0x7f77c406e010 2024-05-09T00:09:04.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.219+0000 7f32c1000640 1 Processor -- start 2024-05-09T00:09:04.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.219+0000 7f32c1000640 1 -- start start 2024-05-09T00:09:04.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.219+0000 7f77c8e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f77c40c7a70 0x7f77c40c6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53162/0 (socket says 172.21.15.114:53162) 2024-05-09T00:09:04.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.219+0000 7f77c8e00640 1 -- 172.21.15.114:0/784451386 learned_addr learned my addr 172.21.15.114:0/784451386 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.220+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500885520 0 0) 0x7f77c40c9e50 con 0x7f77c40c7a70 2024-05-09T00:09:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.220+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a4003520 con 0x7f77c40c7a70 2024-05-09T00:09:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f80faa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f80ec04f790 0x7f80ec0ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f80faa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ec0433f0 con 0x7f80ec04c490 2024-05-09T00:09:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f80faa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ec04dd60 con 0x7f80ec04ebf0 2024-05-09T00:09:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f80faa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f80ec033780 con 0x7f80ec04f790 2024-05-09T00:09:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f80f3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f80ec04c490 0x7f80ec007590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53164/0 (socket says 172.21.15.114:53164) 2024-05-09T00:09:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f80f3e00640 1 -- 172.21.15.114:0/2927924065 learned_addr learned my addr 172.21.15.114:0/2927924065 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 416048804 0 0) 0x7f77a4003520 con 0x7f77c40c7a70 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77c406e010 msgr2=0x7f77c40c6c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77c406e010 0x7f77c40c6c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 >> v1:172.21.15.153:6789/0 conn(0x7f77c415fca0 legacy=0x7f77c41600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c40ca410 con 0x7f77c40c7a70 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f77ac001a70 con 0x7f77c40c7a70 2024-05-09T00:09:04.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 >> v1:172.21.15.114:6789/0 conn(0x7f77c40c7a70 legacy=0x7f77c40c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77a4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a4004800 0x7f77a4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a4005350 0x7f77a400b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77a400c290 con 0x7f77a4005350 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f77a400c440 con 0x7f77a4004800 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.221+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f77a400c640 con 0x7f77a4003a80 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f32c1000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32b404bfb0 0x7f32b4040b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f32c1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b4048580 0x7f32b40df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f32c1000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32b400aae0 0x7f32b40df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f32c1000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40e2e50 con 0x7f32b400aae0 2024-05-09T00:09:04.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f32c1000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40e3130 con 0x7f32b404bfb0 2024-05-09T00:09:04.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f80f8a00640 1 --2- 172.21.15.114:0/2927924065 >> v2:172.21.15.153:3300/0 conn(0x7f80ec04f790 0x7f80ec0ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f32c1000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f32b4049d10 con 0x7f32b4048580 2024-05-09T00:09:04.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.222+0000 7f1228a00640 1 Processor -- start 2024-05-09T00:09:04.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f32ba800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32b400aae0 0x7f32b40df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f32b9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32b404bfb0 0x7f32b4040b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f32b9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b4048580 0x7f32b40df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f32ba800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32b400aae0 0x7f32b40df560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59352/0 (socket says 172.21.15.114:59352) 2024-05-09T00:09:04.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f32ba800640 1 -- 172.21.15.114:0/3930664125 learned_addr learned my addr 172.21.15.114:0/3930664125 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f77c9800640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a4005350 0x7f77a400b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f77c8e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77a4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.224+0000 7f32ba800640 1 -- 172.21.15.114:0/3930664125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b4048580 msgr2=0x7f32b40df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.224+0000 7f32ba800640 1 --2- 172.21.15.114:0/3930664125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b4048580 0x7f32b40df020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.224+0000 7f32ba800640 1 -- 172.21.15.114:0/3930664125 >> v2:172.21.15.153:3300/0 conn(0x7f32b404bfb0 msgr2=0x7f32b4040b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.223+0000 7f1228a00640 1 -- start start 2024-05-09T00:09:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f1228a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224160600 0x7f12240c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f1228a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122415fe20 con 0x7f1224072890 2024-05-09T00:09:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f1228a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122415d1b0 con 0x7f1224072d50 2024-05-09T00:09:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f1228a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1224160170 con 0x7f1224160600 2024-05-09T00:09:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7fb696c00640 1 Processor -- start 2024-05-09T00:09:04.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f77c8e00640 1 -- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a4004800 msgr2=0x7f77a4004c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:09:04.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f77c8e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a4004800 0x7f77a4004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f77c8e00640 1 -- 172.21.15.114:0/784451386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a4005350 msgr2=0x7f77a400b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f77c8e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a4005350 0x7f77a400b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f77c8e00640 1 -- 172.21.15.114:0/784451386 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c40ca410 con 0x7f77a4003a80 2024-05-09T00:09:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7fb696c00640 1 -- start start 2024-05-09T00:09:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f32ba800640 1 --2- 172.21.15.114:0/3930664125 >> v2:172.21.15.153:3300/0 conn(0x7f32b404bfb0 0x7f32b4040b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f32ba800640 1 -- 172.21.15.114:0/3930664125 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4049ff0 con 0x7f32b400aae0 2024-05-09T00:09:04.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f32b9e00640 1 --2- 172.21.15.114:0/3930664125 >> v2:172.21.15.153:3300/0 conn(0x7f32b404bfb0 0x7f32b4040b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:04.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f1221e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1224072d50 0x7f12240c4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:40818/0 (socket says 172.21.15.114:40818) 2024-05-09T00:09:04.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f1221e00640 1 -- 172.21.15.114:0/2285443722 learned_addr learned my addr 172.21.15.114:0/2285443722 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:04.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f1221400640 1 --1- 172.21.15.114:0/2285443722 >> v1:172.21.15.114:6789/0 conn(0x7f1224072890 0x7f1224159c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53170/0 (socket says 172.21.15.114:53170) 2024-05-09T00:09:04.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f80f2a00640 1 -- 172.21.15.114:0/2927924065 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466285625 0 0) 0x7f80ec0433f0 con 0x7f80ec04c490 2024-05-09T00:09:04.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.225+0000 7f80f2a00640 1 -- 172.21.15.114:0/2927924065 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80dc003520 con 0x7f80ec04c490 2024-05-09T00:09:04.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f80f8a00640 1 -- 172.21.15.114:0/2927924065 >> v1:172.21.15.153:6789/0 conn(0x7f80ec04ebf0 legacy=0x7f80ec033070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f80f8a00640 1 -- 172.21.15.114:0/2927924065 >> v1:172.21.15.114:6789/0 conn(0x7f80ec04c490 legacy=0x7f80ec007590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f80f8a00640 1 -- 172.21.15.114:0/2927924065 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec04b180 con 0x7f80ec04f790 2024-05-09T00:09:04.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f1222800640 1 --2- 172.21.15.114:0/2285443722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224160600 0x7f12240c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.226+0000 7f32ba800640 1 --2- 172.21.15.114:0/3930664125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b40df560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32bc075320 tx=0x7f32bc0a7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a381d000b102104 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f1220a00640 1 -- 172.21.15.114:0/2285443722 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096428572 0 0) 0x7f122415fe20 con 0x7f1224072890 2024-05-09T00:09:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f1220a00640 1 -- 172.21.15.114:0/2285443722 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1208003520 con 0x7f1224072890 2024-05-09T00:09:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f32b8a00640 1 -- 172.21.15.114:0/3930664125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0b5070 con 0x7f32b400aae0 2024-05-09T00:09:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f77c8e00640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77a4003ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00a900 tx=0x7f77a4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1424ac82972c61 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f32b8a00640 1 -- 172.21.15.114:0/3930664125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc0a8b30 con 0x7f32b400aae0 2024-05-09T00:09:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f32b8a00640 1 -- 172.21.15.114:0/3930664125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0b0440 con 0x7f32b400aae0 2024-05-09T00:09:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00a520 con 0x7f77a4003a80 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.228+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac02f070 con 0x7f77a4003a80 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.228+0000 7f77c3e00640 1 -- 172.21.15.114:0/784451386 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac02bd20 con 0x7f77a4003a80 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f80f8a00640 1 --2- 172.21.15.114:0/2927924065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec04f790 0x7f80ec0ea0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80f4051620 tx=0x7f80f40a7ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6591d2bafc93ba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.228+0000 7f80f2a00640 1 -- 172.21.15.114:0/2927924065 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40b5070 con 0x7f80ec04f790 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.228+0000 7fb696c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb6900c3190 0x7fb690140e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb696c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb690073550 0x7fb690073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb68f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb6900c3190 0x7fb690140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f1222800640 1 -- 172.21.15.114:0/2285443722 >> v1:172.21.15.153:6789/0 conn(0x7f1224072d50 legacy=0x7f12240c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f1220a00640 1 -- 172.21.15.114:0/2285443722 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1259601782 0 0) 0x7f1208003520 con 0x7f1224072890 2024-05-09T00:09:04.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f1222800640 1 -- 172.21.15.114:0/2285443722 >> v1:172.21.15.114:6789/0 conn(0x7f1224072890 legacy=0x7f1224159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.227+0000 7f1222800640 1 -- 172.21.15.114:0/2285443722 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122415d490 con 0x7f1224160600 2024-05-09T00:09:04.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb68f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb6900c3190 0x7fb690140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59366/0 (socket says 172.21.15.114:59366) 2024-05-09T00:09:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb68f400640 1 -- 172.21.15.114:0/4115382831 learned_addr learned my addr 172.21.15.114:0/4115382831 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb696c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69015c740 con 0x7fb69015c260 2024-05-09T00:09:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb690158cf0 con 0x7fb6900c3190 2024-05-09T00:09:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.228+0000 7f80f2a00640 1 -- 172.21.15.114:0/2927924065 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f40a8ae0 con 0x7f80ec04f790 2024-05-09T00:09:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.228+0000 7f80f2a00640 1 -- 172.21.15.114:0/2927924065 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40b0440 con 0x7f80ec04f790 2024-05-09T00:09:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f80faa00640 1 -- 172.21.15.114:0/2927924065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec04f790 msgr2=0x7f80ec0ea0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f80faa00640 1 --2- 172.21.15.114:0/2927924065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec04f790 0x7f80ec0ea0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80f4051620 tx=0x7f80f40a7ee0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f80faa00640 1 -- 172.21.15.114:0/2927924065 shutdown_connections 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f80faa00640 1 --2- 172.21.15.114:0/2927924065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec04f790 0x7f80ec0ea0b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f80faa00640 1 -- 172.21.15.114:0/2927924065 >> 172.21.15.114:0/2927924065 conn(0x7f80ec04c8a0 msgr2=0x7f80ec04ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f77cb800640 1 -- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 msgr2=0x7f77a4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb6901583c0 con 0x7fb690073550 2024-05-09T00:09:04.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7fb694c00640 1 --2- 172.21.15.114:0/4115382831 >> v2:172.21.15.153:3300/0 conn(0x7fb690073550 0x7fb690073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.229+0000 7f77cb800640 1 --2- 172.21.15.114:0/784451386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77a4003ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00a900 tx=0x7f77a4005830 comp rx=0 tx=0).stop 2024-05-09T00:09:04.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f80faa00640 1 -- 172.21.15.114:0/2927924065 shutdown_connections 2024-05-09T00:09:04.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7fb68f400640 1 -- 172.21.15.114:0/4115382831 >> v2:172.21.15.153:3300/0 conn(0x7fb690073550 msgr2=0x7fb690073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7fb68f400640 1 --2- 172.21.15.114:0/4115382831 >> v2:172.21.15.153:3300/0 conn(0x7fb690073550 0x7fb690073960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7fb68f400640 1 -- 172.21.15.114:0/4115382831 >> v1:172.21.15.153:6789/0 conn(0x7fb69015c260 legacy=0x7fb6900c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7fb68f400640 1 -- 172.21.15.114:0/4115382831 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6901586a0 con 0x7fb6900c3190 2024-05-09T00:09:04.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f77c9800640 1 -- 172.21.15.114:0/784451386 reap_dead start 2024-05-09T00:09:04.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f8f97a00640 1 Processor -- start 2024-05-09T00:09:04.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f77cb800640 1 -- 172.21.15.114:0/784451386 shutdown_connections 2024-05-09T00:09:04.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f77cb800640 1 -- 172.21.15.114:0/784451386 >> 172.21.15.114:0/784451386 conn(0x7f77c40cbb70 msgr2=0x7f77c40ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f32c1000640 1 -- 172.21.15.114:0/3930664125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 msgr2=0x7f32b40df560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f32c1000640 1 --2- 172.21.15.114:0/3930664125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b40df560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32bc075320 tx=0x7f32bc0a7f30 comp rx=0 tx=0).stop 2024-05-09T00:09:04.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f8f97a00640 1 -- start start 2024-05-09T00:09:04.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.230+0000 7f80faa00640 1 -- 172.21.15.114:0/2927924065 wait complete. 2024-05-09T00:09:04.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f1222800640 1 --2- 172.21.15.114:0/2285443722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224160600 0x7f12240c6050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f121c009dc0 tx=0x7f121c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f9f658635099ba8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 -- 172.21.15.114:0/3930664125 shutdown_connections 2024-05-09T00:09:04.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 --2- 172.21.15.114:0/3930664125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b40df560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 --2- 172.21.15.114:0/3930664125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b4048580 0x7f32b40df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 --2- 172.21.15.114:0/3930664125 >> v2:172.21.15.153:3300/0 conn(0x7f32b404bfb0 0x7f32b4040b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 -- 172.21.15.114:0/3930664125 >> 172.21.15.114:0/3930664125 conn(0x7f32b404aa10 msgr2=0x7f32b404ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 -- 172.21.15.114:0/3930664125 shutdown_connections 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f1220a00640 1 -- 172.21.15.114:0/2285443722 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1210001710 con 0x7f1224160600 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f1220a00640 1 -- 172.21.15.114:0/2285443722 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c007540 con 0x7f1224160600 2024-05-09T00:09:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f1220a00640 1 -- 172.21.15.114:0/2285443722 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c007910 con 0x7f1224160600 2024-05-09T00:09:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.231+0000 7f32c1000640 1 -- 172.21.15.114:0/3930664125 wait complete. 2024-05-09T00:09:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f77cb800640 1 -- 172.21.15.114:0/784451386 shutdown_connections 2024-05-09T00:09:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f1228a00640 1 -- 172.21.15.114:0/2285443722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224160600 msgr2=0x7f12240c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f1228a00640 1 --2- 172.21.15.114:0/2285443722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224160600 0x7f12240c6050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f121c009dc0 tx=0x7f121c02a5f0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f77cb800640 1 -- 172.21.15.114:0/784451386 wait complete. 2024-05-09T00:09:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f8f97a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f900ae680 0x7f8f900b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f1228a00640 1 -- 172.21.15.114:0/2285443722 shutdown_connections 2024-05-09T00:09:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7fb68f400640 1 --2- 172.21.15.114:0/4115382831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb690140e60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb6900c2ea0 tx=0x7fb67c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6332f9ad42816101 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f1228a00640 1 --2- 172.21.15.114:0/2285443722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224160600 0x7f12240c6050 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.233+0000 7f1228a00640 1 -- 172.21.15.114:0/2285443722 >> 172.21.15.114:0/2285443722 conn(0x7f122406c680 msgr2=0x7f122406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f80faa00640 1 Processor -- start 2024-05-09T00:09:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f80faa00640 1 -- start start 2024-05-09T00:09:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f8f97a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f900c74a0 0x7f8f900c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f1228a00640 1 -- 172.21.15.114:0/2285443722 shutdown_connections 2024-05-09T00:09:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f8f8fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f900c74a0 0x7f8f900c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f8f97a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f900aee90 con 0x7f8f90159650 2024-05-09T00:09:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f8f97a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8f900c6100 con 0x7f8f900c74a0 2024-05-09T00:09:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.235+0000 7f8f95a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8f90159650 0x7f8f90159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53184/0 (socket says 172.21.15.114:53184) 2024-05-09T00:09:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.235+0000 7f8f95a00640 1 -- 172.21.15.114:0/4222170985 learned_addr learned my addr 172.21.15.114:0/4222170985 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.234+0000 7f1228a00640 1 -- 172.21.15.114:0/2285443722 wait complete. 2024-05-09T00:09:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.235+0000 7f8f95000640 1 --2- 172.21.15.114:0/4222170985 >> v2:172.21.15.153:3300/0 conn(0x7f8f900ae680 0x7f8f900b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.235+0000 7f32c1000640 1 Processor -- start 2024-05-09T00:09:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.235+0000 7f8f8f400640 1 -- 172.21.15.114:0/4222170985 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843304000 0 0) 0x7f8f900aee90 con 0x7f8f90159650 2024-05-09T00:09:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f32c1000640 1 -- start start 2024-05-09T00:09:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.235+0000 7fb68ea00640 1 -- 172.21.15.114:0/4115382831 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c037070 con 0x7fb6900c3190 2024-05-09T00:09:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7fb68ea00640 1 -- 172.21.15.114:0/4115382831 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c032440 con 0x7fb6900c3190 2024-05-09T00:09:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7fb68ea00640 1 -- 172.21.15.114:0/4115382831 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c032810 con 0x7fb6900c3190 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f80faa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80ec04c490 0x7f80ec0dc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f80faa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 0x7f80ec177c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f80faa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec049bc0 0x7f80ec041f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f80faa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec035ae0 con 0x7f80ec04c490 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f80faa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec04b4f0 con 0x7f80ec049bc0 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.236+0000 7f80faa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec035c60 con 0x7f80ec04f790 2024-05-09T00:09:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f80f3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 0x7f80ec177c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 msgr2=0x7fb690140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7fb696c00640 1 --2- 172.21.15.114:0/4115382831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb690140e60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb6900c2ea0 tx=0x7fb67c02a1e0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f80f3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 0x7f80ec177c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:49994/0 (socket says 172.21.15.114:49994) 2024-05-09T00:09:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f80f3400640 1 -- 172.21.15.114:0/3070155471 learned_addr learned my addr 172.21.15.114:0/3070155471 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f80f3e00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80ec04c490 0x7f80ec0dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f80f8a00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec049bc0 0x7f80ec041f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f8f97a00640 1 -- 172.21.15.114:0/4222170985 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8f900aebb0 con 0x7f8f900ae680 2024-05-09T00:09:04.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 shutdown_connections 2024-05-09T00:09:04.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7fb696c00640 1 --2- 172.21.15.114:0/4115382831 >> v2:172.21.15.153:3300/0 conn(0x7fb690073550 0x7fb690073960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7fb696c00640 1 --2- 172.21.15.114:0/4115382831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb690140e60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 >> 172.21.15.114:0/4115382831 conn(0x7fb69006c680 msgr2=0x7fb69006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7f8f8f400640 1 -- 172.21.15.114:0/4222170985 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f74007930 con 0x7f8f90159650 2024-05-09T00:09:04.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.237+0000 7f77cb800640 1 Processor -- start 2024-05-09T00:09:04.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7f77cb800640 1 -- start start 2024-05-09T00:09:04.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 shutdown_connections 2024-05-09T00:09:04.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7f32c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b4174e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7f32c1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b4048580 0x7f32b4178cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7fb696c00640 1 -- 172.21.15.114:0/4115382831 wait complete. 2024-05-09T00:09:04.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.238+0000 7f32c1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b404bfb0 0x7f32b40de400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f8f8fe00640 1 -- 172.21.15.114:0/4222170985 >> v2:172.21.15.153:3300/0 conn(0x7f8f900ae680 msgr2=0x7f8f900b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f8f8f400640 1 -- 172.21.15.114:0/4222170985 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 307164608 0 0) 0x7f8f74007930 con 0x7f8f90159650 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f8f8fe00640 1 --2- 172.21.15.114:0/4222170985 >> v2:172.21.15.153:3300/0 conn(0x7f8f900ae680 0x7f8f900b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f8f8fe00640 1 -- 172.21.15.114:0/4222170985 >> v1:172.21.15.114:6789/0 conn(0x7f8f90159650 legacy=0x7f8f90159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f8f8fe00640 1 -- 172.21.15.114:0/4222170985 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f900c63a0 con 0x7f8f900c74a0 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f32c1000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40dc7a0 con 0x7f32b400aae0 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f32c1000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40dc620 con 0x7f32b4048580 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f32c1000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f32b40dfaa0 con 0x7f32b404bfb0 2024-05-09T00:09:04.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f1228a00640 1 Processor -- start 2024-05-09T00:09:04.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f32b9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b4174e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.240+0000 7f1228a00640 1 -- start start 2024-05-09T00:09:04.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.239+0000 7f32b9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b4048580 0x7f32b4178cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.240+0000 7f32b9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b4048580 0x7f32b4178cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54294/0 (socket says 172.21.15.114:54294) 2024-05-09T00:09:04.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.240+0000 7f80f3400640 1 -- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec049bc0 msgr2=0x7f80ec041f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.240+0000 7f77cb800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77c40afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f8f8fe00640 1 --2- 172.21.15.114:0/4222170985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900c74a0 0x7f8f900c78b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f900c8c90 tx=0x7f8f8802a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a34c66f14cd8c36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77cb800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77c4153b20 0x7f77c41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77cb800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77c4152e10 0x7f77c4151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.240+0000 7f32b9400640 1 -- 172.21.15.114:0/452972555 learned_addr learned my addr 172.21.15.114:0/452972555 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.240+0000 7f32ba800640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b404bfb0 0x7f32b40de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77cb800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77c40ca9d0 con 0x7f77c4153b20 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77cb800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f77c40c7e80 con 0x7f77c4152e10 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77c8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77c40afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77cb800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f77c406e420 con 0x7f77a4003a80 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77c8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77c40afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:50006/0 (socket says 172.21.15.114:50006) 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f77c8e00640 1 -- 172.21.15.114:0/1743453148 learned_addr learned my addr 172.21.15.114:0/1743453148 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f80f3400640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec049bc0 0x7f80ec041f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7fb696c00640 1 Processor -- start 2024-05-09T00:09:04.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f80f3400640 1 -- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80ec04c490 msgr2=0x7f80ec0dc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.241+0000 7f32b9e00640 1 -- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b404bfb0 msgr2=0x7f32b40de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f32b9e00640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b404bfb0 0x7f32b40de400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f8f8f400640 1 -- 172.21.15.114:0/4222170985 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0016f0 con 0x7f8f900c74a0 2024-05-09T00:09:04.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f32b9e00640 1 -- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b4048580 msgr2=0x7f32b4178cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f32b9e00640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b4048580 0x7f32b4178cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f32b9e00640 1 -- 172.21.15.114:0/452972555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40e0e00 con 0x7f32b400aae0 2024-05-09T00:09:04.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f77c9800640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77c4152e10 0x7f77c4151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f8f8f400640 1 -- 172.21.15.114:0/4222170985 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f88007540 con 0x7f8f900c74a0 2024-05-09T00:09:04.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7ffa63400640 1 Processor -- start 2024-05-09T00:09:04.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f80f3400640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80ec04c490 0x7f80ec0dc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f8f8f400640 1 -- 172.21.15.114:0/4222170985 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0016f0 con 0x7f8f900c74a0 2024-05-09T00:09:04.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f80f3400640 1 -- 172.21.15.114:0/3070155471 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec1748a0 con 0x7f80ec04f790 2024-05-09T00:09:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f8f95000640 1 --2- 172.21.15.114:0/4222170985 >> v2:172.21.15.153:3300/0 conn(0x7f8f900ae680 0x7f8f900b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f80f8a00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec049bc0 0x7f80ec041f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7f80f3e00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80ec04c490 0x7f80ec0dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f77c8e00640 1 -- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77c4152e10 msgr2=0x7f77c4151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f77c8e00640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77c4152e10 0x7f77c4151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 -- 172.21.15.114:0/4222170985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900c74a0 msgr2=0x7f8f900c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 --2- 172.21.15.114:0/4222170985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900c74a0 0x7f8f900c78b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f900c8c90 tx=0x7f8f8802a590 comp rx=0 tx=0).stop 2024-05-09T00:09:04.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f77c8e00640 1 -- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77c4153b20 msgr2=0x7f77c41528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f77c8e00640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77c4153b20 0x7f77c41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f80f3400640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 0x7f80ec177c40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c400 tx=0x7f80e000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7fb696c00640 1 -- start start 2024-05-09T00:09:04.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f1228a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224072890 0x7f122415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f77c8e00640 1 -- 172.21.15.114:0/1743453148 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c41f2550 con 0x7f77a4003a80 2024-05-09T00:09:04.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 -- 172.21.15.114:0/4222170985 shutdown_connections 2024-05-09T00:09:04.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 --2- 172.21.15.114:0/4222170985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900c74a0 0x7f8f900c78b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 --2- 172.21.15.114:0/4222170985 >> v2:172.21.15.153:3300/0 conn(0x7f8f900ae680 0x7f8f900b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 -- 172.21.15.114:0/4222170985 >> 172.21.15.114:0/4222170985 conn(0x7f8f900cb7b0 msgr2=0x7f8f900cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f8f97a00640 1 -- 172.21.15.114:0/4222170985 shutdown_connections 2024-05-09T00:09:04.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.243+0000 7f1228a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1224072d50 0x7f12240addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e0017070 con 0x7f80ec04f790 2024-05-09T00:09:04.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e00052d0 con 0x7f80ec04f790 2024-05-09T00:09:04.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e00037f0 con 0x7f80ec04f790 2024-05-09T00:09:04.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f8f97a00640 1 -- 172.21.15.114:0/4222170985 wait complete. 2024-05-09T00:09:04.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f80faa00640 1 -- 172.21.15.114:0/3070155471 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec174b80 con 0x7f80ec04f790 2024-05-09T00:09:04.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f80faa00640 1 -- 172.21.15.114:0/3070155471 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec175140 con 0x7f80ec04f790 2024-05-09T00:09:04.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f1228a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1224160600 0x7f12241584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.242+0000 7ffa63400640 1 -- start start 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f1221400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1224072d50 0x7f12240addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f1228a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1224160b90 con 0x7f1224160600 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f1228a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1224160a10 con 0x7f1224072d50 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f1228a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12240c6590 con 0x7f1224072890 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f1222800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1224160600 0x7f12241584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7ffa63400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7ffa63400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5c15bad0 con 0x7ffa5c0cbc00 2024-05-09T00:09:04.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7ffa63400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5c15bdb0 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7ffa63400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c159360 con 0x7ffa5c155990 2024-05-09T00:09:04.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7f1221400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1224072d50 0x7f12240addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54324/0 (socket says 172.21.15.114:54324) 2024-05-09T00:09:04.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7f1221400640 1 -- 172.21.15.114:0/1403616759 learned_addr learned my addr 172.21.15.114:0/1403616759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7f1222800640 1 -- 172.21.15.114:0/1403616759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224072890 msgr2=0x7f122415d9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:09:04.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fb696c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 0x7fb6901f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7f1222800640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224072890 0x7f122415d9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fb696c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb6901e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fb696c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb69015c260 0x7fb6901e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fb696c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900c6800 con 0x7fb6900c3190 2024-05-09T00:09:04.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fb696c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb690159180 con 0x7fb690073550 2024-05-09T00:09:04.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fb696c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900c6980 con 0x7fb69015c260 2024-05-09T00:09:04.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7f1222800640 1 -- 172.21.15.114:0/1403616759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1224072d50 msgr2=0x7f12240addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7f1222800640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1224072d50 0x7f12240addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7f1222800640 1 -- 172.21.15.114:0/1403616759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12241f3600 con 0x7f1224160600 2024-05-09T00:09:04.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7f1222800640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1224160600 0x7f12241584b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f121c031000 tx=0x7f121c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7ffa5be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7fac82800640 1 Processor -- start 2024-05-09T00:09:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7fb694c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb69015c260 0x7fb6901e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7fb68fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 0x7fb6901f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.246+0000 7ffa5be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:50014/0 (socket says 172.21.15.114:50014) 2024-05-09T00:09:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7ffa5be00640 1 -- 172.21.15.114:0/2590302897 learned_addr learned my addr 172.21.15.114:0/2590302897 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7fb68fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 0x7fb6901f3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54336/0 (socket says 172.21.15.114:54336) 2024-05-09T00:09:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7fb68fe00640 1 -- 172.21.15.114:0/4093960925 learned_addr learned my addr 172.21.15.114:0/4093960925 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.244+0000 7f32b9e00640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b4174e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32a400ebb0 tx=0x7f32a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4017070 con 0x7f32b400aae0 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.245+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b40e10e0 con 0x7f32b400aae0 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a400eca0 con 0x7f32b400aae0 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b4179210 con 0x7f32b400aae0 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4017070 con 0x7f32b400aae0 2024-05-09T00:09:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7fac82800640 1 -- start start 2024-05-09T00:09:04.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7ffa5be00640 1 -- 172.21.15.114:0/2590302897 >> v1:172.21.15.153:6789/0 conn(0x7ffa5c0c8a40 legacy=0x7ffa5c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7ffa5be00640 1 -- 172.21.15.114:0/2590302897 >> v1:172.21.15.114:6789/0 conn(0x7ffa5c0cbc00 legacy=0x7ffa5c0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7ffa5be00640 1 -- 172.21.15.114:0/2590302897 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c15c090 con 0x7ffa5c155990 2024-05-09T00:09:04.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7f80faa00640 1 -- 172.21.15.114:0/3070155471 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d0005290 con 0x7f80ec04f790 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68f400640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb6901e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68fe00640 1 -- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb69015c260 msgr2=0x7fb6901e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68fe00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb69015c260 0x7fb6901e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68fe00640 1 -- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 msgr2=0x7fb6901e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68fe00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb6901e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68fe00640 1 -- 172.21.15.114:0/4093960925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6901f6490 con 0x7fb690073550 2024-05-09T00:09:04.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.247+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c040070 con 0x7f1224160600 2024-05-09T00:09:04.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7fb68f400640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb6901e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:04.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122415df20 con 0x7f1224160600 2024-05-09T00:09:04.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fb68fe00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 0x7fb6901f3ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb68000b3f0 tx=0x7fb68000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.248+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122414bfb0 con 0x7f1224160600 2024-05-09T00:09:04.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3294005290 con 0x7f32b400aae0 2024-05-09T00:09:04.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac82800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac7c072850 0x7fac7c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac82800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c0c83a0 0x7fac7c0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac82800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7c0c9770 con 0x7fac7c0718e0 2024-05-09T00:09:04.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac82800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fac7c160610 con 0x7fac7c072850 2024-05-09T00:09:04.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac82800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c0c7660 con 0x7fac7c0c83a0 2024-05-09T00:09:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c031b40 con 0x7f1224160600 2024-05-09T00:09:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c007540 con 0x7f1224160600 2024-05-09T00:09:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7f8f97a00640 1 Processor -- start 2024-05-09T00:09:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac81400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac7c072850 0x7fac7c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fac81400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac7c072850 0x7fac7c0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59408/0 (socket says 172.21.15.114:59408) 2024-05-09T00:09:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fac81400640 1 -- 172.21.15.114:0/1687633951 learned_addr learned my addr 172.21.15.114:0/1687633951 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fac80a00640 1 --2- 172.21.15.114:0/1687633951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c0c83a0 0x7fac7c0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f80e001a070 con 0x7f80ec04f790 2024-05-09T00:09:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32a401a070 con 0x7f32b400aae0 2024-05-09T00:09:04.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f32b2000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3298076500 0x7f3298078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7f77c8e00640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77c40afdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00a900 tx=0x7f77ac001c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.251+0000 7f80e7e00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80d40762d0 0x7f80d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.251+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f80e0096b60 con 0x7f80ec04f790 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.249+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680015020 con 0x7fb690073550 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680011830 con 0x7fb690073550 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680011c20 con 0x7fb690073550 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6900c9fc0 con 0x7fb690073550 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6901e5110 con 0x7fb690073550 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7ffa5be00640 1 --2- 172.21.15.114:0/2590302897 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c158e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa500098a0 tx=0x7ffa5002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3adabe2072865690 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.251+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11fc005290 con 0x7f1224160600 2024-05-09T00:09:04.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fac81400640 1 -- 172.21.15.114:0/1687633951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c0c83a0 msgr2=0x7fac7c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7fac81400640 1 --2- 172.21.15.114:0/1687633951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c0c83a0 0x7fac7c0713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.251+0000 7fac81400640 1 -- 172.21.15.114:0/1687633951 >> v1:172.21.15.153:6789/0 conn(0x7fac7c0718e0 legacy=0x7fac7c15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.251+0000 7fac81400640 1 -- 172.21.15.114:0/1687633951 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c0c7940 con 0x7fac7c072850 2024-05-09T00:09:04.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.250+0000 7f8f97a00640 1 -- start start 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f97a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 0x7f8f900a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f97a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f90159650 0x7f8f9014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f97a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f9014fde0 0x7f8f900a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f97a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900c6ba0 con 0x7f8f900ae680 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f97a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f90150560 con 0x7f8f9014fde0 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6900c4990 con 0x7fb690073550 2024-05-09T00:09:04.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f97a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8f900b0aa0 con 0x7f8f90159650 2024-05-09T00:09:04.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f80f3e00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80d40762d0 0x7f80d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f32a405cb60 con 0x7f32b400aae0 2024-05-09T00:09:04.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7fac81400640 1 --2- 172.21.15.114:0/1687633951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c072850 0x7fac7c0c7e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fac74009e50 tx=0x7fac7402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9916b8c76121e8be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f32b9400640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3298076500 0x7f3298078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.252+0000 7f8f95000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 0x7f8f900a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 0x7f8f900a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59422/0 (socket says 172.21.15.114:59422) 2024-05-09T00:09:04.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 -- 172.21.15.114:0/35924106 learned_addr learned my addr 172.21.15.114:0/35924106 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f8fe00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f90159650 0x7f8f9014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f9014fde0 0x7f8f900a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 -- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f90159650 msgr2=0x7f8f9014f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f90159650 0x7f8f9014f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 -- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f9014fde0 msgr2=0x7f8f900a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f9014fde0 0x7f8f900a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 -- 172.21.15.114:0/35924106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f900a9230 con 0x7f8f900ae680 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f9014fde0 0x7f8f900a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f80f3e00640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80d40762d0 0x7f80d40787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80e8007fd0 tx=0x7f80e8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.253+0000 7f8f95000640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 0x7f8f900a6da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e960 tx=0x7f8f8000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.254+0000 7f32b9400640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3298076500 0x7f3298078a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006fd0 tx=0x7f32ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.254+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f121c039040 con 0x7f1224160600 2024-05-09T00:09:04.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.255+0000 7f121a000640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1204076470 0x7f1204078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.256+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f121c0b9790 con 0x7f1224160600 2024-05-09T00:09:04.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.256+0000 7f1221e00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1204076470 0x7f1204078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.256+0000 7f1221e00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1204076470 0x7f1204078980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1214005880 tx=0x7f1214007a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.257+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb680018020 con 0x7fb690073550 2024-05-09T00:09:04.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.258+0000 7fb687e00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb670076320 0x7fb670078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.258+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb680097db0 con 0x7fb690073550 2024-05-09T00:09:04.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.258+0000 7fb68f400640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb670076320 0x7fb670078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.259+0000 7fb68f400640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb670076320 0x7fb670078830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb67c034000 tx=0x7fb67c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.259+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f121c053020 con 0x7f1224160600 2024-05-09T00:09:04.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.268+0000 7fac7be00640 1 -- 172.21.15.114:0/1687633951 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74036070 con 0x7fac7c072850 2024-05-09T00:09:04.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.268+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80017070 con 0x7f8f900ae680 2024-05-09T00:09:04.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.268+0000 7fac7be00640 1 -- 172.21.15.114:0/1687633951 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac74031600 con 0x7fac7c072850 2024-05-09T00:09:04.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.268+0000 7fac7be00640 1 -- 172.21.15.114:0/1687633951 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74031a10 con 0x7fac7c072850 2024-05-09T00:09:04.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.269+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8000c9a0 con 0x7f8f900ae680 2024-05-09T00:09:04.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.269+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000cd70 con 0x7f8f900ae680 2024-05-09T00:09:04.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.269+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32a4060570 con 0x7f32b400aae0 2024-05-09T00:09:04.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.269+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f900a9510 con 0x7f8f900ae680 2024-05-09T00:09:04.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.269+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f900c1000 con 0x7f8f900ae680 2024-05-09T00:09:04.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 -- 172.21.15.114:0/1687633951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c072850 msgr2=0x7fac7c0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 --2- 172.21.15.114:0/1687633951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c072850 0x7fac7c0c7e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fac74009e50 tx=0x7fac7402a6c0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 -- 172.21.15.114:0/1687633951 shutdown_connections 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 --2- 172.21.15.114:0/1687633951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c0c83a0 0x7fac7c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 --2- 172.21.15.114:0/1687633951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c072850 0x7fac7c0c7e60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 -- 172.21.15.114:0/1687633951 >> 172.21.15.114:0/1687633951 conn(0x7fac7c0cb3f0 msgr2=0x7fac7c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac002050 con 0x7f77a4003a80 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.271+0000 7f77cb800640 1 -- 172.21.15.114:0/1743453148 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c41f2830 con 0x7f77a4003a80 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.271+0000 7f77cb800640 1 -- 172.21.15.114:0/1743453148 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c41f2df0 con 0x7f77a4003a80 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac004b60 con 0x7f77a4003a80 2024-05-09T00:09:04.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.271+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac02be60 con 0x7f77a4003a80 2024-05-09T00:09:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f80e005fab0 con 0x7f80ec04f790 2024-05-09T00:09:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f90077430 con 0x7f8f900ae680 2024-05-09T00:09:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 -- 172.21.15.114:0/1687633951 shutdown_connections 2024-05-09T00:09:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.270+0000 7fac82800640 1 -- 172.21.15.114:0/1687633951 wait complete. 2024-05-09T00:09:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.272+0000 7ffa5b400640 1 -- 172.21.15.114:0/2590302897 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50037070 con 0x7ffa5c155990 2024-05-09T00:09:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.272+0000 7ffa5b400640 1 -- 172.21.15.114:0/2590302897 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5002ae50 con 0x7ffa5c155990 2024-05-09T00:09:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.272+0000 7ffa5b400640 1 -- 172.21.15.114:0/2590302897 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50032660 con 0x7ffa5c155990 2024-05-09T00:09:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.273+0000 7ffa63400640 1 -- 172.21.15.114:0/2590302897 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 msgr2=0x7ffa5c158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.273+0000 7ffa63400640 1 --2- 172.21.15.114:0/2590302897 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c158e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa500098a0 tx=0x7ffa5002a100 comp rx=0 tx=0).stop 2024-05-09T00:09:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.272+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7794005290 con 0x7f77a4003a80 2024-05-09T00:09:04.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.273+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8f8001a070 con 0x7f8f900ae680 2024-05-09T00:09:04.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.273+0000 7ffa63400640 1 -- 172.21.15.114:0/2590302897 shutdown_connections 2024-05-09T00:09:04.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.273+0000 7ffa63400640 1 --2- 172.21.15.114:0/2590302897 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c158e20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.273+0000 7ffa63400640 1 -- 172.21.15.114:0/2590302897 >> 172.21.15.114:0/2590302897 conn(0x7ffa5c068fd0 msgr2=0x7ffa5c0cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.274+0000 7fac82800640 1 Processor -- start 2024-05-09T00:09:04.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.274+0000 7fac82800640 1 -- start start 2024-05-09T00:09:04.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.275+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f77ac034470 con 0x7f77a4003a80 2024-05-09T00:09:04.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.275+0000 7ffa63400640 1 -- 172.21.15.114:0/2590302897 shutdown_connections 2024-05-09T00:09:04.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.275+0000 7ffa63400640 1 -- 172.21.15.114:0/2590302897 wait complete. 2024-05-09T00:09:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.275+0000 7f8f8cc00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8f700762d0 0x7f8f700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.275+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f8f80097a50 con 0x7f8f900ae680 2024-05-09T00:09:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.277+0000 7f8f8fe00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8f700762d0 0x7f8f700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.276+0000 7f77c1600640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77a0076350 0x7f77a0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.277+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f77ac0b7fe0 con 0x7f77a4003a80 2024-05-09T00:09:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.276+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6900c4990 con 0x7fb690073550 2024-05-09T00:09:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.277+0000 7fac82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c0718e0 0x7fac7c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.277+0000 7fac82800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c072850 0x7fac7c1e9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.277+0000 7fac82800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c0c83a0 0x7fac7c1f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.277+0000 7f77bbe00640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77a0076350 0x7f77a0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac82800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c0c6050 con 0x7fac7c0718e0 2024-05-09T00:09:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac82800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c0c5ed0 con 0x7fac7c0c83a0 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac82800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c0c87b0 con 0x7fac7c072850 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac80a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c072850 0x7fac7c1e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac81400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c0718e0 0x7fac7c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac80a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c072850 0x7fac7c1e9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:50040/0 (socket says 172.21.15.114:50040) 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac80a00640 1 -- 172.21.15.114:0/2202922995 learned_addr learned my addr 172.21.15.114:0/2202922995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.278+0000 7fac81e00640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c0c83a0 0x7fac7c1f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7ffa63400640 1 Processor -- start 2024-05-09T00:09:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7ffa63400640 1 -- start start 2024-05-09T00:09:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7fac81400640 1 -- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c072850 msgr2=0x7fac7c1e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7fac81400640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c072850 0x7fac7c1e9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7fac81400640 1 -- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c0c83a0 msgr2=0x7fac7c1f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7fac81400640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c0c83a0 0x7fac7c1f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.279+0000 7fac81400640 1 -- 172.21.15.114:0/2202922995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c1f67d0 con 0x7fac7c0718e0 2024-05-09T00:09:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.280+0000 7f77bbe00640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77a0076350 0x7f77a0078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77c41595d0 tx=0x7f77b4006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.280+0000 7f8f8fe00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8f700762d0 0x7f8f700787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f88034000 tx=0x7f8f8802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.280+0000 7fac81400640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c0718e0 0x7fac7c15cc60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fac74030000 tx=0x7fac74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa63400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 0x7ffa5c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa63400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa5c0cbc00 0x7ffa5c0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa63400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c1f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa60a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 0x7ffa5c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa63400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c155da0 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa63400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c15c650 con 0x7ffa5c0cbc00 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa63400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c0af950 con 0x7ffa5c155990 2024-05-09T00:09:04.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.282+0000 7ffa60a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 0x7ffa5c151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59440/0 (socket says 172.21.15.114:59440) 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.283+0000 7ffa60a00640 1 -- 172.21.15.114:0/1725711425 learned_addr learned my addr 172.21.15.114:0/1725711425 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.283+0000 7ffa5be00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa5c0cbc00 0x7ffa5c0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.283+0000 7ffa61400640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c1f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8f80060a20 con 0x7f8f900ae680 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7ffa60a00640 1 -- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 msgr2=0x7ffa5c1f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7ffa60a00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c1f32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7ffa60a00640 1 -- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa5c0cbc00 msgr2=0x7ffa5c0c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7ffa60a00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa5c0cbc00 0x7ffa5c0c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7ffa60a00640 1 -- 172.21.15.114:0/1725711425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c1f37f0 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74041020 con 0x7fac7c0718e0 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac740087b0 con 0x7fac7c0718e0 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74041020 con 0x7fac7c0718e0 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c1e7f10 con 0x7fac7c0718e0 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.284+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c1f25d0 con 0x7fac7c0718e0 2024-05-09T00:09:04.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.285+0000 7ffa60a00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 0x7ffa5c151770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b3f0 tx=0x7ffa4800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.287+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7c1e8430 con 0x7fac7c0718e0 2024-05-09T00:09:04.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.287+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48015020 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.287+0000 7ffa63400640 1 -- 172.21.15.114:0/1725711425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5c0c2230 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.287+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48011830 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.287+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48015020 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.287+0000 7ffa63400640 1 -- 172.21.15.114:0/1725711425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5c150640 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.291+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac74044020 con 0x7fac7c0718e0 2024-05-09T00:09:04.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.289+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5c0c2450 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.293+0000 7fac79600640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fac5c076500 0x7fac5c078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.293+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fac740b8110 con 0x7fac7c0718e0 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.294+0000 7fac80a00640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fac5c076500 0x7fac5c078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.292+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa48018020 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.294+0000 7ffa58c00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa3c0764d0 0x7ffa3c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.294+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ffa48097820 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.295+0000 7ffa5be00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa3c0764d0 0x7ffa3c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.294+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f77ac081680 con 0x7f77a4003a80 2024-05-09T00:09:04.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.296+0000 7ffa5be00640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa3c0764d0 0x7ffa3c0789e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa50034000 tx=0x7ffa5002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.297+0000 7fac80a00640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fac5c076500 0x7fac5c078a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac6800ab30 tx=0x7fac68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.303+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa4801f020 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.313+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac7404b030 con 0x7fac7c0718e0 2024-05-09T00:09:04.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.694+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f11fc005850 con 0x7f1224160600 2024-05-09T00:09:04.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.695+0000 7f121a000640 1 -- 172.21.15.114:0/1403616759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f121c082f80 con 0x7f1224160600 2024-05-09T00:09:04.692 INFO:teuthology.orchestra.run.smithi114.stdout:60129542152 2024-05-09T00:09:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.698+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1204076470 msgr2=0x7f1204078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.698+0000 7f1228a00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1204076470 0x7f1204078980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1214005880 tx=0x7f1214007a20 comp rx=0 tx=0).stop 2024-05-09T00:09:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.699+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1224160600 msgr2=0x7f12241584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.699+0000 7f1228a00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1224160600 0x7f12241584b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f121c031000 tx=0x7f121c004a40 comp rx=0 tx=0).stop 2024-05-09T00:09:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 shutdown_connections 2024-05-09T00:09:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1204076470 0x7f1204078980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1224160600 0x7f12241584b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1224072d50 0x7f12240addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 --2- 172.21.15.114:0/1403616759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1224072890 0x7f122415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 >> 172.21.15.114:0/1403616759 conn(0x7f122406c680 msgr2=0x7f122415a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 shutdown_connections 2024-05-09T00:09:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.700+0000 7f1228a00640 1 -- 172.21.15.114:0/1403616759 wait complete. 2024-05-09T00:09:04.713 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-05-09T00:09:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.714+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3294005850 con 0x7f32b400aae0 2024-05-09T00:09:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.715+0000 7f32b2000640 1 -- 172.21.15.114:0/452972555 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32a4064870 con 0x7f32b400aae0 2024-05-09T00:09:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.717+0000 7f80faa00640 1 -- 172.21.15.114:0/3070155471 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f80d0005850 con 0x7f80ec04f790 2024-05-09T00:09:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.718+0000 7f80e7e00640 1 -- 172.21.15.114:0/3070155471 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80e0068180 con 0x7f80ec04f790 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.720+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3298076500 msgr2=0x7f3298078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.720+0000 7f32c1000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3298076500 0x7f3298078a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006fd0 tx=0x7f32ac008040 comp rx=0 tx=0).stop 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.720+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 msgr2=0x7f32b4174e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.720+0000 7f32c1000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b4174e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32a400ebb0 tx=0x7f32a400c520 comp rx=0 tx=0).stop 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 shutdown_connections 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3298076500 0x7f3298078a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32b404bfb0 0x7f32b40de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b4048580 0x7f32b4178cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.721 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-05-09T00:09:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 --2- 172.21.15.114:0/452972555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32b400aae0 0x7f32b4174e30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 >> 172.21.15.114:0/452972555 conn(0x7f32b404aa10 msgr2=0x7f32b40d7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.721+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 shutdown_connections 2024-05-09T00:09:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.722+0000 7f32c1000640 1 -- 172.21.15.114:0/452972555 wait complete. 2024-05-09T00:09:04.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.722+0000 7f80e5600640 1 -- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80d40762d0 msgr2=0x7f80d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.722+0000 7f80e5600640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80d40762d0 0x7f80d40787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80e8007fd0 tx=0x7f80e8007de0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.722+0000 7f80e5600640 1 -- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 msgr2=0x7f80ec177c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.722+0000 7f80e5600640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 0x7f80ec177c40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c400 tx=0x7f80e000c8c0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.723+0000 7f80e5600640 1 -- 172.21.15.114:0/3070155471 shutdown_connections 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.723+0000 7f80e5600640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80d40762d0 0x7f80d40787e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.723+0000 7f80e5600640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec049bc0 0x7f80ec041f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.723+0000 7f80e5600640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80ec04f790 0x7f80ec177c40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.723+0000 7f80e5600640 1 --2- 172.21.15.114:0/3070155471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80ec04c490 0x7f80ec0dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.723+0000 7f80e5600640 1 -- 172.21.15.114:0/3070155471 >> 172.21.15.114:0/3070155471 conn(0x7f80ec04c8a0 msgr2=0x7f80ec0dea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.724+0000 7f80e5600640 1 -- 172.21.15.114:0/3070155471 shutdown_connections 2024-05-09T00:09:04.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.724+0000 7f80e5600640 1 -- 172.21.15.114:0/3070155471 wait complete. 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.731+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb6901f38e0 con 0x7fb690073550 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.732+0000 7fb687e00640 1 -- 172.21.15.114:0/4093960925 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb68001f020 con 0x7fb690073550 2024-05-09T00:09:04.730 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-05-09T00:09:04.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-05-09T00:09:04.735 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb670076320 msgr2=0x7fb670078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb670076320 0x7fb670078830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb67c034000 tx=0x7fb67c02e000 comp rx=0 tx=0).stop 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 msgr2=0x7fb6901f3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 0x7fb6901f3ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb68000b3f0 tx=0x7fb68000b8b0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 shutdown_connections 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb670076320 0x7fb670078830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb69015c260 0x7fb6901e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6900c3190 0x7fb6901e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 --2- 172.21.15.114:0/4093960925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690073550 0x7fb6901f3ca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.738+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 >> 172.21.15.114:0/4093960925 conn(0x7fb69006c680 msgr2=0x7fb69006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.739+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 shutdown_connections 2024-05-09T00:09:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.739+0000 7fb696c00640 1 -- 172.21.15.114:0/4093960925 wait complete. 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.740+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8f900cb280 con 0x7f8f900ae680 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.740+0000 7f8f8cc00640 1 -- 172.21.15.114:0/35924106 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f80064d20 con 0x7f8f900ae680 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.743+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8f700762d0 msgr2=0x7f8f700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.744+0000 7f8f97a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8f700762d0 0x7f8f700787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f88034000 tx=0x7f8f8802f000 comp rx=0 tx=0).stop 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 msgr2=0x7f8f900a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 0x7f8f900a6da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e960 tx=0x7f8f8000ee20 comp rx=0 tx=0).stop 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 shutdown_connections 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8f700762d0 0x7f8f700787e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f9014fde0 0x7f8f900a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f90159650 0x7f8f9014f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 --2- 172.21.15.114:0/35924106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900ae680 0x7f8f900a6da0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 >> 172.21.15.114:0/35924106 conn(0x7f8f900cb7b0 msgr2=0x7f8f90158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 shutdown_connections 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.745+0000 7f8f97a00640 1 -- 172.21.15.114:0/35924106 wait complete. 2024-05-09T00:09:04.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.750+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fac7c1f23c0 con 0x7fac7c0718e0 2024-05-09T00:09:04.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.751+0000 7fac79600640 1 -- 172.21.15.114:0/2202922995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac74080fc0 con 0x7fac7c0718e0 2024-05-09T00:09:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.753+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7794005850 con 0x7f77a4003a80 2024-05-09T00:09:04.750 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-05-09T00:09:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.751+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ffa5c1f28a0 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.752+0000 7ffa58c00640 1 -- 172.21.15.114:0/1725711425 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa480607e0 con 0x7ffa5c0c8a40 2024-05-09T00:09:04.751 INFO:teuthology.orchestra.run.smithi114.stdout:64424509449 2024-05-09T00:09:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.754+0000 7f77c1600640 1 -- 172.21.15.114:0/1743453148 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f77ac080f80 con 0x7f77a4003a80 2024-05-09T00:09:04.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.754+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fac5c076500 msgr2=0x7fac5c078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.752 INFO:teuthology.orchestra.run.smithi114.stdout:64424509449 2024-05-09T00:09:04.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.754+0000 7fac82800640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fac5c076500 0x7fac5c078a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac6800ab30 tx=0x7fac68008040 comp rx=0 tx=0).stop 2024-05-09T00:09:04.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.754+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c0718e0 msgr2=0x7fac7c15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.754+0000 7fac82800640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c0718e0 0x7fac7c15cc60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fac74030000 tx=0x7fac74004a40 comp rx=0 tx=0).stop 2024-05-09T00:09:04.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 shutdown_connections 2024-05-09T00:09:04.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fac5c076500 0x7fac5c078a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c0c83a0 0x7fac7c1f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac7c072850 0x7fac7c1e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 --2- 172.21.15.114:0/2202922995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac7c0718e0 0x7fac7c15cc60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 >> 172.21.15.114:0/2202922995 conn(0x7fac7c0cb3f0 msgr2=0x7fac7c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 shutdown_connections 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7fac82800640 1 -- 172.21.15.114:0/2202922995 wait complete. 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.755+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa3c0764d0 msgr2=0x7ffa3c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.756+0000 7ffa4e000640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa3c0764d0 0x7ffa3c0789e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa50034000 tx=0x7ffa5002e000 comp rx=0 tx=0).stop 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.756+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 msgr2=0x7ffa5c151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.756+0000 7ffa4e000640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 0x7ffa5c151770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b3f0 tx=0x7ffa4800b8b0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.756+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 shutdown_connections 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa3c0764d0 0x7ffa3c0789e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa5c155990 0x7ffa5c1f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa5c0cbc00 0x7ffa5c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 --2- 172.21.15.114:0/1725711425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa5c0c8a40 0x7ffa5c151770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 >> 172.21.15.114:0/1725711425 conn(0x7ffa5c068fd0 msgr2=0x7ffa5c0af130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 shutdown_connections 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.757+0000 7ffa4e000640 1 -- 172.21.15.114:0/1725711425 wait complete. 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.758+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77a0076350 msgr2=0x7f77a0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.758+0000 7f77ba000640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77a0076350 0x7f77a0078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77c41595d0 tx=0x7f77b4006ba0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.758+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 msgr2=0x7f77c40afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.758+0000 7f77ba000640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77c40afdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00a900 tx=0x7f77ac001c10 comp rx=0 tx=0).stop 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 shutdown_connections 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77a0076350 0x7f77a0078860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77c4152e10 0x7f77c4151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77c4153b20 0x7f77c41528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 --2- 172.21.15.114:0/1743453148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77a4003a80 0x7f77c40afdc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 >> 172.21.15.114:0/1743453148 conn(0x7f77c40cbb70 msgr2=0x7f77c40c8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 shutdown_connections 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:04.759+0000 7f77ba000640 1 -- 172.21.15.114:0/1743453148 wait complete. 2024-05-09T00:09:04.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-05-09T00:09:04.762 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-05-09T00:09:04.763 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-05-09T00:09:04.767 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-05-09T00:09:04.777 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-05-09T00:09:04.779 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-05-09T00:09:04.781 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-05-09T00:09:04.787 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:04.787 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T00:09:04.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.077+0000 7f6aba600640 1 Processor -- start 2024-05-09T00:09:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.078+0000 7f6aba600640 1 -- start start 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6aba600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ab40700b0 0x7f6ab4145810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6aba600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab40704c0 con 0x7f6ab40c4c20 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6aba600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab406ed30 con 0x7f6ab415c450 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6aba600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab4072800 con 0x7f6ab40700b0 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6ab9200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6ab40c4c20 0x7f6ab40720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53202/0 (socket says 172.21.15.114:53202) 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6ab9200640 1 -- 172.21.15.114:0/2044424862 learned_addr learned my addr 172.21.15.114:0/2044424862 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.080+0000 7f6ab9c00640 1 --2- 172.21.15.114:0/2044424862 >> v2:172.21.15.114:3300/0 conn(0x7f6ab40700b0 0x7f6ab4145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.081+0000 7f6ab9c00640 1 -- 172.21.15.114:0/2044424862 >> v1:172.21.15.153:6789/0 conn(0x7f6ab415c450 legacy=0x7f6ab40c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.081+0000 7f6ab9c00640 1 -- 172.21.15.114:0/2044424862 >> v1:172.21.15.114:6789/0 conn(0x7f6ab40c4c20 legacy=0x7f6ab40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.081+0000 7f6ab9c00640 1 -- 172.21.15.114:0/2044424862 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab406f010 con 0x7f6ab40700b0 2024-05-09T00:09:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.081+0000 7f6ab3400640 1 -- 172.21.15.114:0/2044424862 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539059312 0 0) 0x7f6ab40704c0 con 0x7f6ab40c4c20 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6ab9c00640 1 --2- 172.21.15.114:0/2044424862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab4145810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0097a0 tx=0x7f6aac02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6758be84494e0ff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6ab3400640 1 -- 172.21.15.114:0/2044424862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac037070 con 0x7f6ab40700b0 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6ab3400640 1 -- 172.21.15.114:0/2044424862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac02ae50 con 0x7f6ab40700b0 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6ab3400640 1 -- 172.21.15.114:0/2044424862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac032660 con 0x7f6ab40700b0 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6aba600640 1 -- 172.21.15.114:0/2044424862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 msgr2=0x7f6ab4145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6aba600640 1 --2- 172.21.15.114:0/2044424862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab4145810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0097a0 tx=0x7f6aac02a100 comp rx=0 tx=0).stop 2024-05-09T00:09:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6aba600640 1 -- 172.21.15.114:0/2044424862 shutdown_connections 2024-05-09T00:09:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.082+0000 7f6aba600640 1 --2- 172.21.15.114:0/2044424862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab4145810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.083+0000 7f6aba600640 1 -- 172.21.15.114:0/2044424862 >> 172.21.15.114:0/2044424862 conn(0x7f6ab40c9730 msgr2=0x7f6ab40c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.083+0000 7f6aba600640 1 -- 172.21.15.114:0/2044424862 shutdown_connections 2024-05-09T00:09:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.083+0000 7f6aba600640 1 -- 172.21.15.114:0/2044424862 wait complete. 2024-05-09T00:09:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.085+0000 7f6aba600640 1 Processor -- start 2024-05-09T00:09:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.085+0000 7f6aba600640 1 -- start start 2024-05-09T00:09:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6aba600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab40ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6aba600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40c4c20 0x7f6ab41e8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6aba600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415c450 0x7f6ab415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6aba600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab406f5d0 con 0x7f6ab40700b0 2024-05-09T00:09:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6aba600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab40c3a40 con 0x7f6ab415c450 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6aba600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab406f8b0 con 0x7f6ab40c4c20 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab40ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab40ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59454/0 (socket says 172.21.15.114:59454) 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.086+0000 7f6ab9200640 1 -- 172.21.15.114:0/2193470747 learned_addr learned my addr 172.21.15.114:0/2193470747 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab3e00640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40c4c20 0x7f6ab41e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9c00640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415c450 0x7f6ab415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9200640 1 -- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40c4c20 msgr2=0x7f6ab41e8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9200640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40c4c20 0x7f6ab41e8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9200640 1 -- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415c450 msgr2=0x7f6ab415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9200640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415c450 0x7f6ab415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9200640 1 -- 172.21.15.114:0/2193470747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab40af2d0 con 0x7f6ab40700b0 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab3e00640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40c4c20 0x7f6ab41e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab9200640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab40ac9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400c3f0 tx=0x7f6aa400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40074e0 con 0x7f6ab40700b0 2024-05-09T00:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa40047e0 con 0x7f6ab40700b0 2024-05-09T00:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4004bd0 con 0x7f6ab40700b0 2024-05-09T00:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab41f2e60 con 0x7f6ab40700b0 2024-05-09T00:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.087+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab40ae510 con 0x7f6ab40700b0 2024-05-09T00:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.088+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab4078430 con 0x7f6ab40700b0 2024-05-09T00:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.090+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6aa4011070 con 0x7f6ab40700b0 2024-05-09T00:09:05.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.091+0000 7f6ab0c00640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6a940762d0 0x7f6a940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.091+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6aa40974c0 con 0x7f6ab40700b0 2024-05-09T00:09:05.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.091+0000 7f6ab3e00640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6a940762d0 0x7f6a940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.092+0000 7f6ab3e00640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6a940762d0 0x7f6a940787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6ab41445d0 tx=0x7f6aa00073e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.096+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6aa4060b80 con 0x7f6ab40700b0 2024-05-09T00:09:05.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.281+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ab406fb60 con 0x7f6a940762d0 2024-05-09T00:09:05.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.300+0000 7f6ab0c00640 1 -- 172.21.15.114:0/2193470747 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490296 (secure 0 0 0) 0x7f6ab406fb60 con 0x7f6a940762d0 2024-05-09T00:09:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6a940762d0 msgr2=0x7f6a940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6a940762d0 0x7f6a940787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6ab41445d0 tx=0x7f6aa00073e0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 msgr2=0x7f6ab40ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab40ac9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400c3f0 tx=0x7f6aa400c8b0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 shutdown_connections 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6a940762d0 0x7f6a940787e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415c450 0x7f6ab415da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40c4c20 0x7f6ab41e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 --2- 172.21.15.114:0/2193470747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ab40700b0 0x7f6ab40ac9b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 >> 172.21.15.114:0/2193470747 conn(0x7f6ab40c9730 msgr2=0x7f6ab40c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 shutdown_connections 2024-05-09T00:09:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.307+0000 7f6aba600640 1 -- 172.21.15.114:0/2193470747 wait complete. 2024-05-09T00:09:05.329 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-05-09T00:09:04.293503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219584,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755136,"statfs":{"total":773094113280,"available":772869259264,"internally_reserved":0,"allocated":3481600,"data_stored":2027328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.107125"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478651+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:58.478651+0000","last_peered":"2024-05-09T00:08:58.478651+0000","last_clean":"2024-05-09T00:08:58.478651+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:58.478651+0000","last_undegraded":"2024-05-09T00:08:58.478651+0000","last_fullsized":"2024-05-09T00:08:58.478651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476848+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:58.476848+0000","last_peered":"2024-05-09T00:08:58.476848+0000","last_clean":"2024-05-09T00:08:58.476848+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:58.476848+0000","last_undegraded":"2024-05-09T00:08:58.476848+0000","last_fullsized":"2024-05-09T00:08:58.476848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481099+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:58.481099+0000","last_peered":"2024-05-09T00:08:58.481099+0000","last_clean":"2024-05-09T00:08:58.481099+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:58.481099+0000","last_undegraded":"2024-05-09T00:08:58.481099+0000","last_fullsized":"2024-05-09T00:08:58.481099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480820+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:58.480820+0000","last_peered":"2024-05-09T00:08:58.480820+0000","last_clean":"2024-05-09T00:08:58.480820+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:58.480820+0000","last_undegraded":"2024-05-09T00:08:58.480820+0000","last_fullsized":"2024-05-09T00:08:58.480820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479058+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:58.479058+0000","last_peered":"2024-05-09T00:08:58.479058+0000","last_clean":"2024-05-09T00:08:58.479058+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:58.479058+0000","last_undegraded":"2024-05-09T00:08:58.479058+0000","last_fullsized":"2024-05-09T00:08:58.479058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480776+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:58.480776+0000","last_peered":"2024-05-09T00:08:58.480776+0000","last_clean":"2024-05-09T00:08:58.480776+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:58.480776+0000","last_undegraded":"2024-05-09T00:08:58.480776+0000","last_fullsized":"2024-05-09T00:08:58.480776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478159+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:58.478159+0000","last_peered":"2024-05-09T00:08:58.478159+0000","last_clean":"2024-05-09T00:08:58.478159+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:58.478159+0000","last_undegraded":"2024-05-09T00:08:58.478159+0000","last_fullsized":"2024-05-09T00:08:58.478159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475636+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:58.475636+0000","last_peered":"2024-05-09T00:08:58.475636+0000","last_clean":"2024-05-09T00:08:58.475636+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:58.475636+0000","last_undegraded":"2024-05-09T00:08:58.475636+0000","last_fullsized":"2024-05-09T00:08:58.475636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483407+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:58.483407+0000","last_peered":"2024-05-09T00:08:58.483407+0000","last_clean":"2024-05-09T00:08:58.483407+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:58.483407+0000","last_undegraded":"2024-05-09T00:08:58.483407+0000","last_fullsized":"2024-05-09T00:08:58.483407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480021+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:58.480021+0000","last_peered":"2024-05-09T00:08:58.480021+0000","last_clean":"2024-05-09T00:08:58.480021+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:58.480021+0000","last_undegraded":"2024-05-09T00:08:58.480021+0000","last_fullsized":"2024-05-09T00:08:58.480021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476066+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:58.476066+0000","last_peered":"2024-05-09T00:08:58.476066+0000","last_clean":"2024-05-09T00:08:58.476066+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:58.476066+0000","last_undegraded":"2024-05-09T00:08:58.476066+0000","last_fullsized":"2024-05-09T00:08:58.476066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483024+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:58.483024+0000","last_peered":"2024-05-09T00:08:58.483024+0000","last_clean":"2024-05-09T00:08:58.483024+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:58.483024+0000","last_undegraded":"2024-05-09T00:08:58.483024+0000","last_fullsized":"2024-05-09T00:08:58.483024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478064+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:58.478064+0000","last_peered":"2024-05-09T00:08:58.478064+0000","last_clean":"2024-05-09T00:08:58.478064+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:58.478064+0000","last_undegraded":"2024-05-09T00:08:58.478064+0000","last_fullsized":"2024-05-09T00:08:58.478064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477477+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:58.477477+0000","last_peered":"2024-05-09T00:08:58.477477+0000","last_clean":"2024-05-09T00:08:58.477477+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:58.477477+0000","last_undegraded":"2024-05-09T00:08:58.477477+0000","last_fullsized":"2024-05-09T00:08:58.477477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480993+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:58.480993+0000","last_peered":"2024-05-09T00:08:58.480993+0000","last_clean":"2024-05-09T00:08:58.480993+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:58.480993+0000","last_undegraded":"2024-05-09T00:08:58.480993+0000","last_fullsized":"2024-05-09T00:08:58.480993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478741+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:58.478741+0000","last_peered":"2024-05-09T00:08:58.478741+0000","last_clean":"2024-05-09T00:08:58.478741+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:58.478741+0000","last_undegraded":"2024-05-09T00:08:58.478741+0000","last_fullsized":"2024-05-09T00:08:58.478741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478705+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:58.478705+0000","last_peered":"2024-05-09T00:08:58.478705+0000","last_clean":"2024-05-09T00:08:58.478705+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:58.478705+0000","last_undegraded":"2024-05-09T00:08:58.478705+0000","last_fullsized":"2024-05-09T00:08:58.478705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483900+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:58.483900+0000","last_peered":"2024-05-09T00:08:58.483900+0000","last_clean":"2024-05-09T00:08:58.483900+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:58.483900+0000","last_undegraded":"2024-05-09T00:08:58.483900+0000","last_fullsized":"2024-05-09T00:08:58.483900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479091+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:58.479091+0000","last_peered":"2024-05-09T00:08:58.479091+0000","last_clean":"2024-05-09T00:08:58.479091+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:58.479091+0000","last_undegraded":"2024-05-09T00:08:58.479091+0000","last_fullsized":"2024-05-09T00:08:58.479091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477426+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:58.477426+0000","last_peered":"2024-05-09T00:08:58.477426+0000","last_clean":"2024-05-09T00:08:58.477426+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:58.477426+0000","last_undegraded":"2024-05-09T00:08:58.477426+0000","last_fullsized":"2024-05-09T00:08:58.477426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391402+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:08:57.391402+0000","last_peered":"2024-05-09T00:08:57.391402+0000","last_clean":"2024-05-09T00:08:57.391402+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:08:57.391402+0000","last_undegraded":"2024-05-09T00:08:57.391402+0000","last_fullsized":"2024-05-09T00:08:57.391402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476732+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:58.476732+0000","last_peered":"2024-05-09T00:08:58.476732+0000","last_clean":"2024-05-09T00:08:58.476732+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:58.476732+0000","last_undegraded":"2024-05-09T00:08:58.476732+0000","last_fullsized":"2024-05-09T00:08:58.476732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483217+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:08:58.483217+0000","last_peered":"2024-05-09T00:08:58.483217+0000","last_clean":"2024-05-09T00:08:58.483217+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:08:58.483217+0000","last_undegraded":"2024-05-09T00:08:58.483217+0000","last_fullsized":"2024-05-09T00:08:58.483217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481463+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:58.481463+0000","last_peered":"2024-05-09T00:08:58.481463+0000","last_clean":"2024-05-09T00:08:58.481463+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:58.481463+0000","last_undegraded":"2024-05-09T00:08:58.481463+0000","last_fullsized":"2024-05-09T00:08:58.481463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477387+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:58.477387+0000","last_peered":"2024-05-09T00:08:58.477387+0000","last_clean":"2024-05-09T00:08:58.477387+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:58.477387+0000","last_undegraded":"2024-05-09T00:08:58.477387+0000","last_fullsized":"2024-05-09T00:08:58.477387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478333+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:58.478333+0000","last_peered":"2024-05-09T00:08:58.478333+0000","last_clean":"2024-05-09T00:08:58.478333+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:58.478333+0000","last_undegraded":"2024-05-09T00:08:58.478333+0000","last_fullsized":"2024-05-09T00:08:58.478333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483817+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:58.483817+0000","last_peered":"2024-05-09T00:08:58.483817+0000","last_clean":"2024-05-09T00:08:58.483817+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:58.483817+0000","last_undegraded":"2024-05-09T00:08:58.483817+0000","last_fullsized":"2024-05-09T00:08:58.483817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483648+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:58.483648+0000","last_peered":"2024-05-09T00:08:58.483648+0000","last_clean":"2024-05-09T00:08:58.483648+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:58.483648+0000","last_undegraded":"2024-05-09T00:08:58.483648+0000","last_fullsized":"2024-05-09T00:08:58.483648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482784+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:58.482784+0000","last_peered":"2024-05-09T00:08:58.482784+0000","last_clean":"2024-05-09T00:08:58.482784+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:58.482784+0000","last_undegraded":"2024-05-09T00:08:58.482784+0000","last_fullsized":"2024-05-09T00:08:58.482784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479553+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:58.479553+0000","last_peered":"2024-05-09T00:08:58.479553+0000","last_clean":"2024-05-09T00:08:58.479553+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:58.479553+0000","last_undegraded":"2024-05-09T00:08:58.479553+0000","last_fullsized":"2024-05-09T00:08:58.479553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482839+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:58.482839+0000","last_peered":"2024-05-09T00:08:58.482839+0000","last_clean":"2024-05-09T00:08:58.482839+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:58.482839+0000","last_undegraded":"2024-05-09T00:08:58.482839+0000","last_fullsized":"2024-05-09T00:08:58.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475873+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:58.475873+0000","last_peered":"2024-05-09T00:08:58.475873+0000","last_clean":"2024-05-09T00:08:58.475873+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:58.475873+0000","last_undegraded":"2024-05-09T00:08:58.475873+0000","last_fullsized":"2024-05-09T00:08:58.475873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476268+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:58.476268+0000","last_peered":"2024-05-09T00:08:58.476268+0000","last_clean":"2024-05-09T00:08:58.476268+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:58.476268+0000","last_undegraded":"2024-05-09T00:08:58.476268+0000","last_fullsized":"2024-05-09T00:08:58.476268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:59.670906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483620+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:58.483620+0000","last_peered":"2024-05-09T00:08:58.483620+0000","last_clean":"2024-05-09T00:08:58.483620+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:58.483620+0000","last_undegraded":"2024-05-09T00:08:58.483620+0000","last_fullsized":"2024-05-09T00:08:58.483620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480061+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:58.480061+0000","last_peered":"2024-05-09T00:08:58.480061+0000","last_clean":"2024-05-09T00:08:58.480061+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:58.480061+0000","last_undegraded":"2024-05-09T00:08:58.480061+0000","last_fullsized":"2024-05-09T00:08:58.480061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480789+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:58.480789+0000","last_peered":"2024-05-09T00:08:58.480789+0000","last_clean":"2024-05-09T00:08:58.480789+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:58.480789+0000","last_undegraded":"2024-05-09T00:08:58.480789+0000","last_fullsized":"2024-05-09T00:08:58.480789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:49.557566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478428+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:58.478428+0000","last_peered":"2024-05-09T00:08:58.478428+0000","last_clean":"2024-05-09T00:08:58.478428+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:58.478428+0000","last_undegraded":"2024-05-09T00:08:58.478428+0000","last_fullsized":"2024-05-09T00:08:58.478428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477100+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:58.477100+0000","last_peered":"2024-05-09T00:08:58.477100+0000","last_clean":"2024-05-09T00:08:58.477100+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:58.477100+0000","last_undegraded":"2024-05-09T00:08:58.477100+0000","last_fullsized":"2024-05-09T00:08:58.477100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477818+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:58.477818+0000","last_peered":"2024-05-09T00:08:58.477818+0000","last_clean":"2024-05-09T00:08:58.477818+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:58.477818+0000","last_undegraded":"2024-05-09T00:08:58.477818+0000","last_fullsized":"2024-05-09T00:08:58.477818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477905+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:58.477905+0000","last_peered":"2024-05-09T00:08:58.477905+0000","last_clean":"2024-05-09T00:08:58.477905+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:58.477905+0000","last_undegraded":"2024-05-09T00:08:58.477905+0000","last_fullsized":"2024-05-09T00:08:58.477905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476613+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:58.476613+0000","last_peered":"2024-05-09T00:08:58.476613+0000","last_clean":"2024-05-09T00:08:58.476613+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:58.476613+0000","last_undegraded":"2024-05-09T00:08:58.476613+0000","last_fullsized":"2024-05-09T00:08:58.476613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475819+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:58.475819+0000","last_peered":"2024-05-09T00:08:58.475819+0000","last_clean":"2024-05-09T00:08:58.475819+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:58.475819+0000","last_undegraded":"2024-05-09T00:08:58.475819+0000","last_fullsized":"2024-05-09T00:08:58.475819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477248+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:58.477248+0000","last_peered":"2024-05-09T00:08:58.477248+0000","last_clean":"2024-05-09T00:08:58.477248+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:58.477248+0000","last_undegraded":"2024-05-09T00:08:58.477248+0000","last_fullsized":"2024-05-09T00:08:58.477248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476388+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:58.476388+0000","last_peered":"2024-05-09T00:08:58.476388+0000","last_clean":"2024-05-09T00:08:58.476388+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:58.476388+0000","last_undegraded":"2024-05-09T00:08:58.476388+0000","last_fullsized":"2024-05-09T00:08:58.476388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483808+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:58.483808+0000","last_peered":"2024-05-09T00:08:58.483808+0000","last_clean":"2024-05-09T00:08:58.483808+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:58.483808+0000","last_undegraded":"2024-05-09T00:08:58.483808+0000","last_fullsized":"2024-05-09T00:08:58.483808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477114+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:58.477114+0000","last_peered":"2024-05-09T00:08:58.477114+0000","last_clean":"2024-05-09T00:08:58.477114+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:58.477114+0000","last_undegraded":"2024-05-09T00:08:58.477114+0000","last_fullsized":"2024-05-09T00:08:58.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481101+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:58.481101+0000","last_peered":"2024-05-09T00:08:58.481101+0000","last_clean":"2024-05-09T00:08:58.481101+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:58.481101+0000","last_undegraded":"2024-05-09T00:08:58.481101+0000","last_fullsized":"2024-05-09T00:08:58.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478553+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:58.478553+0000","last_peered":"2024-05-09T00:08:58.478553+0000","last_clean":"2024-05-09T00:08:58.478553+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:58.478553+0000","last_undegraded":"2024-05-09T00:08:58.478553+0000","last_fullsized":"2024-05-09T00:08:58.478553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483038+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:58.483038+0000","last_peered":"2024-05-09T00:08:58.483038+0000","last_clean":"2024-05-09T00:08:58.483038+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:58.483038+0000","last_undegraded":"2024-05-09T00:08:58.483038+0000","last_fullsized":"2024-05-09T00:08:58.483038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479550+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:58.479550+0000","last_peered":"2024-05-09T00:08:58.479550+0000","last_clean":"2024-05-09T00:08:58.479550+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:58.479550+0000","last_undegraded":"2024-05-09T00:08:58.479550+0000","last_fullsized":"2024-05-09T00:08:58.479550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479863+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:58.479863+0000","last_peered":"2024-05-09T00:08:58.479863+0000","last_clean":"2024-05-09T00:08:58.479863+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:58.479863+0000","last_undegraded":"2024-05-09T00:08:58.479863+0000","last_fullsized":"2024-05-09T00:08:58.479863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478406+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:58.478406+0000","last_peered":"2024-05-09T00:08:58.478406+0000","last_clean":"2024-05-09T00:08:58.478406+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:58.478406+0000","last_undegraded":"2024-05-09T00:08:58.478406+0000","last_fullsized":"2024-05-09T00:08:58.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":106231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":307200,"data_stored":108537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:05.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:05.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.635+0000 7fae8e600640 1 Processor -- start 2024-05-09T00:09:05.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.635+0000 7fae8e600640 1 -- start start 2024-05-09T00:09:05.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.637+0000 7fae8e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae88072720 0x7fae880c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.637+0000 7fae8e600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae88074040 con 0x7fae88073800 2024-05-09T00:09:05.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.637+0000 7fae8e600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae880c58f0 con 0x7fae881585c0 2024-05-09T00:09:05.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.637+0000 7fae8e600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fae88073df0 con 0x7fae88072720 2024-05-09T00:09:05.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.637+0000 7fae87400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fae88073800 0x7fae880c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53206/0 (socket says 172.21.15.114:53206) 2024-05-09T00:09:05.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.637+0000 7fae87400640 1 -- 172.21.15.114:0/2287337883 learned_addr learned my addr 172.21.15.114:0/2287337883 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86a00640 1 --2- 172.21.15.114:0/2287337883 >> v2:172.21.15.153:3300/0 conn(0x7fae88072720 0x7fae880c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145762549 0 0) 0x7fae88074040 con 0x7fae88073800 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae6c003520 con 0x7fae88073800 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1133566757 0 0) 0x7fae6c003520 con 0x7fae88073800 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 >> v2:172.21.15.153:3300/0 conn(0x7fae88072720 msgr2=0x7fae880c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 --2- 172.21.15.114:0/2287337883 >> v2:172.21.15.153:3300/0 conn(0x7fae88072720 0x7fae880c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 >> v1:172.21.15.153:6789/0 conn(0x7fae881585c0 legacy=0x7fae8815f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae880c5bd0 con 0x7fae88073800 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fae780016f0 con 0x7fae88073800 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 >> v1:172.21.15.114:6789/0 conn(0x7fae88073800 legacy=0x7fae880c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae6c003a50 0x7fae6c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae6c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c005300 0x7fae6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fae88073df0 con 0x7fae6c004800 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c00c2a0 con 0x7fae6c005300 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.638+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c00c4a0 con 0x7fae6c003a50 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae86a00640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae6c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae87400640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae6c003a50 0x7fae6c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae86a00640 1 -- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae6c003a50 msgr2=0x7fae6c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae86a00640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae6c003a50 0x7fae6c003ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae86a00640 1 -- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c005300 msgr2=0x7fae6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae86a00640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c005300 0x7fae6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae86a00640 1 -- 172.21.15.114:0/2287337883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c003520 con 0x7fae6c004800 2024-05-09T00:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.639+0000 7fae87e00640 1 -- 172.21.15.114:0/2287337883 reap_dead start 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.640+0000 7fae86a00640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae6c004c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae7400ba30 tx=0x7fae6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981cd276b80a22f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.640+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74030070 con 0x7fae6c004800 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.640+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7402ade0 con 0x7fae6c004800 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.640+0000 7fae86000640 1 -- 172.21.15.114:0/2287337883 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7400b600 con 0x7fae6c004800 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 -- 172.21.15.114:0/2287337883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 msgr2=0x7fae6c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae6c004c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae7400ba30 tx=0x7fae6c005830 comp rx=0 tx=0).stop 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 -- 172.21.15.114:0/2287337883 shutdown_connections 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 --2- 172.21.15.114:0/2287337883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae6c004c10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 -- 172.21.15.114:0/2287337883 >> 172.21.15.114:0/2287337883 conn(0x7fae8806c680 msgr2=0x7fae8806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 -- 172.21.15.114:0/2287337883 shutdown_connections 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.641+0000 7fae8e600640 1 -- 172.21.15.114:0/2287337883 wait complete. 2024-05-09T00:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.643+0000 7fae8e600640 1 Processor -- start 2024-05-09T00:09:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.643+0000 7fae8e600640 1 -- start start 2024-05-09T00:09:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae8e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae881ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae8e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae88149820 0x7fae8814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae8e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae8814d440 0x7fae8813ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae8e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fae88074320 con 0x7fae6c004800 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae8e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae880c5f40 con 0x7fae8814d440 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae8e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fae881528f0 con 0x7fae88149820 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae881ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae881ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59484/0 (socket says 172.21.15.114:59484) 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 -- 172.21.15.114:0/764091501 learned_addr learned my addr 172.21.15.114:0/764091501 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae86a00640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae88149820 0x7fae8814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 -- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae88149820 msgr2=0x7fae8814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae88149820 0x7fae8814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 -- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae8814d440 msgr2=0x7fae8813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae8814d440 0x7fae8813ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae87400640 1 -- 172.21.15.114:0/764091501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae881efb40 con 0x7fae6c004800 2024-05-09T00:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.645+0000 7fae86a00640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae88149820 0x7fae8814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.646+0000 7fae87400640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae881ef270 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fae7800d8e0 tx=0x7fae7800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.646+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae78019070 con 0x7fae6c004800 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.646+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780074e0 con 0x7fae6c004800 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.646+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8814ca40 con 0x7fae6c004800 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.646+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae78004a00 con 0x7fae6c004800 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.646+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae881efdb0 con 0x7fae6c004800 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.647+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae88077430 con 0x7fae6c004800 2024-05-09T00:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.648+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae7801c070 con 0x7fae6c004800 2024-05-09T00:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.649+0000 7fae7f400640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae68076300 0x7fae68078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.649+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fae78097330 con 0x7fae6c004800 2024-05-09T00:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.649+0000 7fae86a00640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae68076300 0x7fae68078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.650+0000 7fae86a00640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae68076300 0x7fae68078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fae7400ba00 tx=0x7fae74030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.654+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fae8814ca40 con 0x7fae6c004800 2024-05-09T00:09:05.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.838+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae880c5630 con 0x7fae68076300 2024-05-09T00:09:05.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.875+0000 7fae7f400640 1 -- 172.21.15.114:0/764091501 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490296 (secure 0 0 0) 0x7fae880c5630 con 0x7fae68076300 2024-05-09T00:09:05.884 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:05.887 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae68076300 msgr2=0x7fae68078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae68076300 0x7fae68078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fae7400ba00 tx=0x7fae74030000 comp rx=0 tx=0).stop 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 msgr2=0x7fae881ef270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae881ef270 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fae7800d8e0 tx=0x7fae7800dda0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 shutdown_connections 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae68076300 0x7fae68078810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae8814d440 0x7fae8813ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae88149820 0x7fae8814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 --2- 172.21.15.114:0/764091501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c004800 0x7fae881ef270 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 >> 172.21.15.114:0/764091501 conn(0x7fae8806c680 msgr2=0x7fae8806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.884+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 shutdown_connections 2024-05-09T00:09:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:05.885+0000 7fae8e600640 1 -- 172.21.15.114:0/764091501 wait complete. 2024-05-09T00:09:05.911 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-05-09T00:09:04.293503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219584,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755136,"statfs":{"total":773094113280,"available":772869259264,"internally_reserved":0,"allocated":3481600,"data_stored":2027328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.107125"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478651+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:58.478651+0000","last_peered":"2024-05-09T00:08:58.478651+0000","last_clean":"2024-05-09T00:08:58.478651+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:58.478651+0000","last_undegraded":"2024-05-09T00:08:58.478651+0000","last_fullsized":"2024-05-09T00:08:58.478651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476848+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:58.476848+0000","last_peered":"2024-05-09T00:08:58.476848+0000","last_clean":"2024-05-09T00:08:58.476848+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:58.476848+0000","last_undegraded":"2024-05-09T00:08:58.476848+0000","last_fullsized":"2024-05-09T00:08:58.476848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481099+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:58.481099+0000","last_peered":"2024-05-09T00:08:58.481099+0000","last_clean":"2024-05-09T00:08:58.481099+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:58.481099+0000","last_undegraded":"2024-05-09T00:08:58.481099+0000","last_fullsized":"2024-05-09T00:08:58.481099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480820+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:58.480820+0000","last_peered":"2024-05-09T00:08:58.480820+0000","last_clean":"2024-05-09T00:08:58.480820+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:58.480820+0000","last_undegraded":"2024-05-09T00:08:58.480820+0000","last_fullsized":"2024-05-09T00:08:58.480820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479058+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:58.479058+0000","last_peered":"2024-05-09T00:08:58.479058+0000","last_clean":"2024-05-09T00:08:58.479058+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:58.479058+0000","last_undegraded":"2024-05-09T00:08:58.479058+0000","last_fullsized":"2024-05-09T00:08:58.479058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480776+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:58.480776+0000","last_peered":"2024-05-09T00:08:58.480776+0000","last_clean":"2024-05-09T00:08:58.480776+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:58.480776+0000","last_undegraded":"2024-05-09T00:08:58.480776+0000","last_fullsized":"2024-05-09T00:08:58.480776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478159+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:58.478159+0000","last_peered":"2024-05-09T00:08:58.478159+0000","last_clean":"2024-05-09T00:08:58.478159+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:58.478159+0000","last_undegraded":"2024-05-09T00:08:58.478159+0000","last_fullsized":"2024-05-09T00:08:58.478159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475636+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:58.475636+0000","last_peered":"2024-05-09T00:08:58.475636+0000","last_clean":"2024-05-09T00:08:58.475636+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:58.475636+0000","last_undegraded":"2024-05-09T00:08:58.475636+0000","last_fullsized":"2024-05-09T00:08:58.475636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483407+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:58.483407+0000","last_peered":"2024-05-09T00:08:58.483407+0000","last_clean":"2024-05-09T00:08:58.483407+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:58.483407+0000","last_undegraded":"2024-05-09T00:08:58.483407+0000","last_fullsized":"2024-05-09T00:08:58.483407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480021+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:58.480021+0000","last_peered":"2024-05-09T00:08:58.480021+0000","last_clean":"2024-05-09T00:08:58.480021+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:58.480021+0000","last_undegraded":"2024-05-09T00:08:58.480021+0000","last_fullsized":"2024-05-09T00:08:58.480021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476066+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:58.476066+0000","last_peered":"2024-05-09T00:08:58.476066+0000","last_clean":"2024-05-09T00:08:58.476066+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:58.476066+0000","last_undegraded":"2024-05-09T00:08:58.476066+0000","last_fullsized":"2024-05-09T00:08:58.476066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483024+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:58.483024+0000","last_peered":"2024-05-09T00:08:58.483024+0000","last_clean":"2024-05-09T00:08:58.483024+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:58.483024+0000","last_undegraded":"2024-05-09T00:08:58.483024+0000","last_fullsized":"2024-05-09T00:08:58.483024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478064+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:58.478064+0000","last_peered":"2024-05-09T00:08:58.478064+0000","last_clean":"2024-05-09T00:08:58.478064+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:58.478064+0000","last_undegraded":"2024-05-09T00:08:58.478064+0000","last_fullsized":"2024-05-09T00:08:58.478064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477477+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:58.477477+0000","last_peered":"2024-05-09T00:08:58.477477+0000","last_clean":"2024-05-09T00:08:58.477477+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:58.477477+0000","last_undegraded":"2024-05-09T00:08:58.477477+0000","last_fullsized":"2024-05-09T00:08:58.477477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480993+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:58.480993+0000","last_peered":"2024-05-09T00:08:58.480993+0000","last_clean":"2024-05-09T00:08:58.480993+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:58.480993+0000","last_undegraded":"2024-05-09T00:08:58.480993+0000","last_fullsized":"2024-05-09T00:08:58.480993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478741+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:58.478741+0000","last_peered":"2024-05-09T00:08:58.478741+0000","last_clean":"2024-05-09T00:08:58.478741+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:58.478741+0000","last_undegraded":"2024-05-09T00:08:58.478741+0000","last_fullsized":"2024-05-09T00:08:58.478741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478705+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:58.478705+0000","last_peered":"2024-05-09T00:08:58.478705+0000","last_clean":"2024-05-09T00:08:58.478705+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:58.478705+0000","last_undegraded":"2024-05-09T00:08:58.478705+0000","last_fullsized":"2024-05-09T00:08:58.478705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483900+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:58.483900+0000","last_peered":"2024-05-09T00:08:58.483900+0000","last_clean":"2024-05-09T00:08:58.483900+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:58.483900+0000","last_undegraded":"2024-05-09T00:08:58.483900+0000","last_fullsized":"2024-05-09T00:08:58.483900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479091+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:58.479091+0000","last_peered":"2024-05-09T00:08:58.479091+0000","last_clean":"2024-05-09T00:08:58.479091+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:58.479091+0000","last_undegraded":"2024-05-09T00:08:58.479091+0000","last_fullsized":"2024-05-09T00:08:58.479091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477426+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:58.477426+0000","last_peered":"2024-05-09T00:08:58.477426+0000","last_clean":"2024-05-09T00:08:58.477426+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:58.477426+0000","last_undegraded":"2024-05-09T00:08:58.477426+0000","last_fullsized":"2024-05-09T00:08:58.477426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391402+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:08:57.391402+0000","last_peered":"2024-05-09T00:08:57.391402+0000","last_clean":"2024-05-09T00:08:57.391402+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:08:57.391402+0000","last_undegraded":"2024-05-09T00:08:57.391402+0000","last_fullsized":"2024-05-09T00:08:57.391402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476732+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:58.476732+0000","last_peered":"2024-05-09T00:08:58.476732+0000","last_clean":"2024-05-09T00:08:58.476732+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:58.476732+0000","last_undegraded":"2024-05-09T00:08:58.476732+0000","last_fullsized":"2024-05-09T00:08:58.476732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483217+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:08:58.483217+0000","last_peered":"2024-05-09T00:08:58.483217+0000","last_clean":"2024-05-09T00:08:58.483217+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:08:58.483217+0000","last_undegraded":"2024-05-09T00:08:58.483217+0000","last_fullsized":"2024-05-09T00:08:58.483217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481463+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:58.481463+0000","last_peered":"2024-05-09T00:08:58.481463+0000","last_clean":"2024-05-09T00:08:58.481463+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:58.481463+0000","last_undegraded":"2024-05-09T00:08:58.481463+0000","last_fullsized":"2024-05-09T00:08:58.481463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477387+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:58.477387+0000","last_peered":"2024-05-09T00:08:58.477387+0000","last_clean":"2024-05-09T00:08:58.477387+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:58.477387+0000","last_undegraded":"2024-05-09T00:08:58.477387+0000","last_fullsized":"2024-05-09T00:08:58.477387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478333+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:58.478333+0000","last_peered":"2024-05-09T00:08:58.478333+0000","last_clean":"2024-05-09T00:08:58.478333+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:58.478333+0000","last_undegraded":"2024-05-09T00:08:58.478333+0000","last_fullsized":"2024-05-09T00:08:58.478333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483817+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:58.483817+0000","last_peered":"2024-05-09T00:08:58.483817+0000","last_clean":"2024-05-09T00:08:58.483817+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:58.483817+0000","last_undegraded":"2024-05-09T00:08:58.483817+0000","last_fullsized":"2024-05-09T00:08:58.483817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483648+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:58.483648+0000","last_peered":"2024-05-09T00:08:58.483648+0000","last_clean":"2024-05-09T00:08:58.483648+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:58.483648+0000","last_undegraded":"2024-05-09T00:08:58.483648+0000","last_fullsized":"2024-05-09T00:08:58.483648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482784+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:58.482784+0000","last_peered":"2024-05-09T00:08:58.482784+0000","last_clean":"2024-05-09T00:08:58.482784+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:58.482784+0000","last_undegraded":"2024-05-09T00:08:58.482784+0000","last_fullsized":"2024-05-09T00:08:58.482784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479553+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:58.479553+0000","last_peered":"2024-05-09T00:08:58.479553+0000","last_clean":"2024-05-09T00:08:58.479553+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:58.479553+0000","last_undegraded":"2024-05-09T00:08:58.479553+0000","last_fullsized":"2024-05-09T00:08:58.479553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482839+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:58.482839+0000","last_peered":"2024-05-09T00:08:58.482839+0000","last_clean":"2024-05-09T00:08:58.482839+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:58.482839+0000","last_undegraded":"2024-05-09T00:08:58.482839+0000","last_fullsized":"2024-05-09T00:08:58.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475873+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:58.475873+0000","last_peered":"2024-05-09T00:08:58.475873+0000","last_clean":"2024-05-09T00:08:58.475873+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:58.475873+0000","last_undegraded":"2024-05-09T00:08:58.475873+0000","last_fullsized":"2024-05-09T00:08:58.475873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476268+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:58.476268+0000","last_peered":"2024-05-09T00:08:58.476268+0000","last_clean":"2024-05-09T00:08:58.476268+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:58.476268+0000","last_undegraded":"2024-05-09T00:08:58.476268+0000","last_fullsized":"2024-05-09T00:08:58.476268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:59.670906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483620+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:58.483620+0000","last_peered":"2024-05-09T00:08:58.483620+0000","last_clean":"2024-05-09T00:08:58.483620+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:58.483620+0000","last_undegraded":"2024-05-09T00:08:58.483620+0000","last_fullsized":"2024-05-09T00:08:58.483620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480061+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:58.480061+0000","last_peered":"2024-05-09T00:08:58.480061+0000","last_clean":"2024-05-09T00:08:58.480061+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:58.480061+0000","last_undegraded":"2024-05-09T00:08:58.480061+0000","last_fullsized":"2024-05-09T00:08:58.480061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480789+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:58.480789+0000","last_peered":"2024-05-09T00:08:58.480789+0000","last_clean":"2024-05-09T00:08:58.480789+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:58.480789+0000","last_undegraded":"2024-05-09T00:08:58.480789+0000","last_fullsized":"2024-05-09T00:08:58.480789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:49.557566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478428+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:58.478428+0000","last_peered":"2024-05-09T00:08:58.478428+0000","last_clean":"2024-05-09T00:08:58.478428+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:58.478428+0000","last_undegraded":"2024-05-09T00:08:58.478428+0000","last_fullsized":"2024-05-09T00:08:58.478428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477100+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:58.477100+0000","last_peered":"2024-05-09T00:08:58.477100+0000","last_clean":"2024-05-09T00:08:58.477100+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:58.477100+0000","last_undegraded":"2024-05-09T00:08:58.477100+0000","last_fullsized":"2024-05-09T00:08:58.477100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477818+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:58.477818+0000","last_peered":"2024-05-09T00:08:58.477818+0000","last_clean":"2024-05-09T00:08:58.477818+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:58.477818+0000","last_undegraded":"2024-05-09T00:08:58.477818+0000","last_fullsized":"2024-05-09T00:08:58.477818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477905+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:58.477905+0000","last_peered":"2024-05-09T00:08:58.477905+0000","last_clean":"2024-05-09T00:08:58.477905+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:58.477905+0000","last_undegraded":"2024-05-09T00:08:58.477905+0000","last_fullsized":"2024-05-09T00:08:58.477905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476613+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:58.476613+0000","last_peered":"2024-05-09T00:08:58.476613+0000","last_clean":"2024-05-09T00:08:58.476613+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:58.476613+0000","last_undegraded":"2024-05-09T00:08:58.476613+0000","last_fullsized":"2024-05-09T00:08:58.476613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475819+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:58.475819+0000","last_peered":"2024-05-09T00:08:58.475819+0000","last_clean":"2024-05-09T00:08:58.475819+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:58.475819+0000","last_undegraded":"2024-05-09T00:08:58.475819+0000","last_fullsized":"2024-05-09T00:08:58.475819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477248+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:58.477248+0000","last_peered":"2024-05-09T00:08:58.477248+0000","last_clean":"2024-05-09T00:08:58.477248+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:58.477248+0000","last_undegraded":"2024-05-09T00:08:58.477248+0000","last_fullsized":"2024-05-09T00:08:58.477248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476388+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:58.476388+0000","last_peered":"2024-05-09T00:08:58.476388+0000","last_clean":"2024-05-09T00:08:58.476388+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:58.476388+0000","last_undegraded":"2024-05-09T00:08:58.476388+0000","last_fullsized":"2024-05-09T00:08:58.476388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483808+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:58.483808+0000","last_peered":"2024-05-09T00:08:58.483808+0000","last_clean":"2024-05-09T00:08:58.483808+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:58.483808+0000","last_undegraded":"2024-05-09T00:08:58.483808+0000","last_fullsized":"2024-05-09T00:08:58.483808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477114+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:58.477114+0000","last_peered":"2024-05-09T00:08:58.477114+0000","last_clean":"2024-05-09T00:08:58.477114+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:58.477114+0000","last_undegraded":"2024-05-09T00:08:58.477114+0000","last_fullsized":"2024-05-09T00:08:58.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481101+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:58.481101+0000","last_peered":"2024-05-09T00:08:58.481101+0000","last_clean":"2024-05-09T00:08:58.481101+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:58.481101+0000","last_undegraded":"2024-05-09T00:08:58.481101+0000","last_fullsized":"2024-05-09T00:08:58.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478553+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:58.478553+0000","last_peered":"2024-05-09T00:08:58.478553+0000","last_clean":"2024-05-09T00:08:58.478553+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:58.478553+0000","last_undegraded":"2024-05-09T00:08:58.478553+0000","last_fullsized":"2024-05-09T00:08:58.478553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483038+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:58.483038+0000","last_peered":"2024-05-09T00:08:58.483038+0000","last_clean":"2024-05-09T00:08:58.483038+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:58.483038+0000","last_undegraded":"2024-05-09T00:08:58.483038+0000","last_fullsized":"2024-05-09T00:08:58.483038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479550+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:58.479550+0000","last_peered":"2024-05-09T00:08:58.479550+0000","last_clean":"2024-05-09T00:08:58.479550+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:58.479550+0000","last_undegraded":"2024-05-09T00:08:58.479550+0000","last_fullsized":"2024-05-09T00:08:58.479550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479863+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:58.479863+0000","last_peered":"2024-05-09T00:08:58.479863+0000","last_clean":"2024-05-09T00:08:58.479863+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:58.479863+0000","last_undegraded":"2024-05-09T00:08:58.479863+0000","last_fullsized":"2024-05-09T00:08:58.479863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478406+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:58.478406+0000","last_peered":"2024-05-09T00:08:58.478406+0000","last_clean":"2024-05-09T00:08:58.478406+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:58.478406+0000","last_undegraded":"2024-05-09T00:08:58.478406+0000","last_fullsized":"2024-05-09T00:08:58.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":106231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":307200,"data_stored":108537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:05.918 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T00:09:05.918 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T00:09:05.918 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T00:09:05.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T00:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.216+0000 7fb266400640 1 Processor -- start 2024-05-09T00:09:06.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.216+0000 7fb266400640 1 -- start start 2024-05-09T00:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.218+0000 7fb266400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb26006fab0 0x7fb260154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.218+0000 7fb266400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb260073bc0 con 0x7fb2600af300 2024-05-09T00:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.218+0000 7fb266400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb260158c30 con 0x7fb2601586e0 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.218+0000 7fb266400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2600c54c0 con 0x7fb26006fab0 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.218+0000 7fb256a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb2600af300 0x7fb260154730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53218/0 (socket says 172.21.15.114:53218) 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.218+0000 7fb256a00640 1 -- 172.21.15.114:0/248598816 learned_addr learned my addr 172.21.15.114:0/248598816 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25fe00640 1 --2- 172.21.15.114:0/248598816 >> v2:172.21.15.153:3300/0 conn(0x7fb26006fab0 0x7fb260154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572692624 0 0) 0x7fb248001110 con 0x7fb2600af300 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb244003440 con 0x7fb2600af300 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4213200368 0 0) 0x7fb244003440 con 0x7fb2600af300 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 >> v2:172.21.15.153:3300/0 conn(0x7fb26006fab0 msgr2=0x7fb260154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 --2- 172.21.15.114:0/248598816 >> v2:172.21.15.153:3300/0 conn(0x7fb26006fab0 0x7fb260154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 >> v1:172.21.15.153:6789/0 conn(0x7fb2601586e0 legacy=0x7fb26006f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb260073600 con 0x7fb2600af300 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fb2480018e0 con 0x7fb2600af300 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 >> v1:172.21.15.114:6789/0 conn(0x7fb2600af300 legacy=0x7fb260154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244003b40 0x7fb244003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb244008940 0x7fb24400ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb24400b6a0 0x7fb24400dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2600c54c0 con 0x7fb244008940 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb24400e490 con 0x7fb24400b6a0 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.219+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb24400e690 con 0x7fb244003b40 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb256a00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb244008940 0x7fb24400ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb25f400640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244003b40 0x7fb244003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb25fe00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb24400b6a0 0x7fb24400dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb256a00640 1 -- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244003b40 msgr2=0x7fb244003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb256a00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244003b40 0x7fb244003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb256a00640 1 -- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb24400b6a0 msgr2=0x7fb24400dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb256a00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb24400b6a0 0x7fb24400dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb25fe00640 1 -- 172.21.15.114:0/248598816 reap_dead start 2024-05-09T00:09:06.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb256a00640 1 -- 172.21.15.114:0/248598816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb244003440 con 0x7fb244008940 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.220+0000 7fb25f400640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244003b40 0x7fb244003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.221+0000 7fb256a00640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb244008940 0x7fb24400ae00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c490 tx=0x7fb244003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80c5033809c951 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.221+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248036070 con 0x7fb244008940 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.221+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb248005af0 con 0x7fb244008940 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.221+0000 7fb25ea00640 1 -- 172.21.15.114:0/248598816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24800c0e0 con 0x7fb244008940 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 -- 172.21.15.114:0/248598816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb244008940 msgr2=0x7fb24400ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb244008940 0x7fb24400ae00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c490 tx=0x7fb244003730 comp rx=0 tx=0).stop 2024-05-09T00:09:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 -- 172.21.15.114:0/248598816 shutdown_connections 2024-05-09T00:09:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 --2- 172.21.15.114:0/248598816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb244008940 0x7fb24400ae00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 -- 172.21.15.114:0/248598816 >> 172.21.15.114:0/248598816 conn(0x7fb26006c680 msgr2=0x7fb26006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 -- 172.21.15.114:0/248598816 shutdown_connections 2024-05-09T00:09:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.222+0000 7fb266400640 1 -- 172.21.15.114:0/248598816 wait complete. 2024-05-09T00:09:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.224+0000 7fb266400640 1 Processor -- start 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.225+0000 7fb266400640 1 -- start start 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb266400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244008940 0x7fb2601e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb266400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 0x7fb26014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb266400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2601f2100 0x7fb2601f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb266400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb260151f70 con 0x7fb2601553e0 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb266400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb26006fec0 con 0x7fb2601f2100 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb266400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2601520f0 con 0x7fb244008940 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb256a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 0x7fb26014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb256a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 0x7fb26014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59506/0 (socket says 172.21.15.114:59506) 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb256a00640 1 -- 172.21.15.114:0/1514788713 learned_addr learned my addr 172.21.15.114:0/1514788713 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.226+0000 7fb25f400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244008940 0x7fb2601e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb25fe00640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2601f2100 0x7fb2601f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb256a00640 1 -- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244008940 msgr2=0x7fb2601e2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb256a00640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244008940 0x7fb2601e2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb256a00640 1 -- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2601f2100 msgr2=0x7fb2601f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb256a00640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2601f2100 0x7fb2601f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb256a00640 1 -- 172.21.15.114:0/1514788713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26014f280 con 0x7fb2601553e0 2024-05-09T00:09:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb256a00640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 0x7fb26014dd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c5b0 tx=0x7fb2600737d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248041020 con 0x7fb2601553e0 2024-05-09T00:09:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480016a0 con 0x7fb2601553e0 2024-05-09T00:09:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248036030 con 0x7fb2601553e0 2024-05-09T00:09:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26014f560 con 0x7fb2601553e0 2024-05-09T00:09:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.227+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2601e1320 con 0x7fb2601553e0 2024-05-09T00:09:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.228+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2601f1a10 con 0x7fb2601553e0 2024-05-09T00:09:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.230+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb248044020 con 0x7fb2601553e0 2024-05-09T00:09:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.231+0000 7fb257e00640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb23c0762d0 0x7fb23c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.231+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb2480b7490 con 0x7fb2601553e0 2024-05-09T00:09:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.231+0000 7fb25f400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb23c0762d0 0x7fb23c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.231+0000 7fb25f400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb23c0762d0 0x7fb23c0787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb26006a230 tx=0x7fb250009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.235+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb24804b070 con 0x7fb2601553e0 2024-05-09T00:09:06.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.478+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb260077430 con 0x7fb2601553e0 2024-05-09T00:09:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.479+0000 7fb257e00640 1 -- 172.21.15.114:0/1514788713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb260073bc0 con 0x7fb2601553e0 2024-05-09T00:09:06.475 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:06.475 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb23c0762d0 msgr2=0x7fb23c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb23c0762d0 0x7fb23c0787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb26006a230 tx=0x7fb250009040 comp rx=0 tx=0).stop 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 msgr2=0x7fb26014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 0x7fb26014dd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c5b0 tx=0x7fb2600737d0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 shutdown_connections 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb23c0762d0 0x7fb23c0787e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2601f2100 0x7fb2601f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2601553e0 0x7fb26014dd50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 --2- 172.21.15.114:0/1514788713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb244008940 0x7fb2601e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 >> 172.21.15.114:0/1514788713 conn(0x7fb26006c680 msgr2=0x7fb2601513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 shutdown_connections 2024-05-09T00:09:06.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.481+0000 7fb266400640 1 -- 172.21.15.114:0/1514788713 wait complete. 2024-05-09T00:09:06.500 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T00:09:06.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.770+0000 7fa39ce00640 1 Processor -- start 2024-05-09T00:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.771+0000 7fa39ce00640 1 -- start start 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa39ce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa39815c260 0x7fa3980c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa39ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa398073550 0x7fa398073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa39ce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa398141270 con 0x7fa398140e60 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa39ce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa398158cf0 con 0x7fa398073550 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa39ce00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa39815c740 con 0x7fa39815c260 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa396800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa398073550 0x7fa398073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa395400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa398140e60 0x7fa3980c60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53232/0 (socket says 172.21.15.114:53232) 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa396800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa398073550 0x7fa398073960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59508/0 (socket says 172.21.15.114:59508) 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa395400640 1 -- 172.21.15.114:0/4116175032 learned_addr learned my addr 172.21.15.114:0/4116175032 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.773+0000 7fa395e00640 1 --2- 172.21.15.114:0/4116175032 >> v2:172.21.15.153:3300/0 conn(0x7fa39815c260 0x7fa3980c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.774+0000 7fa396800640 1 -- 172.21.15.114:0/4116175032 >> v2:172.21.15.153:3300/0 conn(0x7fa39815c260 msgr2=0x7fa3980c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.774+0000 7fa396800640 1 --2- 172.21.15.114:0/4116175032 >> v2:172.21.15.153:3300/0 conn(0x7fa39815c260 0x7fa3980c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.774+0000 7fa396800640 1 -- 172.21.15.114:0/4116175032 >> v1:172.21.15.114:6789/0 conn(0x7fa398140e60 legacy=0x7fa3980c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.774+0000 7fa396800640 1 -- 172.21.15.114:0/4116175032 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3981583c0 con 0x7fa398073550 2024-05-09T00:09:06.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.775+0000 7fa396800640 1 --2- 172.21.15.114:0/4116175032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398073550 0x7fa398073960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa398071b30 tx=0x7fa39002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6b4782e89c07cd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.775+0000 7fa394a00640 1 -- 172.21.15.114:0/4116175032 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390037070 con 0x7fa398073550 2024-05-09T00:09:06.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.775+0000 7fa394a00640 1 -- 172.21.15.114:0/4116175032 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa390032440 con 0x7fa398073550 2024-05-09T00:09:06.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.775+0000 7fa394a00640 1 -- 172.21.15.114:0/4116175032 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390032810 con 0x7fa398073550 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 -- 172.21.15.114:0/4116175032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398073550 msgr2=0x7fa398073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 --2- 172.21.15.114:0/4116175032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398073550 0x7fa398073960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa398071b30 tx=0x7fa39002a1a0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 -- 172.21.15.114:0/4116175032 shutdown_connections 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 --2- 172.21.15.114:0/4116175032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398073550 0x7fa398073960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 --2- 172.21.15.114:0/4116175032 >> v2:172.21.15.153:3300/0 conn(0x7fa39815c260 0x7fa3980c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 -- 172.21.15.114:0/4116175032 >> 172.21.15.114:0/4116175032 conn(0x7fa39806c680 msgr2=0x7fa39806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 -- 172.21.15.114:0/4116175032 shutdown_connections 2024-05-09T00:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.776+0000 7fa39ce00640 1 -- 172.21.15.114:0/4116175032 wait complete. 2024-05-09T00:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.779+0000 7fa39ce00640 1 Processor -- start 2024-05-09T00:09:06.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.779+0000 7fa39ce00640 1 -- start start 2024-05-09T00:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa398073550 0x7fa3980c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 0x7fa3980c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa39815c260 0x7fa3980c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa39ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa398159180 con 0x7fa398140e60 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa39ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa398158980 con 0x7fa398073550 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa39ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3980c6800 con 0x7fa39815c260 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 0x7fa3980c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 0x7fa3980c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59524/0 (socket says 172.21.15.114:59524) 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 -- 172.21.15.114:0/377583579 learned_addr learned my addr 172.21.15.114:0/377583579 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395e00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa398073550 0x7fa3980c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa396800640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa39815c260 0x7fa3980c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 -- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa39815c260 msgr2=0x7fa3980c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa39815c260 0x7fa3980c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 -- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa398073550 msgr2=0x7fa3980c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa398073550 0x7fa3980c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.781+0000 7fa395400640 1 -- 172.21.15.114:0/377583579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39813c2a0 con 0x7fa398140e60 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa396800640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa39815c260 0x7fa3980c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa395400640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 0x7fa3980c79a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa38000cb10 tx=0x7fa38000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380017070 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38000ac90 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380012640 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3981ee9e0 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.782+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3980c8d60 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.783+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa398070200 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.785+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa38001a070 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.786+0000 7fa38e000640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa374076300 0x7fa374078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.786+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fa380097770 con 0x7fa398140e60 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.786+0000 7fa395e00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa374076300 0x7fa374078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.787+0000 7fa395e00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa374076300 0x7fa374078810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa388006fd0 tx=0x7fa388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:06.790+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa398070200 con 0x7fa398140e60 2024-05-09T00:09:07.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.035+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa398077430 con 0x7fa398140e60 2024-05-09T00:09:07.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.036+0000 7fa38e000640 1 -- 172.21.15.114:0/377583579 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fa380060d00 con 0x7fa398140e60 2024-05-09T00:09:07.033 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:07.033 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:07.033 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa374076300 msgr2=0x7fa374078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa374076300 0x7fa374078810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa388006fd0 tx=0x7fa388008040 comp rx=0 tx=0).stop 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 msgr2=0x7fa3980c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 0x7fa3980c79a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa38000cb10 tx=0x7fa38000a060 comp rx=0 tx=0).stop 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 shutdown_connections 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa374076300 0x7fa374078810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa39815c260 0x7fa3980c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa398140e60 0x7fa3980c79a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 --2- 172.21.15.114:0/377583579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa398073550 0x7fa3980c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 >> 172.21.15.114:0/377583579 conn(0x7fa39806c680 msgr2=0x7fa39806faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 shutdown_connections 2024-05-09T00:09:07.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.039+0000 7fa39ce00640 1 -- 172.21.15.114:0/377583579 wait complete. 2024-05-09T00:09:07.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.325+0000 7f957b000640 1 Processor -- start 2024-05-09T00:09:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.325+0000 7f957b000640 1 -- start start 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.327+0000 7f957b000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.327+0000 7f957b000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9574159830 0x7f9574159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.327+0000 7f957b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f957415a180 0x7f957406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.327+0000 7f957b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f95740ac710 con 0x7f957415a180 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f957b000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9574156bb0 con 0x7f9574159830 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f957b000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9574156e90 con 0x7f95740c43c0 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f957415a180 0x7f957406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f957415a180 0x7f957406f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59538/0 (socket says 172.21.15.114:59538) 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 -- 172.21.15.114:0/3521611939 learned_addr learned my addr 172.21.15.114:0/3521611939 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f956b400640 1 --2- 172.21.15.114:0/3521611939 >> v2:172.21.15.153:3300/0 conn(0x7f9574159830 0x7f9574159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9573e00640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 -- 172.21.15.114:0/3521611939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 msgr2=0x7f9574153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 -- 172.21.15.114:0/3521611939 >> v2:172.21.15.153:3300/0 conn(0x7f9574159830 msgr2=0x7f9574159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 --2- 172.21.15.114:0/3521611939 >> v2:172.21.15.153:3300/0 conn(0x7f9574159830 0x7f9574159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9579000640 1 -- 172.21.15.114:0/3521611939 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95740ac960 con 0x7f957415a180 2024-05-09T00:09:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.328+0000 7f9573e00640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:07.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.329+0000 7f9579000640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957415a180 0x7f957406f3a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f956c009870 tx=0x7f956c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6195afb8ce31e12c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.330+0000 7f9573400640 1 -- 172.21.15.114:0/3521611939 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c037070 con 0x7f957415a180 2024-05-09T00:09:07.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.330+0000 7f9573400640 1 -- 172.21.15.114:0/3521611939 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956c032440 con 0x7f957415a180 2024-05-09T00:09:07.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.330+0000 7f9573400640 1 -- 172.21.15.114:0/3521611939 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c032810 con 0x7f957415a180 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.330+0000 7f957b000640 1 -- 172.21.15.114:0/3521611939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957415a180 msgr2=0x7f957406f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.330+0000 7f957b000640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957415a180 0x7f957406f3a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f956c009870 tx=0x7f956c02a180 comp rx=0 tx=0).stop 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 -- 172.21.15.114:0/3521611939 shutdown_connections 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957415a180 0x7f957406f3a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 --2- 172.21.15.114:0/3521611939 >> v2:172.21.15.153:3300/0 conn(0x7f9574159830 0x7f9574159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 --2- 172.21.15.114:0/3521611939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 -- 172.21.15.114:0/3521611939 >> 172.21.15.114:0/3521611939 conn(0x7f957406c680 msgr2=0x7f957406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 -- 172.21.15.114:0/3521611939 shutdown_connections 2024-05-09T00:09:07.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.331+0000 7f957b000640 1 -- 172.21.15.114:0/3521611939 wait complete. 2024-05-09T00:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.333+0000 7f957b000640 1 Processor -- start 2024-05-09T00:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.333+0000 7f957b000640 1 -- start start 2024-05-09T00:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.334+0000 7f957b000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.334+0000 7f957b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 0x7f95741f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.334+0000 7f957b000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957415a180 0x7f9574073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.334+0000 7f957b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f957406f8e0 con 0x7f9574159830 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.334+0000 7f957b000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95740ad3c0 con 0x7f957415a180 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.334+0000 7f957b000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f957406fa60 con 0x7f95740c43c0 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 0x7f95741f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 0x7f95741f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59548/0 (socket says 172.21.15.114:59548) 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 -- 172.21.15.114:0/1126856496 learned_addr learned my addr 172.21.15.114:0/1126856496 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 -- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 msgr2=0x7f9574158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f9579000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957415a180 0x7f9574073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 -- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957415a180 msgr2=0x7f9574073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957415a180 0x7f9574073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 -- 172.21.15.114:0/1126856496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95741f23b0 con 0x7f9574159830 2024-05-09T00:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.335+0000 7f956b400640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 0x7f95741f1930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f955c00d5f0 tx=0x7f955c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.336+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0125f0 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.336+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c019070 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.336+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9574157c50 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.336+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0129d0 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.336+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95741593c0 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.337+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9574077430 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.338+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f955c012b70 con 0x7f9574159830 2024-05-09T00:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.340+0000 7f9570c00640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9550076300 0x7f9550078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.340+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f955c097c10 con 0x7f9574159830 2024-05-09T00:09:07.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.340+0000 7f9573e00640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9550076300 0x7f9550078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.341+0000 7f9573e00640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9550076300 0x7f9550078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9564007130 tx=0x7f9564007320 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.345+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f955c0612d0 con 0x7f9574159830 2024-05-09T00:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.582+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95740c6ca0 con 0x7f9574159830 2024-05-09T00:09:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.583+0000 7f9570c00640 1 -- 172.21.15.114:0/1126856496 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f955c060bd0 con 0x7f9574159830 2024-05-09T00:09:07.580 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:07.580 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9550076300 msgr2=0x7f9550078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9550076300 0x7f9550078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9564007130 tx=0x7f9564007320 comp rx=0 tx=0).stop 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 msgr2=0x7f95741f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 0x7f95741f1930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f955c00d5f0 tx=0x7f955c00dab0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 shutdown_connections 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9550076300 0x7f9550078810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957415a180 0x7f9574073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9574159830 0x7f95741f1930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 --2- 172.21.15.114:0/1126856496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95740c43c0 0x7f9574158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 >> 172.21.15.114:0/1126856496 conn(0x7f957406c680 msgr2=0x7f95740c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 shutdown_connections 2024-05-09T00:09:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.588+0000 7f957b000640 1 -- 172.21.15.114:0/1126856496 wait complete. 2024-05-09T00:09:07.611 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.875+0000 7f3d67a00640 1 Processor -- start 2024-05-09T00:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.876+0000 7f3d67a00640 1 -- start start 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.877+0000 7f3d67a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 0x7f3d60158700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d67a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d600aba00 0x7f3d600abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d67a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d600ac350 con 0x7f3d600c6b40 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d67a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3d600c5e90 con 0x7f3d600aba00 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d67a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d601590d0 con 0x7f3d600bfbc0 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d5fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3d600c6b40 0x7f3d601522e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40030/0 (socket says 172.21.15.114:40030) 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d5fe00640 1 -- 172.21.15.114:0/3410307192 learned_addr learned my addr 172.21.15.114:0/3410307192 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d65a00640 1 --2- 172.21.15.114:0/3410307192 >> v2:172.21.15.153:3300/0 conn(0x7f3d600aba00 0x7f3d600abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d65000640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 0x7f3d60158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272908203 0 0) 0x7f3d4c001110 con 0x7f3d600c6b40 2024-05-09T00:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.878+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d44003520 con 0x7f3d600c6b40 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 532562707 0 0) 0x7f3d44003520 con 0x7f3d600c6b40 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 msgr2=0x7f3d60158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 0x7f3d60158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 >> v2:172.21.15.153:3300/0 conn(0x7f3d600aba00 msgr2=0x7f3d600abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 --2- 172.21.15.114:0/3410307192 >> v2:172.21.15.153:3300/0 conn(0x7f3d600aba00 0x7f3d600abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d601593b0 con 0x7f3d600c6b40 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f3d4c0018c0 con 0x7f3d600c6b40 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 >> v1:172.21.15.114:6789/0 conn(0x7f3d600c6b40 legacy=0x7f3d601522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44003a00 0x7f3d44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d44004800 0x7f3d44004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 0x7f3d44005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600c5e90 con 0x7f3d44004800 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d601590d0 con 0x7f3d44003a00 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4400baf0 con 0x7f3d600bfbc0 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.879+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d44004800 0x7f3d44004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.880+0000 7f3d65000640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44003a00 0x7f3d44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.880+0000 7f3d5fe00640 1 -- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 msgr2=0x7f3d44005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.880+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d600bfbc0 0x7f3d44005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.880+0000 7f3d5fe00640 1 -- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44003a00 msgr2=0x7f3d44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.880+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44003a00 0x7f3d44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.880+0000 7f3d5fe00640 1 -- 172.21.15.114:0/3410307192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d44003520 con 0x7f3d44004800 2024-05-09T00:09:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.881+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d44004800 0x7f3d44004c10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c3e0 tx=0x7f3d44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595fa3ddc6815a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.881+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00c0e0 con 0x7f3d44004800 2024-05-09T00:09:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.881+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c034070 con 0x7f3d44004800 2024-05-09T00:09:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.881+0000 7f3d5f400640 1 -- 172.21.15.114:0/3410307192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c005d10 con 0x7f3d44004800 2024-05-09T00:09:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d67a00640 1 -- 172.21.15.114:0/3410307192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d44004800 msgr2=0x7f3d44004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d67a00640 1 --2- 172.21.15.114:0/3410307192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d44004800 0x7f3d44004c10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c3e0 tx=0x7f3d44005830 comp rx=0 tx=0).stop 2024-05-09T00:09:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d65a00640 1 -- 172.21.15.114:0/3410307192 reap_dead start 2024-05-09T00:09:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d67a00640 1 -- 172.21.15.114:0/3410307192 shutdown_connections 2024-05-09T00:09:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d67a00640 1 -- 172.21.15.114:0/3410307192 >> 172.21.15.114:0/3410307192 conn(0x7f3d600c7170 msgr2=0x7f3d600c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d67a00640 1 -- 172.21.15.114:0/3410307192 shutdown_connections 2024-05-09T00:09:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.882+0000 7f3d67a00640 1 -- 172.21.15.114:0/3410307192 wait complete. 2024-05-09T00:09:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.884+0000 7f3d67a00640 1 Processor -- start 2024-05-09T00:09:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.885+0000 7f3d67a00640 1 -- start start 2024-05-09T00:09:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d67a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44004800 0x7f3d6006f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d67a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d601eed10 0x7f3d60156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d67a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 0x7f3d6014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d67a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600c6320 con 0x7f3d6014baf0 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d67a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600748d0 con 0x7f3d44004800 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d67a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d600c64a0 con 0x7f3d601eed10 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 0x7f3d6014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 0x7f3d6014b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58432/0 (socket says 172.21.15.114:58432) 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.886+0000 7f3d65a00640 1 -- 172.21.15.114:0/657047933 learned_addr learned my addr 172.21.15.114:0/657047933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65000640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44004800 0x7f3d6006f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65a00640 1 -- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d601eed10 msgr2=0x7f3d60156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d601eed10 0x7f3d60156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65a00640 1 -- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44004800 msgr2=0x7f3d6006f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44004800 0x7f3d6006f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65a00640 1 -- 172.21.15.114:0/657047933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6014e460 con 0x7f3d6014baf0 2024-05-09T00:09:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65000640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44004800 0x7f3d6006f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d65a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 0x7f3d6014b060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800e770 tx=0x7f3d5800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58017070 con 0x7f3d6014baf0 2024-05-09T00:09:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5800c650 con 0x7f3d6014baf0 2024-05-09T00:09:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6014e180 con 0x7f3d6014baf0 2024-05-09T00:09:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800ca40 con 0x7f3d6014baf0 2024-05-09T00:09:07.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.887+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d601ee510 con 0x7f3d6014baf0 2024-05-09T00:09:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.889+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d60071400 con 0x7f3d6014baf0 2024-05-09T00:09:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.890+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d5801a070 con 0x7f3d6014baf0 2024-05-09T00:09:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.891+0000 7f3d5cc00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3d40076300 0x7f3d40078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.891+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f3d58097860 con 0x7f3d6014baf0 2024-05-09T00:09:07.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.891+0000 7f3d65000640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3d40076300 0x7f3d40078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.892+0000 7f3d65000640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3d40076300 0x7f3d40078810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d600c1390 tx=0x7f3d5000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:07.895+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d60071400 con 0x7f3d6014baf0 2024-05-09T00:09:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.107+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d601ee020 con 0x7f3d6014baf0 2024-05-09T00:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.109+0000 7f3d5cc00640 1 -- 172.21.15.114:0/657047933 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7f3d58060f20 con 0x7f3d6014baf0 2024-05-09T00:09:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:08.106 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.111+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3d40076300 msgr2=0x7f3d40078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.111+0000 7f3d67a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3d40076300 0x7f3d40078810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d600c1390 tx=0x7f3d5000b040 comp rx=0 tx=0).stop 2024-05-09T00:09:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.111+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 msgr2=0x7f3d6014b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.111+0000 7f3d67a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 0x7f3d6014b060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800e770 tx=0x7f3d5800ec30 comp rx=0 tx=0).stop 2024-05-09T00:09:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 shutdown_connections 2024-05-09T00:09:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3d40076300 0x7f3d40078810 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d6014baf0 0x7f3d6014b060 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d601eed10 0x7f3d60156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 --2- 172.21.15.114:0/657047933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d44004800 0x7f3d6006f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 >> 172.21.15.114:0/657047933 conn(0x7f3d600c7170 msgr2=0x7f3d600c8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 shutdown_connections 2024-05-09T00:09:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.112+0000 7f3d67a00640 1 -- 172.21.15.114:0/657047933 wait complete. 2024-05-09T00:09:08.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:08.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.397+0000 7f732dc00640 1 Processor -- start 2024-05-09T00:09:08.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.397+0000 7f732dc00640 1 -- start start 2024-05-09T00:09:08.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f732dc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f73280c53b0 0x7f7328155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:08.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f732dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f732815bb60 0x7f732815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:08.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f732dc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73280c3280 con 0x7f73280c4070 2024-05-09T00:09:08.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f732dc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f73280c3b70 con 0x7f73280c53b0 2024-05-09T00:09:08.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f732dc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f73280c3520 con 0x7f732815bb60 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f7326a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f73280c4070 0x7f73280c9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40036/0 (socket says 172.21.15.114:40036) 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f7326a00640 1 -- 172.21.15.114:0/1550326073 learned_addr learned my addr 172.21.15.114:0/1550326073 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f7326000640 1 --2- 172.21.15.114:0/1550326073 >> v2:172.21.15.114:3300/0 conn(0x7f73280c53b0 0x7f7328155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.399+0000 7f7327400640 1 --2- 172.21.15.114:0/1550326073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f732815bb60 0x7f732815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.400+0000 7f7325600640 1 -- 172.21.15.114:0/1550326073 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251141791 0 0) 0x7f73280c3280 con 0x7f73280c4070 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.400+0000 7f7326000640 1 -- 172.21.15.114:0/1550326073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f732815bb60 msgr2=0x7f732815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.400+0000 7f7326000640 1 --2- 172.21.15.114:0/1550326073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f732815bb60 0x7f732815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.400+0000 7f7326000640 1 -- 172.21.15.114:0/1550326073 >> v1:172.21.15.114:6789/0 conn(0x7f73280c4070 legacy=0x7f73280c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.400+0000 7f7326000640 1 -- 172.21.15.114:0/1550326073 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73280c3800 con 0x7f73280c53b0 2024-05-09T00:09:08.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.401+0000 7f7326000640 1 --2- 172.21.15.114:0/1550326073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c53b0 0x7f7328155b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73140097a0 tx=0x7f731402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bfa7ebb0550ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:08.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.403+0000 7f7325600640 1 -- 172.21.15.114:0/1550326073 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314037070 con 0x7f73280c53b0 2024-05-09T00:09:08.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.403+0000 7f7325600640 1 -- 172.21.15.114:0/1550326073 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731402ae50 con 0x7f73280c53b0 2024-05-09T00:09:08.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.403+0000 7f7325600640 1 -- 172.21.15.114:0/1550326073 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314032660 con 0x7f73280c53b0 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 -- 172.21.15.114:0/1550326073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c53b0 msgr2=0x7f7328155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 --2- 172.21.15.114:0/1550326073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c53b0 0x7f7328155b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73140097a0 tx=0x7f731402a100 comp rx=0 tx=0).stop 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 -- 172.21.15.114:0/1550326073 shutdown_connections 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 --2- 172.21.15.114:0/1550326073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f732815bb60 0x7f732815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 --2- 172.21.15.114:0/1550326073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c53b0 0x7f7328155b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 -- 172.21.15.114:0/1550326073 >> 172.21.15.114:0/1550326073 conn(0x7f73280ac3b0 msgr2=0x7f732806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.404+0000 7f732dc00640 1 -- 172.21.15.114:0/1550326073 shutdown_connections 2024-05-09T00:09:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.405+0000 7f732dc00640 1 -- 172.21.15.114:0/1550326073 wait complete. 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.407+0000 7f732dc00640 1 Processor -- start 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.407+0000 7f732dc00640 1 -- start start 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f732dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 0x7f73280af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f732dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73280c53b0 0x7f7328150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f732dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f732815bb60 0x7f7328158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f732dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73280c99f0 con 0x7f73280c4070 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f732dc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f73280c9870 con 0x7f732815bb60 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f732dc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f732806ec10 con 0x7f73280c53b0 2024-05-09T00:09:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f7326a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 0x7f73280af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f7326a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 0x7f73280af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58444/0 (socket says 172.21.15.114:58444) 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.408+0000 7f7326a00640 1 -- 172.21.15.114:0/3499774809 learned_addr learned my addr 172.21.15.114:0/3499774809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7327400640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f732815bb60 0x7f7328158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326a00640 1 -- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73280c53b0 msgr2=0x7f7328150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326000640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73280c53b0 0x7f7328150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326a00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73280c53b0 0x7f7328150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326a00640 1 -- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f732815bb60 msgr2=0x7f7328158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326a00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f732815bb60 0x7f7328158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326a00640 1 -- 172.21.15.114:0/3499774809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73280747c0 con 0x7f73280c4070 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f7326a00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 0x7f73280af4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f731800c3f0 tx=0x7f731800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73180074e0 con 0x7f73280c4070 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73180047e0 con 0x7f73280c4070 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318004bd0 con 0x7f73280c4070 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.409+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73280ad880 con 0x7f73280c4070 2024-05-09T00:09:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.410+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281505d0 con 0x7f73280c4070 2024-05-09T00:09:08.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.411+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7328077430 con 0x7f73280c4070 2024-05-09T00:09:08.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.412+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7318011070 con 0x7f73280c4070 2024-05-09T00:09:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.413+0000 7f731ea00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73080762d0 0x7f73080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.413+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f7318097540 con 0x7f73280c4070 2024-05-09T00:09:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.413+0000 7f7326000640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73080762d0 0x7f73080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.414+0000 7f7326000640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73080762d0 0x7f73080787e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7314034000 tx=0x7f731402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:08.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.418+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7318060ad0 con 0x7f73280c4070 2024-05-09T00:09:08.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.645+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73280c5f10 con 0x7f73280c4070 2024-05-09T00:09:08.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.646+0000 7f731ea00640 1 -- 172.21.15.114:0/3499774809 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f73180603d0 con 0x7f73280c4070 2024-05-09T00:09:08.643 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:08.643 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:08.643 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73080762d0 msgr2=0x7f73080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73080762d0 0x7f73080787e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7314034000 tx=0x7f731402e000 comp rx=0 tx=0).stop 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 msgr2=0x7f73280af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 0x7f73280af4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f731800c3f0 tx=0x7f731800c8b0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 shutdown_connections 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73080762d0 0x7f73080787e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f732815bb60 0x7f7328158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73280c53b0 0x7f7328150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 --2- 172.21.15.114:0/3499774809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280c4070 0x7f73280af4a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 >> 172.21.15.114:0/3499774809 conn(0x7f73280ac3b0 msgr2=0x7f73280ab2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 shutdown_connections 2024-05-09T00:09:08.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:08.649+0000 7f732dc00640 1 -- 172.21.15.114:0/3499774809 wait complete. 2024-05-09T00:09:09.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T00:08:44.610847+0000', 'modified': '2024-05-09T00:08:48.668491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6836/1498992114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 1498992114}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 1498992114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4267, 'qdb_cluster': [4267]} 2024-05-09T00:09:09.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T00:09:09.074 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-09T00:09:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.341+0000 7f895b200640 1 Processor -- start 2024-05-09T00:09:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.341+0000 7f895b200640 1 -- start start 2024-05-09T00:09:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895b200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f895c0cb430 0x7f895c0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895c15b7f0 con 0x7f895c158b10 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895b200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f895c15c5b0 con 0x7f895c0cb430 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f895c15bad0 con 0x7f895c0c8760 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f895c0cb430 0x7f895c0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f895c0cb430 0x7f895c0cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58450/0 (socket says 172.21.15.114:58450) 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f895a800640 1 -- 172.21.15.114:0/276079279 learned_addr learned my addr 172.21.15.114:0/276079279 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f8951400640 1 --1- 172.21.15.114:0/276079279 >> v1:172.21.15.114:6789/0 conn(0x7f895c158b10 0x7f895c0af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40048/0 (socket says 172.21.15.114:40048) 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.343+0000 7f8959e00640 1 --2- 172.21.15.114:0/276079279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.344+0000 7f895a800640 1 -- 172.21.15.114:0/276079279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 msgr2=0x7f895c155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.344+0000 7f895a800640 1 --2- 172.21.15.114:0/276079279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.344+0000 7f895a800640 1 -- 172.21.15.114:0/276079279 >> v1:172.21.15.114:6789/0 conn(0x7f895c158b10 legacy=0x7f895c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.344+0000 7f8959400640 1 -- 172.21.15.114:0/276079279 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764446860 0 0) 0x7f895c15b7f0 con 0x7f895c158b10 2024-05-09T00:09:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.344+0000 7f895a800640 1 -- 172.21.15.114:0/276079279 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c15bdb0 con 0x7f895c0cb430 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.345+0000 7f895a800640 1 --2- 172.21.15.114:0/276079279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0cb840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8954009e50 tx=0x7f895402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e847b142d472051e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.345+0000 7f8959400640 1 -- 172.21.15.114:0/276079279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954036070 con 0x7f895c0cb430 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.345+0000 7f8959400640 1 -- 172.21.15.114:0/276079279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8954031600 con 0x7f895c0cb430 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.345+0000 7f8959400640 1 -- 172.21.15.114:0/276079279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89540319d0 con 0x7f895c0cb430 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.345+0000 7f895b200640 1 -- 172.21.15.114:0/276079279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 msgr2=0x7f895c0cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.345+0000 7f895b200640 1 --2- 172.21.15.114:0/276079279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0cb840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8954009e50 tx=0x7f895402a730 comp rx=0 tx=0).stop 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.346+0000 7f895b200640 1 -- 172.21.15.114:0/276079279 shutdown_connections 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.346+0000 7f895b200640 1 --2- 172.21.15.114:0/276079279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0cb840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.346+0000 7f895b200640 1 --2- 172.21.15.114:0/276079279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.346+0000 7f895b200640 1 -- 172.21.15.114:0/276079279 >> 172.21.15.114:0/276079279 conn(0x7f895c068ef0 msgr2=0x7f895c0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.346+0000 7f895b200640 1 -- 172.21.15.114:0/276079279 shutdown_connections 2024-05-09T00:09:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.346+0000 7f895b200640 1 -- 172.21.15.114:0/276079279 wait complete. 2024-05-09T00:09:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.348+0000 7f895b200640 1 Processor -- start 2024-05-09T00:09:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.348+0000 7f895b200640 1 -- start start 2024-05-09T00:09:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f895b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c1e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f895b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f895b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f895c158b10 0x7f895c1ee8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f895b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f895c0af740 con 0x7f895c0cb430 2024-05-09T00:09:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f895b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f895c155c80 con 0x7f895c158b10 2024-05-09T00:09:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f895b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f895c0af8c0 con 0x7f895c0c8760 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f8951400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f8951400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58454/0 (socket says 172.21.15.114:58454) 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.349+0000 7f8951400640 1 -- 172.21.15.114:0/688981868 learned_addr learned my addr 172.21.15.114:0/688981868 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8951400640 1 -- 172.21.15.114:0/688981868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 msgr2=0x7f895c1e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8951400640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c1e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8951400640 1 -- 172.21.15.114:0/688981868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f895c158b10 msgr2=0x7f895c1ee8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8951400640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f895c158b10 0x7f895c1ee8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8951400640 1 -- 172.21.15.114:0/688981868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c1e22d0 con 0x7f895c0cb430 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8951400640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0ae5d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f895c0c0ec0 tx=0x7f894400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8952a00640 1 -- 172.21.15.114:0/688981868 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89440074e0 con 0x7f895c0cb430 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8952a00640 1 -- 172.21.15.114:0/688981868 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89440047e0 con 0x7f895c0cb430 2024-05-09T00:09:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895c1e25b0 con 0x7f895c0cb430 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f8952a00640 1 -- 172.21.15.114:0/688981868 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944004bb0 con 0x7f895c0cb430 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.350+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895c0c45c0 con 0x7f895c0cb430 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.353+0000 7f8952a00640 1 -- 172.21.15.114:0/688981868 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8944011070 con 0x7f895c0cb430 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.354+0000 7f8952a00640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f89380762d0 0x7f89380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.354+0000 7f8952a00640 1 -- 172.21.15.114:0/688981868 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f8944097400 con 0x7f895c0cb430 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.355+0000 7f8959e00640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f89380762d0 0x7f89380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.355+0000 7f8967c47740 1 Processor -- start 2024-05-09T00:09:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.355+0000 7f8967c47740 1 -- start start 2024-05-09T00:09:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.355+0000 7f8959e00640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f89380762d0 0x7f89380787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f894c006fd0 tx=0x7f894c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8967c47740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e829bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8967c47740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b2e8203410 con 0x55b2e7efb270 2024-05-09T00:09:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2e819fac0 con 0x55b2e7ed23b0 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b2e81ff3d0 con 0x55b2e7eda590 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8959e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e829bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8959e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e829bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58462/0 (socket says 172.21.15.114:58462) 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.356+0000 7f8959e00640 1 -- 172.21.15.114:0/2525738331 learned_addr learned my addr 172.21.15.114:0/2525738331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f8959e00640 1 -- 172.21.15.114:0/2525738331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 msgr2=0x55b2e82db210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f8959e00640 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f8959e00640 1 -- 172.21.15.114:0/2525738331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 msgr2=0x55b2e82bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f8959e00640 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f8959e00640 1 -- 172.21.15.114:0/2525738331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e7f66850 con 0x55b2e7efb270 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f8959e00640 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e829bbe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f894c00d940 tx=0x7f894c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f715d69319210f13 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f894a600640 1 -- 172.21.15.114:0/2525738331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c024070 con 0x55b2e7efb270 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f894a600640 1 -- 172.21.15.114:0/2525738331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c01b040 con 0x55b2e7efb270 2024-05-09T00:09:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.357+0000 7f894a600640 1 -- 172.21.15.114:0/2525738331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c014bd0 con 0x55b2e7efb270 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 -- 172.21.15.114:0/2525738331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 msgr2=0x55b2e829bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e829bbe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f894c00d940 tx=0x7f894c010000 comp rx=0 tx=0).stop 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 -- 172.21.15.114:0/2525738331 shutdown_connections 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 --2- 172.21.15.114:0/2525738331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e829bbe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 -- 172.21.15.114:0/2525738331 >> 172.21.15.114:0/2525738331 conn(0x55b2e7eef3c0 msgr2=0x55b2e829da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 -- 172.21.15.114:0/2525738331 shutdown_connections 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.358+0000 7f8967c47740 1 -- 172.21.15.114:0/2525738331 wait complete. 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.359+0000 7f8967c47740 1 -- start start 2024-05-09T00:09:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.359+0000 7f8967c47740 1 Processor -- start 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7efb270 0x55b2e82bb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b2e82dea70 con 0x55b2e7ed23b0 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2e818a5e0 con 0x55b2e7efb270 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b2e82dc0d0 con 0x55b2e7eda590 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8967c47740 10 client.0 _ll_register_callbacks cb 0x55b2e7f12ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58478/0 (socket says 172.21.15.114:58478) 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 -- 172.21.15.114:0/2236648567 learned_addr learned my addr 172.21.15.114:0/2236648567 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8951400640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 -- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 msgr2=0x55b2e82db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f895a800640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7efb270 0x55b2e82bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 -- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7efb270 msgr2=0x55b2e82bb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7efb270 0x55b2e82bb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.361+0000 7f8959e00640 1 -- 172.21.15.114:0/2236648567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e7fdd6b0 con 0x55b2e7ed23b0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f8959e00640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bf910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f894c017040 tx=0x7f894c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7a86689835b6f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f893ea00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f893ea00640 1 -- 172.21.15.114:0/2236648567 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c024040 con 0x55b2e7ed23b0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f893ea00640 1 -- 172.21.15.114:0/2236648567 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f894c02a730 con 0x55b2e7ed23b0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f894c01b040 con 0x55b2e7ed23b0 2024-05-09T00:09:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f893ea00640 1 -- 172.21.15.114:0/2236648567 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f894c038050 con 0x55b2e7ed23b0 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f8967c47740 10 client.4596 fetch_fsmap learned FSMap version 15 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55b2e82dbe10 con 0x55b2e7ed23b0 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.362+0000 7f893ea00640 1 -- 172.21.15.114:0/2236648567 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c01b040 con 0x55b2e7ed23b0 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f893ea00640 1 -- 172.21.15.114:0/2236648567 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7f894c03b020 con 0x55b2e7ed23b0 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8967c47740 10 client.4596 fetch_fsmap finished waiting for FSMap version 15 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8967c47740 10 client.4596 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8967c47740 20 client.4596 populate_metadata read hostname 'smithi114' 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8967c47740 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e7eb9e40 0x55b2e82efc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8967c47740 4 client.4596 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 --> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2e8211020 con 0x55b2e7eb9e40 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8951400640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e7eb9e40 0x55b2e82efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f8951400640 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e7eb9e40 0x55b2e82efc80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6d12b2061c86e server_cookie=52e4edbc1bd547f8 in_seq=0 out_seq=0 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.363+0000 7f893ea00640 10 client.4596 ms_handle_connect on v2:172.21.15.114:6834/1498992114 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.364+0000 7f893ea00640 1 -- 172.21.15.114:0/2236648567 <== mds.0 v2:172.21.15.114:6834/1498992114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b2e8211020 con 0x55b2e7eb9e40 2024-05-09T00:09:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.364+0000 7f893ea00640 10 client.4596 handle_command_reply: tid=0 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.364+0000 7f8967c47740 1 client.4596 shutdown 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 msgr2=0x55b2e82bf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bf910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f894c017040 tx=0x7f894c015000 comp rx=0 tx=0).stop 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 shutdown_connections 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e7eb9e40 0x55b2e82efc80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7efb270 0x55b2e82bb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7eda590 0x55b2e82db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f893ea00640 0 client.4596 ms_handle_reset on v2:172.21.15.114:6834/1498992114 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 --2- 172.21.15.114:0/2236648567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7ed23b0 0x55b2e82bf910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 >> 172.21.15.114:0/2236648567 conn(0x55b2e7eef3c0 msgr2=0x55b2e829b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 shutdown_connections 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 1 -- 172.21.15.114:0/2236648567 wait complete. 2024-05-09T00:09:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.365+0000 7f8967c47740 20 client.4596 trim_cache size 0 max 16384 2024-05-09T00:09:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.385+0000 7f8967c47740 1 Processor -- start 2024-05-09T00:09:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.385+0000 7f8967c47740 1 -- start start 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.386+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 0x55b2e82a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8967c47740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 0x55b2e82da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7efb270 0x55b2e82d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8967c47740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1fdc60 con 0x55b2e7eda590 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1fb7d0 con 0x55b2e7ed23b0 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f895c1fbd20 con 0x55b2e7efb270 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 0x55b2e82da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 0x55b2e82da460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58486/0 (socket says 172.21.15.114:58486) 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 -- 172.21.15.114:0/1179056884 learned_addr learned my addr 172.21.15.114:0/1179056884 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 -- 172.21.15.114:0/1179056884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7efb270 msgr2=0x55b2e82d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7efb270 0x55b2e82d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 -- 172.21.15.114:0/1179056884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 msgr2=0x55b2e82a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 0x55b2e82a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 -- 172.21.15.114:0/1179056884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e82daca0 con 0x55b2e7eda590 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.387+0000 7f8951400640 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 0x55b2e82da460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f894405c3a0 tx=0x7f8944009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3e3fdc9aafac34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8949c00640 1 -- 172.21.15.114:0/1179056884 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89440690f0 con 0x55b2e7eda590 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8949c00640 1 -- 172.21.15.114:0/1179056884 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8944001060 con 0x55b2e7eda590 2024-05-09T00:09:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8949c00640 1 -- 172.21.15.114:0/1179056884 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89440970c0 con 0x55b2e7eda590 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 -- 172.21.15.114:0/1179056884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 msgr2=0x55b2e82da460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 0x55b2e82da460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f894405c3a0 tx=0x7f8944009040 comp rx=0 tx=0).stop 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 -- 172.21.15.114:0/1179056884 shutdown_connections 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7efb270 0x55b2e82d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7eda590 0x55b2e82da460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 --2- 172.21.15.114:0/1179056884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7ed23b0 0x55b2e82a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.388+0000 7f8967c47740 1 -- 172.21.15.114:0/1179056884 >> 172.21.15.114:0/1179056884 conn(0x55b2e7eef3c0 msgr2=0x55b2e82bf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.389+0000 7f8967c47740 1 -- 172.21.15.114:0/1179056884 shutdown_connections 2024-05-09T00:09:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.389+0000 7f8967c47740 1 -- 172.21.15.114:0/1179056884 wait complete. 2024-05-09T00:09:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.389+0000 7f8967c47740 1 -- start start 2024-05-09T00:09:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.390+0000 7f8967c47740 1 Processor -- start 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7ed23b0 0x55b2e8299a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7eda590 0x55b2e8361dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e835f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b2e82dba80 con 0x55b2e7efb270 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2e82bed60 con 0x55b2e7eda590 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b2e82ef6f0 con 0x55b2e7ed23b0 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f8967c47740 10 client.0 _ll_register_callbacks cb 0x7f894c022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f895a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e835f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f895a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e835f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58490/0 (socket says 172.21.15.114:58490) 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.391+0000 7f895a800640 1 -- 172.21.15.114:0/306268553 learned_addr learned my addr 172.21.15.114:0/306268553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f8959e00640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7ed23b0 0x55b2e8299a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f8951400640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7eda590 0x55b2e8361dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f895a800640 1 -- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7ed23b0 msgr2=0x55b2e8299a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f895a800640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7ed23b0 0x55b2e8299a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f895a800640 1 -- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7eda590 msgr2=0x55b2e8361dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f895a800640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7eda590 0x55b2e8361dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f895a800640 1 -- 172.21.15.114:0/306268553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e829aaf0 con 0x55b2e7efb270 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f8951400640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7eda590 0x55b2e8361dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f895a800640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e835f050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8954009f70 tx=0x7f8954007080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df753aeb950d41ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f893ea00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f893ea00640 1 -- 172.21.15.114:0/306268553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954040020 con 0x55b2e7efb270 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f893ea00640 1 -- 172.21.15.114:0/306268553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f8954004040 con 0x55b2e7efb270 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.392+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8944001060 con 0x55b2e7efb270 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f893ea00640 1 -- 172.21.15.114:0/306268553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f895404a050 con 0x55b2e7efb270 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 10 client.4602 fetch_fsmap learned FSMap version 15 2024-05-09T00:09:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55b2e8362310 con 0x55b2e7efb270 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f893ea00640 1 -- 172.21.15.114:0/306268553 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8944001060 con 0x55b2e7efb270 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f893ea00640 1 -- 172.21.15.114:0/306268553 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7f895404d020 con 0x55b2e7efb270 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 10 client.4602 fetch_fsmap finished waiting for FSMap version 15 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 10 client.4602 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 20 client.4602 populate_metadata read hostname 'smithi114' 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e8365620 0x55b2e8365a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 4 client.4602 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 --> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] -- command(tid 0: {"prefix": "status"}) -- 0x55b2e82bd140 con 0x55b2e8365620 2024-05-09T00:09:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.393+0000 7f8959e00640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e8365620 0x55b2e8365a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8959e00640 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e8365620 0x55b2e8365a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6c449cf469e2e server_cookie=453dd396a7267aa0 in_seq=0 out_seq=0 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f893ea00640 10 client.4602 ms_handle_connect on v2:172.21.15.114:6834/1498992114 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f893ea00640 1 -- 172.21.15.114:0/306268553 <== mds.0 v2:172.21.15.114:6834/1498992114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55b2e82bd140 con 0x55b2e8365620 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f893ea00640 10 client.4602 handle_command_reply: tid=0 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 client.4602 shutdown 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 msgr2=0x55b2e835f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e835f050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8954009f70 tx=0x7f8954007080 comp rx=0 tx=0).stop 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 shutdown_connections 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e7efb270 0x55b2e835f050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.114:6834/1498992114,v1:172.21.15.114:6836/1498992114] conn(0x55b2e8365620 0x55b2e8365a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2e7eda590 0x55b2e8361dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f893ea00640 0 client.4602 ms_handle_reset on v2:172.21.15.114:6834/1498992114 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 --2- 172.21.15.114:0/306268553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b2e7ed23b0 0x55b2e8299a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 >> 172.21.15.114:0/306268553 conn(0x55b2e7eef3c0 msgr2=0x55b2e82bd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 shutdown_connections 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.394+0000 7f8967c47740 1 -- 172.21.15.114:0/306268553 wait complete. 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f8967c47740 20 client.4602 trim_cache size 0 max 16384 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae", 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-05-09T00:09:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4267, 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "a", 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 24.31001213, 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 9, 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 26, 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 22, 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 31.092042236000001 2024-05-09T00:09:09.396 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f89380762d0 msgr2=0x7f89380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f89380762d0 0x7f89380787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f894c006fd0 tx=0x7f894c008040 comp rx=0 tx=0).stop 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 msgr2=0x7f895c0ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0ae5d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f895c0c0ec0 tx=0x7f894400c820 comp rx=0 tx=0).stop 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 shutdown_connections 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f89380762d0 0x7f89380787e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f895c158b10 0x7f895c1ee8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895c0cb430 0x7f895c0ae5d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 --2- 172.21.15.114:0/688981868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f895c0c8760 0x7f895c1e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 >> 172.21.15.114:0/688981868 conn(0x7f895c068ef0 msgr2=0x7f895c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 shutdown_connections 2024-05-09T00:09:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.395+0000 7f895b200640 1 -- 172.21.15.114:0/688981868 wait complete. 2024-05-09T00:09:09.415 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:09.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.678+0000 7f1c8c400640 1 Processor -- start 2024-05-09T00:09:09.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.679+0000 7f1c8c400640 1 -- start start 2024-05-09T00:09:09.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.681+0000 7f1c8c400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c8413f420 0x7f1c8406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.681+0000 7f1c8c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 0x7f1c840abc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.681+0000 7f1c8c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c840c08f0 con 0x7f1c84159610 2024-05-09T00:09:09.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.681+0000 7f1c8c400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1c840c0bd0 con 0x7f1c8413f420 2024-05-09T00:09:09.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.681+0000 7f1c8c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c840c0eb0 con 0x7f1c8406cbc0 2024-05-09T00:09:09.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c8a400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c84159610 0x7f1c840ac180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40052/0 (socket says 172.21.15.114:40052) 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c8a400640 1 -- 172.21.15.114:0/505576791 learned_addr learned my addr 172.21.15.114:0/505576791 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c89a00640 1 --2- 172.21.15.114:0/505576791 >> v2:172.21.15.153:3300/0 conn(0x7f1c8413f420 0x7f1c8406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c89000640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 0x7f1c840abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340875616 0 0) 0x7f1c840c08f0 con 0x7f1c84159610 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c6c003520 con 0x7f1c84159610 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356406246 0 0) 0x7f1c6c003520 con 0x7f1c84159610 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 msgr2=0x7f1c840abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 0x7f1c840abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 >> v2:172.21.15.153:3300/0 conn(0x7f1c8413f420 msgr2=0x7f1c8406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 --2- 172.21.15.114:0/505576791 >> v2:172.21.15.153:3300/0 conn(0x7f1c8413f420 0x7f1c8406c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.682+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c840c1190 con 0x7f1c84159610 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f1c7c0016f0 con 0x7f1c84159610 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 >> v1:172.21.15.114:6789/0 conn(0x7f1c84159610 legacy=0x7f1c840ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c003a00 0x7f1c6c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c004800 0x7f1c6c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 0x7f1c6c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840c0bd0 con 0x7f1c6c004800 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840c0eb0 con 0x7f1c6c003a00 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6c00ba70 con 0x7f1c8406cbc0 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89000640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c004800 0x7f1c6c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89000640 1 -- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 msgr2=0x7f1c6c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89a00640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c003a00 0x7f1c6c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89000640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8406cbc0 0x7f1c6c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89000640 1 -- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c003a00 msgr2=0x7f1c6c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89000640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c003a00 0x7f1c6c003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.683+0000 7f1c89000640 1 -- 172.21.15.114:0/505576791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c003520 con 0x7f1c6c004800 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.684+0000 7f1c89000640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c004800 0x7f1c6c004c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ac0 tx=0x7f1c6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5544abdd49cd6497 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70036070 con 0x7f1c6c004800 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70031400 con 0x7f1c6c004800 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c83e00640 1 -- 172.21.15.114:0/505576791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70009690 con 0x7f1c6c004800 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c8c400640 1 -- 172.21.15.114:0/505576791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c004800 msgr2=0x7f1c6c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c8c400640 1 --2- 172.21.15.114:0/505576791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c004800 0x7f1c6c004c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ac0 tx=0x7f1c6c005830 comp rx=0 tx=0).stop 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c8a400640 1 -- 172.21.15.114:0/505576791 reap_dead start 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c8c400640 1 -- 172.21.15.114:0/505576791 shutdown_connections 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c8c400640 1 -- 172.21.15.114:0/505576791 >> 172.21.15.114:0/505576791 conn(0x7f1c840c7170 msgr2=0x7f1c840c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.685+0000 7f1c8c400640 1 -- 172.21.15.114:0/505576791 shutdown_connections 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.686+0000 7f1c8c400640 1 -- 172.21.15.114:0/505576791 wait complete. 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.688+0000 7f1c8c400640 1 Processor -- start 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.688+0000 7f1c8c400640 1 -- start start 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.689+0000 7f1c8c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6c004800 0x7f1c84070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.689+0000 7f1c8c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 0x7f1c840c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.689+0000 7f1c8c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c84153f10 0x7f1c84153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.689+0000 7f1c8c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840ac890 con 0x7f1c840c1e20 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.689+0000 7f1c8c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8406d4f0 con 0x7f1c84153f10 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.689+0000 7f1c8c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c840c7c90 con 0x7f1c6c004800 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 0x7f1c840c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 0x7f1c840c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58496/0 (socket says 172.21.15.114:58496) 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 -- 172.21.15.114:0/3225161289 learned_addr learned my addr 172.21.15.114:0/3225161289 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c8a400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c84153f10 0x7f1c84153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89a00640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6c004800 0x7f1c84070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 -- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6c004800 msgr2=0x7f1c84070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6c004800 0x7f1c84070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 -- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c84153f10 msgr2=0x7f1c84153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c84153f10 0x7f1c84153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89000640 1 -- 172.21.15.114:0/3225161289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c840c29a0 con 0x7f1c840c1e20 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.690+0000 7f1c89a00640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6c004800 0x7f1c84070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.691+0000 7f1c89000640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 0x7f1c840c3440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009be0 tx=0x7f1c70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.691+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70040020 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.691+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c700038d0 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.691+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70036040 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.691+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c841f2510 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.691+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8413a240 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.692+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8415a0b0 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.693+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c70043020 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.694+0000 7f1c81600640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1c640762d0 0x7f1c640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.694+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f1c700b7b80 con 0x7f1c840c1e20 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.695+0000 7f1c89a00640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1c640762d0 0x7f1c640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.695+0000 7f1c89a00640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1c640762d0 0x7f1c640787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c84072630 tx=0x7f1c7800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.699+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c8415a0b0 con 0x7f1c840c1e20 2024-05-09T00:09:09.909 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:09:09.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:09:09.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.948+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c840ad4a0 con 0x7f1c840c1e20 2024-05-09T00:09:09.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.949+0000 7f1c81600640 1 -- 172.21.15.114:0/3225161289 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f1c840ad4a0 con 0x7f1c840c1e20 2024-05-09T00:09:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:09.946 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:09.947 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1c640762d0 msgr2=0x7f1c640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1c640762d0 0x7f1c640787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c84072630 tx=0x7f1c7800b040 comp rx=0 tx=0).stop 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 msgr2=0x7f1c840c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 0x7f1c840c3440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009be0 tx=0x7f1c70004730 comp rx=0 tx=0).stop 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 shutdown_connections 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1c640762d0 0x7f1c640787e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c84153f10 0x7f1c84153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c840c1e20 0x7f1c840c3440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 --2- 172.21.15.114:0/3225161289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6c004800 0x7f1c84070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:09.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 >> 172.21.15.114:0/3225161289 conn(0x7f1c840c7170 msgr2=0x7f1c840c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:09.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.952+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 shutdown_connections 2024-05-09T00:09:09.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:09.953+0000 7f1c8c400640 1 -- 172.21.15.114:0/3225161289 wait complete. 2024-05-09T00:09:09.976 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:10.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.339+0000 7f5c57e00640 1 Processor -- start 2024-05-09T00:09:10.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.340+0000 7f5c57e00640 1 -- start start 2024-05-09T00:09:10.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c57e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c57e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c581566f0 0x7f5c580ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c57e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c580ad340 con 0x7f5c58156b00 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c57e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5c58156260 con 0x7f5c581566f0 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c57e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c58155f10 con 0x7f5c580aba00 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c581566f0 0x7f5c580ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c581566f0 0x7f5c580ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58512/0 (socket says 172.21.15.114:58512) 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 -- 172.21.15.114:0/1228239739 learned_addr learned my addr 172.21.15.114:0/1228239739 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56a00640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 -- 172.21.15.114:0/1228239739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 msgr2=0x7f5c580accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 -- 172.21.15.114:0/1228239739 >> v1:172.21.15.114:6789/0 conn(0x7f5c58156b00 legacy=0x7f5c580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56000640 1 -- 172.21.15.114:0/1228239739 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c580c4f40 con 0x7f5c581566f0 2024-05-09T00:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.342+0000 7f5c56a00640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.343+0000 7f5c56000640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c580ae820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009870 tx=0x7f5c4402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e47d0e9e0c351e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.344+0000 7f5c55600640 1 -- 172.21.15.114:0/1228239739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44037070 con 0x7f5c581566f0 2024-05-09T00:09:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.344+0000 7f5c55600640 1 -- 172.21.15.114:0/1228239739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c44032440 con 0x7f5c581566f0 2024-05-09T00:09:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.344+0000 7f5c55600640 1 -- 172.21.15.114:0/1228239739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44032810 con 0x7f5c581566f0 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.344+0000 7f5c57e00640 1 -- 172.21.15.114:0/1228239739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 msgr2=0x7f5c580ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.344+0000 7f5c57e00640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c580ae820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009870 tx=0x7f5c4402a250 comp rx=0 tx=0).stop 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.345+0000 7f5c57e00640 1 -- 172.21.15.114:0/1228239739 shutdown_connections 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.345+0000 7f5c57e00640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c580ae820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.345+0000 7f5c57e00640 1 --2- 172.21.15.114:0/1228239739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.345+0000 7f5c57e00640 1 -- 172.21.15.114:0/1228239739 >> 172.21.15.114:0/1228239739 conn(0x7f5c580c9730 msgr2=0x7f5c580c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.345+0000 7f5c57e00640 1 -- 172.21.15.114:0/1228239739 shutdown_connections 2024-05-09T00:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.345+0000 7f5c57e00640 1 -- 172.21.15.114:0/1228239739 wait complete. 2024-05-09T00:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.347+0000 7f5c57e00640 1 Processor -- start 2024-05-09T00:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.347+0000 7f5c57e00640 1 -- start start 2024-05-09T00:09:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.348+0000 7f5c57e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.348+0000 7f5c57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c58134b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.348+0000 7f5c57e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c58156b00 0x7f5c58152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.348+0000 7f5c57e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5c580af470 con 0x7f5c581566f0 2024-05-09T00:09:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.348+0000 7f5c57e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c580c4920 con 0x7f5c58156b00 2024-05-09T00:09:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.348+0000 7f5c57e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5813e830 con 0x7f5c580aba00 2024-05-09T00:09:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c58134b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c58134b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58524/0 (socket says 172.21.15.114:58524) 2024-05-09T00:09:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 -- 172.21.15.114:0/2595508601 learned_addr learned my addr 172.21.15.114:0/2595508601 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 -- 172.21.15.114:0/2595508601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 msgr2=0x7f5c580c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 -- 172.21.15.114:0/2595508601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c58156b00 msgr2=0x7f5c58152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c58156b00 0x7f5c58152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 -- 172.21.15.114:0/2595508601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c581535b0 con 0x7f5c581566f0 2024-05-09T00:09:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.349+0000 7f5c56000640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c58134b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000c00 tx=0x7f5c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.350+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44037040 con 0x7f5c581566f0 2024-05-09T00:09:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.350+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c44042070 con 0x7f5c581566f0 2024-05-09T00:09:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.350+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c58133c10 con 0x7f5c581566f0 2024-05-09T00:09:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.350+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44030bd0 con 0x7f5c581566f0 2024-05-09T00:09:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.350+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c581f2490 con 0x7f5c581566f0 2024-05-09T00:09:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.351+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c58153320 con 0x7f5c581566f0 2024-05-09T00:09:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.352+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c44047460 con 0x7f5c581566f0 2024-05-09T00:09:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.353+0000 7f5c4ea00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5c38076300 0x7f5c38078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.353+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f5c440b8650 con 0x7f5c581566f0 2024-05-09T00:09:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.353+0000 7f5c56a00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5c38076300 0x7f5c38078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.354+0000 7f5c56a00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5c38076300 0x7f5c38078810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c48006fd0 tx=0x7f5c48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.358+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c44081500 con 0x7f5c581566f0 2024-05-09T00:09:10.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.571+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c58154980 con 0x7f5c581566f0 2024-05-09T00:09:10.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.574+0000 7f5c4ea00640 1 -- 172.21.15.114:0/2595508601 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7f5c58154980 con 0x7f5c581566f0 2024-05-09T00:09:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:10.572 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5c38076300 msgr2=0x7f5c38078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5c38076300 0x7f5c38078810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c48006fd0 tx=0x7f5c48008040 comp rx=0 tx=0).stop 2024-05-09T00:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 msgr2=0x7f5c58134b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c58134b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000c00 tx=0x7f5c440046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 shutdown_connections 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5c38076300 0x7f5c38078810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c58156b00 0x7f5c58152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c581566f0 0x7f5c58134b40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 --2- 172.21.15.114:0/2595508601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c580aba00 0x7f5c580c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.577+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 >> 172.21.15.114:0/2595508601 conn(0x7f5c580c9730 msgr2=0x7f5c580ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.578+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 shutdown_connections 2024-05-09T00:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.578+0000 7f5c57e00640 1 -- 172.21.15.114:0/2595508601 wait complete. 2024-05-09T00:09:10.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:10.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.873+0000 7f5f15400640 1 Processor -- start 2024-05-09T00:09:10.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.873+0000 7f5f15400640 1 -- start start 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f15400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f1015a030 0x7f5f100c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f15400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f100c4ab0 0x7f5f100c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f15400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f10156440 con 0x7f5f10153340 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f15400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5f10157050 con 0x7f5f1015a030 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f15400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5f10156720 con 0x7f5f100c4ab0 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f0e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f1015a030 0x7f5f100c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f0e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f1015a030 0x7f5f100c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58540/0 (socket says 172.21.15.114:58540) 2024-05-09T00:09:10.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.875+0000 7f5f0e800640 1 -- 172.21.15.114:0/4119899680 learned_addr learned my addr 172.21.15.114:0/4119899680 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.876+0000 7f5f0e800640 1 -- 172.21.15.114:0/4119899680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f100c4ab0 msgr2=0x7f5f100c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.876+0000 7f5f0f200640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f100c4ab0 0x7f5f100c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.876+0000 7f5f0e800640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f100c4ab0 0x7f5f100c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.876+0000 7f5f0e800640 1 -- 172.21.15.114:0/4119899680 >> v1:172.21.15.153:6789/0 conn(0x7f5f10153340 legacy=0x7f5f10153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.876+0000 7f5f0e800640 1 -- 172.21.15.114:0/4119899680 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f10156a00 con 0x7f5f1015a030 2024-05-09T00:09:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.876+0000 7f5f0f200640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f100c4ab0 0x7f5f100c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.877+0000 7f5f0e800640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f100c69b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009870 tx=0x7f5f0002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd758c61ead389db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.877+0000 7f5f0d400640 1 -- 172.21.15.114:0/4119899680 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00037070 con 0x7f5f1015a030 2024-05-09T00:09:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.877+0000 7f5f0d400640 1 -- 172.21.15.114:0/4119899680 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f00032440 con 0x7f5f1015a030 2024-05-09T00:09:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.877+0000 7f5f0d400640 1 -- 172.21.15.114:0/4119899680 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00032810 con 0x7f5f1015a030 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 -- 172.21.15.114:0/4119899680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 msgr2=0x7f5f100c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f100c69b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009870 tx=0x7f5f0002a130 comp rx=0 tx=0).stop 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 -- 172.21.15.114:0/4119899680 shutdown_connections 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f100c4ab0 0x7f5f100c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 --2- 172.21.15.114:0/4119899680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f100c69b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 -- 172.21.15.114:0/4119899680 >> 172.21.15.114:0/4119899680 conn(0x7f5f100c9d40 msgr2=0x7f5f100ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 -- 172.21.15.114:0/4119899680 shutdown_connections 2024-05-09T00:09:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.878+0000 7f5f15400640 1 -- 172.21.15.114:0/4119899680 wait complete. 2024-05-09T00:09:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.881+0000 7f5f15400640 1 Processor -- start 2024-05-09T00:09:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.881+0000 7f5f15400640 1 -- start start 2024-05-09T00:09:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f15400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f100c4ab0 0x7f5f101580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f15400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f10153340 0x7f5f10073790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f15400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f101e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f15400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5f100c6ef0 con 0x7f5f1015a030 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f15400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5f100a9590 con 0x7f5f100c4ab0 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f15400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1015a440 con 0x7f5f10153340 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f0f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f101e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f0f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f101e20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58550/0 (socket says 172.21.15.114:58550) 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.882+0000 7f5f0f200640 1 -- 172.21.15.114:0/3926409799 learned_addr learned my addr 172.21.15.114:0/3926409799 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0e800640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f100c4ab0 0x7f5f101580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0de00640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f10153340 0x7f5f10073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0f200640 1 -- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f10153340 msgr2=0x7f5f10073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0f200640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f10153340 0x7f5f10073790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0f200640 1 -- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f100c4ab0 msgr2=0x7f5f101580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0f200640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f100c4ab0 0x7f5f101580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0f200640 1 -- 172.21.15.114:0/3926409799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f101e2ed0 con 0x7f5f1015a030 2024-05-09T00:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f0f200640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f101e20c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800c5c0 tx=0x7f5f0800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f08015070 con 0x7f5f1015a030 2024-05-09T00:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.883+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f08011820 con 0x7f5f1015a030 2024-05-09T00:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.884+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f101e31b0 con 0x7f5f1015a030 2024-05-09T00:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.884+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f08011c10 con 0x7f5f1015a030 2024-05-09T00:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.884+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f100c3cd0 con 0x7f5f1015a030 2024-05-09T00:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.885+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f10077430 con 0x7f5f1015a030 2024-05-09T00:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.886+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f08018070 con 0x7f5f1015a030 2024-05-09T00:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.887+0000 7f5f06a00640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5eec076300 0x7f5eec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.887+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f5f08097810 con 0x7f5f1015a030 2024-05-09T00:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.887+0000 7f5f0e800640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5eec076300 0x7f5eec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.888+0000 7f5f0e800640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5eec076300 0x7f5eec078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f00034000 tx=0x7f5f0002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:10.892+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5f08060db0 con 0x7f5f1015a030 2024-05-09T00:09:11.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.140+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f100c5b20 con 0x7f5f1015a030 2024-05-09T00:09:11.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.141+0000 7f5f06a00640 1 -- 172.21.15.114:0/3926409799 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f5f080606b0 con 0x7f5f1015a030 2024-05-09T00:09:11.138 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:11.138 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:11.138 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5eec076300 msgr2=0x7f5eec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5eec076300 0x7f5eec078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f00034000 tx=0x7f5f0002e000 comp rx=0 tx=0).stop 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 msgr2=0x7f5f101e20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f101e20c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800c5c0 tx=0x7f5f0800ca80 comp rx=0 tx=0).stop 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 shutdown_connections 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5eec076300 0x7f5eec078810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f1015a030 0x7f5f101e20c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f10153340 0x7f5f10073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 --2- 172.21.15.114:0/3926409799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f100c4ab0 0x7f5f101580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 >> 172.21.15.114:0/3926409799 conn(0x7f5f100c9d40 msgr2=0x7f5f10155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:11.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 shutdown_connections 2024-05-09T00:09:11.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.144+0000 7f5f15400640 1 -- 172.21.15.114:0/3926409799 wait complete. 2024-05-09T00:09:11.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T00:08:54.746296+0000', 'modified': '2024-05-09T00:08:58.825219+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4238}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4238': {'gid': 4238, 'name': 'd', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.153:6835/3829412957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3829412957}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3829412957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4238, 'qdb_cluster': [4238]} 2024-05-09T00:09:11.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T00:09:11.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-09T00:09:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.852+0000 7f37e9400640 1 Processor -- start 2024-05-09T00:09:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.852+0000 7f37e9400640 1 -- start start 2024-05-09T00:09:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.854+0000 7f37e9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e413f360 0x7f37e406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.854+0000 7f37e9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37e40af270 0x7f37e40acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.854+0000 7f37e9400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e406f490 con 0x7f37e41567d0 2024-05-09T00:09:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.854+0000 7f37e9400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f37e40ad260 con 0x7f37e40af270 2024-05-09T00:09:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.854+0000 7f37e9400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f37e406f920 con 0x7f37e413f360 2024-05-09T00:09:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.855+0000 7f37e8a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f37e41567d0 0x7f37e40c4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40076/0 (socket says 172.21.15.114:40076) 2024-05-09T00:09:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.855+0000 7f37e8a00640 1 -- 172.21.15.114:0/3046586317 learned_addr learned my addr 172.21.15.114:0/3046586317 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.855+0000 7f37e3400640 1 --2- 172.21.15.114:0/3046586317 >> v2:172.21.15.153:3300/0 conn(0x7f37e40af270 0x7f37e40acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.855+0000 7f37e3e00640 1 --2- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e413f360 0x7f37e406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.855+0000 7f37e2a00640 1 -- 172.21.15.114:0/3046586317 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116509501 0 0) 0x7f37e406f490 con 0x7f37e41567d0 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.855+0000 7f37e2a00640 1 -- 172.21.15.114:0/3046586317 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c8003520 con 0x7f37e41567d0 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.856+0000 7f37e2a00640 1 -- 172.21.15.114:0/3046586317 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3809097041 0 0) 0x7f37c8003520 con 0x7f37e41567d0 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.856+0000 7f37e3400640 1 -- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e413f360 msgr2=0x7f37e406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.856+0000 7f37e3400640 1 --2- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e413f360 0x7f37e406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.856+0000 7f37e3400640 1 -- 172.21.15.114:0/3046586317 >> v1:172.21.15.114:6789/0 conn(0x7f37e41567d0 legacy=0x7f37e40c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.856+0000 7f37e3400640 1 -- 172.21.15.114:0/3046586317 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e406fc00 con 0x7f37e40af270 2024-05-09T00:09:11.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.857+0000 7f37e3400640 1 --2- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40af270 0x7f37e40acd20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37d00097a0 tx=0x7f37d002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4bb27580354c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.857+0000 7f37e2a00640 1 -- 172.21.15.114:0/3046586317 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0037070 con 0x7f37e40af270 2024-05-09T00:09:11.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e2a00640 1 -- 172.21.15.114:0/3046586317 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d002ab10 con 0x7f37e40af270 2024-05-09T00:09:11.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e2a00640 1 -- 172.21.15.114:0/3046586317 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc001a70 con 0x7f37e40af270 2024-05-09T00:09:11.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e9400640 1 -- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40af270 msgr2=0x7f37e40acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e9400640 1 --2- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40af270 0x7f37e40acd20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37d00097a0 tx=0x7f37d002a080 comp rx=0 tx=0).stop 2024-05-09T00:09:11.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e9400640 1 -- 172.21.15.114:0/3046586317 shutdown_connections 2024-05-09T00:09:11.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e9400640 1 --2- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40af270 0x7f37e40acd20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e9400640 1 --2- 172.21.15.114:0/3046586317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e413f360 0x7f37e406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.858+0000 7f37e9400640 1 -- 172.21.15.114:0/3046586317 >> 172.21.15.114:0/3046586317 conn(0x7f37e40c5ea0 msgr2=0x7f37e40c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.859+0000 7f37e9400640 1 -- 172.21.15.114:0/3046586317 shutdown_connections 2024-05-09T00:09:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.859+0000 7f37e9400640 1 -- 172.21.15.114:0/3046586317 wait complete. 2024-05-09T00:09:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.861+0000 7f37e9400640 1 Processor -- start 2024-05-09T00:09:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.861+0000 7f37e9400640 1 -- start start 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.862+0000 7f37e9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 0x7f37e40c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.862+0000 7f37e9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e413f360 0x7f37e4151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.862+0000 7f37e9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e41567d0 0x7f37e4134640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.862+0000 7f37e9400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40c54c0 con 0x7f37e40af270 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.862+0000 7f37e9400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37e406fee0 con 0x7f37e413f360 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.862+0000 7f37e9400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f37e40c5640 con 0x7f37e41567d0 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 0x7f37e40c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 0x7f37e40c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58562/0 (socket says 172.21.15.114:58562) 2024-05-09T00:09:11.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 -- 172.21.15.114:0/2974154625 learned_addr learned my addr 172.21.15.114:0/2974154625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 -- 172.21.15.114:0/2974154625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e41567d0 msgr2=0x7f37e4134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e41567d0 0x7f37e4134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 -- 172.21.15.114:0/2974154625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e413f360 msgr2=0x7f37e4151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e413f360 0x7f37e4151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 -- 172.21.15.114:0/2974154625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e41edfb0 con 0x7f37e40af270 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.863+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 0x7f37e40c29b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f37d400e870 tx=0x7f37d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.864+0000 7f37dbe00640 1 -- 172.21.15.114:0/2974154625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4017070 con 0x7f37e40af270 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.864+0000 7f37dbe00640 1 -- 172.21.15.114:0/2974154625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d400c8e0 con 0x7f37e40af270 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.864+0000 7f37dbe00640 1 -- 172.21.15.114:0/2974154625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d400ccb0 con 0x7f37e40af270 2024-05-09T00:09:11.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.864+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e41ee290 con 0x7f37e40af270 2024-05-09T00:09:11.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.864+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e41ee850 con 0x7f37e40af270 2024-05-09T00:09:11.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.867+0000 7f37dbe00640 1 -- 172.21.15.114:0/2974154625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37d401a070 con 0x7f37e40af270 2024-05-09T00:09:11.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.868+0000 7f37dbe00640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37c4076300 0x7f37c4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.868+0000 7f37dbe00640 1 -- 172.21.15.114:0/2974154625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f37d4097be0 con 0x7f37e40af270 2024-05-09T00:09:11.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.868+0000 7f37e3400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37c4076300 0x7f37c4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.869+0000 7f37f1a59740 1 Processor -- start 2024-05-09T00:09:11.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.869+0000 7f37f1a59740 1 -- start start 2024-05-09T00:09:11.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.869+0000 7f37e3400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37c4076300 0x7f37c4078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f37d0034000 tx=0x7f37d002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5e9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf607210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37f1a59740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562faf52f410 con 0x562faf227270 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562faf4cbac0 con 0x562faf206590 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562faf52b3d0 con 0x562faf1fe3b0 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58576/0 (socket says 172.21.15.114:58576) 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.870+0000 7f37e3e00640 1 -- 172.21.15.114:0/3542569031 learned_addr learned my addr 172.21.15.114:0/3542569031 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e8a00640 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf607210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3400640 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3e00640 1 -- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 msgr2=0x562faf5e9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3e00640 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5e9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3e00640 1 -- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 msgr2=0x562faf607210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3e00640 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf607210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3e00640 1 -- 172.21.15.114:0/3542569031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562faf292850 con 0x562faf227270 2024-05-09T00:09:11.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e8a00640 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf607210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:11.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37e3e00640 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c7be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37d405cfd0 tx=0x7f37d40692c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549a2ec55a81f2f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37cfe00640 1 -- 172.21.15.114:0/3542569031 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4021040 con 0x562faf227270 2024-05-09T00:09:11.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37cfe00640 1 -- 172.21.15.114:0/3542569031 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d40609e0 con 0x562faf227270 2024-05-09T00:09:11.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.871+0000 7f37cfe00640 1 -- 172.21.15.114:0/3542569031 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d405fe40 con 0x562faf227270 2024-05-09T00:09:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 -- 172.21.15.114:0/3542569031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 msgr2=0x562faf5c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c7be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37d405cfd0 tx=0x7f37d40692c0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 -- 172.21.15.114:0/3542569031 shutdown_connections 2024-05-09T00:09:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf607210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5e9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 --2- 172.21.15.114:0/3542569031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c7be0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 -- 172.21.15.114:0/3542569031 >> 172.21.15.114:0/3542569031 conn(0x562faf21b3c0 msgr2=0x562faf5c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 -- 172.21.15.114:0/3542569031 shutdown_connections 2024-05-09T00:09:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.872+0000 7f37f1a59740 1 -- 172.21.15.114:0/3542569031 wait complete. 2024-05-09T00:09:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.873+0000 7f37f1a59740 1 -- start start 2024-05-09T00:09:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.873+0000 7f37f1a59740 1 Processor -- start 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 0x562faf5ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf5eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf227270 0x562faf6075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562faf60aa70 con 0x562faf1fe3b0 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562faf4b65e0 con 0x562faf206590 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562faf61c240 con 0x562faf227270 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37f1a59740 10 client.0 _ll_register_callbacks cb 0x562faf23eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 0x562faf5ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 0x562faf5ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58580/0 (socket says 172.21.15.114:58580) 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 -- 172.21.15.114:0/4246040111 learned_addr learned my addr 172.21.15.114:0/4246040111 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:11.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 -- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf227270 msgr2=0x562faf6075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf227270 0x562faf6075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3400640 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf5eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 -- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 msgr2=0x562faf5eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.875+0000 7f37e3e00640 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf5eb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37e3e00640 1 -- 172.21.15.114:0/4246040111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562faf3096b0 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37e3e00640 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 0x562faf5ffbf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37d405ca10 tx=0x7f37d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617db0e97fde4c3e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37ccc00640 1 -- 172.21.15.114:0/4246040111 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4021040 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37ccc00640 1 -- 172.21.15.114:0/4246040111 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f37d405c560 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d40609e0 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37ccc00640 1 -- 172.21.15.114:0/4246040111 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f37d4070050 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37f1a59740 10 client.4635 fetch_fsmap learned FSMap version 15 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562faf5ff000 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.876+0000 7f37ccc00640 1 -- 172.21.15.114:0/4246040111 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d40609e0 con 0x562faf1fe3b0 2024-05-09T00:09:11.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37ccc00640 1 -- 172.21.15.114:0/4246040111 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7f37d405f6b0 con 0x562faf1fe3b0 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37f1a59740 10 client.4635 fetch_fsmap finished waiting for FSMap version 15 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37f1a59740 10 client.4635 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37f1a59740 20 client.4635 populate_metadata read hostname 'smithi114' 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37f1a59740 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf1e5e40 0x562faf617ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37f1a59740 4 client.4635 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 --> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562faf53d020 con 0x562faf1e5e40 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.877+0000 7f37e3400640 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf1e5e40 0x562faf617ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.878+0000 7f37e3400640 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf1e5e40 0x562faf617ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bbfb96ee15483c server_cookie=cc0d2a49b875378a in_seq=0 out_seq=0 2024-05-09T00:09:11.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.878+0000 7f37ccc00640 10 client.4635 ms_handle_connect on v2:172.21.15.153:6834/3829412957 2024-05-09T00:09:11.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37ccc00640 1 -- 172.21.15.114:0/4246040111 <== mds.0 v2:172.21.15.153:6834/3829412957 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562faf53d020 con 0x562faf1e5e40 2024-05-09T00:09:11.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37ccc00640 10 client.4635 handle_command_reply: tid=0 2024-05-09T00:09:11.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 client.4635 shutdown 2024-05-09T00:09:11.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 msgr2=0x562faf5ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 0x562faf5ffbf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37d405ca10 tx=0x7f37d4000bc0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 shutdown_connections 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf1e5e40 0x562faf617ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf227270 0x562faf6075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf5eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37ccc00640 0 client.4635 ms_handle_reset on v2:172.21.15.153:6834/3829412957 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 --2- 172.21.15.114:0/4246040111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf1fe3b0 0x562faf5ffbf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.881+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 >> 172.21.15.114:0/4246040111 conn(0x562faf21b3c0 msgr2=0x562faf5c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.882+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 shutdown_connections 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.882+0000 7f37f1a59740 1 -- 172.21.15.114:0/4246040111 wait complete. 2024-05-09T00:09:11.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.882+0000 7f37f1a59740 20 client.4635 trim_cache size 0 max 16384 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.903+0000 7f37f1a59740 1 Processor -- start 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.903+0000 7f37f1a59740 1 -- start start 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf61b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37f1a59740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f37e41fdd30 con 0x562faf227270 2024-05-09T00:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37e41fb7a0 con 0x562faf206590 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f37e41fbdf0 con 0x562faf1fe3b0 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58592/0 (socket says 172.21.15.114:58592) 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.904+0000 7f37e8a00640 1 -- 172.21.15.114:0/2223728971 learned_addr learned my addr 172.21.15.114:0/2223728971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e3400640 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf61b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e8a00640 1 -- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 msgr2=0x562faf5c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e8a00640 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e8a00640 1 -- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 msgr2=0x562faf61b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e8a00640 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf61b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e8a00640 1 -- 172.21.15.114:0/2223728971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562faf5e8050 con 0x562faf227270 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37e8a00640 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c6650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37dc001a10 tx=0x7f37dc00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b70f5c5bc991ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37cf400640 1 -- 172.21.15.114:0/2223728971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc018070 con 0x562faf227270 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37cf400640 1 -- 172.21.15.114:0/2223728971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc013690 con 0x562faf227270 2024-05-09T00:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.905+0000 7f37cf400640 1 -- 172.21.15.114:0/2223728971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc013a80 con 0x562faf227270 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 -- 172.21.15.114:0/2223728971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 msgr2=0x562faf5c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c6650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37dc001a10 tx=0x7f37dc00d520 comp rx=0 tx=0).stop 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 -- 172.21.15.114:0/2223728971 shutdown_connections 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf5c6650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf206590 0x562faf61b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2223728971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf1fe3b0 0x562faf5c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 -- 172.21.15.114:0/2223728971 >> 172.21.15.114:0/2223728971 conn(0x562faf21b3c0 msgr2=0x562faf605420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 -- 172.21.15.114:0/2223728971 shutdown_connections 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.906+0000 7f37f1a59740 1 -- 172.21.15.114:0/2223728971 wait complete. 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.907+0000 7f37f1a59740 1 -- start start 2024-05-09T00:09:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.907+0000 7f37f1a59740 1 Processor -- start 2024-05-09T00:09:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf1fe3b0 0x562faf604920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf206590 0x562faf61ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf684c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562faf60aa70 con 0x562faf227270 2024-05-09T00:09:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562faf61c240 con 0x562faf1fe3b0 2024-05-09T00:09:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562faf5e7a60 con 0x562faf206590 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37f1a59740 10 client.0 _ll_register_callbacks cb 0x7f37d40601e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf684c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf684c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58600/0 (socket says 172.21.15.114:58600) 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.909+0000 7f37e8a00640 1 -- 172.21.15.114:0/2829626349 learned_addr learned my addr 172.21.15.114:0/2829626349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e3400640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf206590 0x562faf61ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf1fe3b0 0x562faf604920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e8a00640 1 -- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf206590 msgr2=0x562faf61ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e8a00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf206590 0x562faf61ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e8a00640 1 -- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf1fe3b0 msgr2=0x562faf604920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e8a00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf1fe3b0 0x562faf604920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e8a00640 1 -- 172.21.15.114:0/2829626349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562faf5e8860 con 0x562faf227270 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37e8a00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf684c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00da20 tx=0x7f37dc001480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d092dbf77129411 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-05-09T00:09:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37ccc00640 1 -- 172.21.15.114:0/2829626349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc018040 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37ccc00640 1 -- 172.21.15.114:0/2829626349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f37dc013b40 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37dc013690 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.910+0000 7f37ccc00640 1 -- 172.21.15.114:0/2829626349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f37dc02d050 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 10 client.4641 fetch_fsmap learned FSMap version 15 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562faf685720 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37ccc00640 1 -- 172.21.15.114:0/2829626349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc013690 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37ccc00640 1 -- 172.21.15.114:0/2829626349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7f37dc030020 con 0x562faf227270 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 10 client.4641 fetch_fsmap finished waiting for FSMap version 15 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 20 client.4641 populate_metadata read hostname 'smithi114' 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 4 client.4641 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.911+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 --> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] -- command(tid 0: {"prefix": "status"}) -- 0x562faf536e90 con 0x562faf6851d0 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.912+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.912+0000 7f37e3e00640 1 -- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 msgr2=0x562faf688200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-05-09T00:09:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.912+0000 7f37e3e00640 1 -- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 msgr2=0x562faf688200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T00:09:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.912+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:09:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:11.912+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:09:12.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.113+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:12.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.115+0000 7f37e3e00640 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c692fb389d3105e server_cookie=e7aa5964a3000451 in_seq=0 out_seq=0 2024-05-09T00:09:12.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.115+0000 7f37ccc00640 10 client.4641 ms_handle_connect on v2:172.21.15.153:6834/3829412957 2024-05-09T00:09:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.115+0000 7f37ccc00640 1 -- 172.21.15.114:0/2829626349 <== mds.0 v2:172.21.15.153:6834/3829412957 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x562faf536e90 con 0x562faf6851d0 2024-05-09T00:09:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.115+0000 7f37ccc00640 10 client.4641 handle_command_reply: tid=0 2024-05-09T00:09:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.115+0000 7f37f1a59740 1 client.4641 shutdown 2024-05-09T00:09:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 msgr2=0x562faf684c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf684c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00da20 tx=0x7f37dc001480 comp rx=0 tx=0).stop 2024-05-09T00:09:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 shutdown_connections 2024-05-09T00:09:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:6834/3829412957,v1:172.21.15.153:6835/3829412957] conn(0x562faf6851d0 0x562faf688200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562faf227270 0x562faf684c90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562faf206590 0x562faf61ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 --2- 172.21.15.114:0/2829626349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562faf1fe3b0 0x562faf604920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 >> 172.21.15.114:0/2829626349 conn(0x562faf21b3c0 msgr2=0x562faf5fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37ccc00640 0 client.4641 ms_handle_reset on v2:172.21.15.153:6834/3829412957 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.116+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 shutdown_connections 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.117+0000 7f37f1a59740 1 -- 172.21.15.114:0/2829626349 wait complete. 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.117+0000 7f37f1a59740 20 client.4641 trim_cache size 0 max 16384 2024-05-09T00:09:12.114 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae", 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4238, 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "b", 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 16.928934771000002, 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 15, 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 26, 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 26, 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 33.775280668999997 2024-05-09T00:09:12.115 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37c4076300 msgr2=0x7f37c4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37c4076300 0x7f37c4078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f37d0034000 tx=0x7f37d002c000 comp rx=0 tx=0).stop 2024-05-09T00:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 msgr2=0x7f37e40c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 0x7f37e40c29b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f37d400e870 tx=0x7f37d400ed30 comp rx=0 tx=0).stop 2024-05-09T00:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 shutdown_connections 2024-05-09T00:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37c4076300 0x7f37c4078810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37e41567d0 0x7f37e4134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e413f360 0x7f37e4151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 --2- 172.21.15.114:0/2974154625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e40af270 0x7f37e40c29b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.118+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 >> 172.21.15.114:0/2974154625 conn(0x7f37e40c5ea0 msgr2=0x7f37e413cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.119+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 shutdown_connections 2024-05-09T00:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.119+0000 7f37e9400640 1 -- 172.21.15.114:0/2974154625 wait complete. 2024-05-09T00:09:12.152 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T00:09:12.291 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T00:09:12.291 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T00:09:12.292 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T00:09:12.292 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T00:09:12.320 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T00:09:12.321 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-05-09T00:09:12.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:12.321 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-05-09T00:09:12.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:12.379 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-05-09T00:09:12.469 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-05-09T00:09:12.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:09:12.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:12.473 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-09T00:09:12.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:12.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-05-09T00:09:12.604 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-05-09T00:09:12.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:09:12.608 INFO:tasks.kclient:client.0 config is {'syntax': 'v1', 'cephfs_name': 'a'} 2024-05-09T00:09:12.608 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T00:09:12.608 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:12.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T00:09:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.891+0000 7f3339a00640 1 Processor -- start 2024-05-09T00:09:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.891+0000 7f3339a00640 1 -- start start 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3339a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3334073800 0x7f3334072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3339a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33340c4a70 0x7f33340c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3339a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33341585c0 0x7f33341589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3339a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3334073df0 con 0x7f33341585c0 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3339a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f33340c5f40 con 0x7f33340c4a70 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3339a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3334074040 con 0x7f3334073800 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3333400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33341585c0 0x7f33341589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3333400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33341585c0 0x7f33341589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58610/0 (socket says 172.21.15.114:58610) 2024-05-09T00:09:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.893+0000 7f3333400640 1 -- 172.21.15.114:0/1039265524 learned_addr learned my addr 172.21.15.114:0/1039265524 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3332000640 1 --2- 172.21.15.114:0/1039265524 >> v2:172.21.15.153:3300/0 conn(0x7f33340c4a70 0x7f33340c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3332a00640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3334073800 0x7f3334072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3333400640 1 -- 172.21.15.114:0/1039265524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3334073800 msgr2=0x7f3334072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3333400640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3334073800 0x7f3334072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3333400640 1 -- 172.21.15.114:0/1039265524 >> v2:172.21.15.153:3300/0 conn(0x7f33340c4a70 msgr2=0x7f33340c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3333400640 1 --2- 172.21.15.114:0/1039265524 >> v2:172.21.15.153:3300/0 conn(0x7f33340c4a70 0x7f33340c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3333400640 1 -- 172.21.15.114:0/1039265524 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33340c58f0 con 0x7f33341585c0 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3332a00640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3334073800 0x7f3334072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.894+0000 7f3332000640 1 --2- 172.21.15.114:0/1039265524 >> v2:172.21.15.153:3300/0 conn(0x7f33340c4a70 0x7f33340c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.895+0000 7f3333400640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33341585c0 0x7f33341589d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f333406d4f0 tx=0x7f332c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956c74bd31191c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.895+0000 7f3331600640 1 -- 172.21.15.114:0/1039265524 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c036070 con 0x7f33341585c0 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.895+0000 7f3331600640 1 -- 172.21.15.114:0/1039265524 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c031600 con 0x7f33341585c0 2024-05-09T00:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.895+0000 7f3331600640 1 -- 172.21.15.114:0/1039265524 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0319d0 con 0x7f33341585c0 2024-05-09T00:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 -- 172.21.15.114:0/1039265524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33341585c0 msgr2=0x7f33341589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33341585c0 0x7f33341589d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f333406d4f0 tx=0x7f332c02a6a0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 -- 172.21.15.114:0/1039265524 shutdown_connections 2024-05-09T00:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33341585c0 0x7f33341589d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 --2- 172.21.15.114:0/1039265524 >> v2:172.21.15.153:3300/0 conn(0x7f33340c4a70 0x7f33340c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 --2- 172.21.15.114:0/1039265524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3334073800 0x7f3334072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 -- 172.21.15.114:0/1039265524 >> 172.21.15.114:0/1039265524 conn(0x7f333406c680 msgr2=0x7f333406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 -- 172.21.15.114:0/1039265524 shutdown_connections 2024-05-09T00:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.896+0000 7f3339a00640 1 -- 172.21.15.114:0/1039265524 wait complete. 2024-05-09T00:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.898+0000 7f3339a00640 1 Processor -- start 2024-05-09T00:09:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.898+0000 7f3339a00640 1 -- start start 2024-05-09T00:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3339a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 0x7f33341e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3339a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c4a70 0x7f333414a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3339a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33341585c0 0x7f33341ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3339a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3334074320 con 0x7f3334073800 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3339a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33340c4e80 con 0x7f33340c4a70 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3339a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33341e1610 con 0x7f33341585c0 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 0x7f33341e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 0x7f33341e3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58620/0 (socket says 172.21.15.114:58620) 2024-05-09T00:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 -- 172.21.15.114:0/660914159 learned_addr learned my addr 172.21.15.114:0/660914159 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 -- 172.21.15.114:0/660914159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33341585c0 msgr2=0x7f33341ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33341585c0 0x7f33341ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 -- 172.21.15.114:0/660914159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c4a70 msgr2=0x7f333414a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c4a70 0x7f333414a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.900+0000 7f3332a00640 1 -- 172.21.15.114:0/660914159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33341ecc40 con 0x7f3334073800 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.901+0000 7f3332a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 0x7f33341e3110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f332400c820 tx=0x7f332400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.901+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324015070 con 0x7f3334073800 2024-05-09T00:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.901+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33240079d0 con 0x7f3334073800 2024-05-09T00:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.901+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324007d80 con 0x7f3334073800 2024-05-09T00:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.901+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33340be800 con 0x7f3334073800 2024-05-09T00:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.901+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333414ae20 con 0x7f3334073800 2024-05-09T00:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.902+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3334077430 con 0x7f3334073800 2024-05-09T00:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.903+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3324018070 con 0x7f3334073800 2024-05-09T00:09:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.904+0000 7f332aa00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3314076300 0x7f3314078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.905+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f33240977c0 con 0x7f3334073800 2024-05-09T00:09:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.905+0000 7f3332000640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3314076300 0x7f3314078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.905+0000 7f3332000640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3314076300 0x7f3314078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3320006b10 tx=0x7f3320008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:12.910+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3324060de0 con 0x7f3334073800 2024-05-09T00:09:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.154+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f33340ac710 con 0x7f3334073800 2024-05-09T00:09:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.156+0000 7f332aa00640 1 -- 172.21.15.114:0/660914159 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+116 (secure 0 0 0) 0x7f33240606e0 con 0x7f3334073800 2024-05-09T00:09:13.152 INFO:teuthology.orchestra.run.smithi114.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-05-09T00:09:13.152 INFO:teuthology.orchestra.run.smithi114.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3314076300 msgr2=0x7f3314078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3314076300 0x7f3314078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3320006b10 tx=0x7f3320008040 comp rx=0 tx=0).stop 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 msgr2=0x7f33341e3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 0x7f33341e3110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f332400c820 tx=0x7f332400cce0 comp rx=0 tx=0).stop 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 shutdown_connections 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3314076300 0x7f3314078810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33341585c0 0x7f33341ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c4a70 0x7f333414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 --2- 172.21.15.114:0/660914159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3334073800 0x7f33341e3110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 >> 172.21.15.114:0/660914159 conn(0x7f333406c680 msgr2=0x7f33340c9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 shutdown_connections 2024-05-09T00:09:13.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13.158+0000 7f3339a00640 1 -- 172.21.15.114:0/660914159 wait complete. 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T00:09:13.183 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T00:09:13.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:13.184 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:09:13.235 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42623sec preferred_lft 42623sec 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-05-09T00:09:13.236 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:09:13.237 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T00:09:13.238 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-05-09T00:09:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:13.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:13.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:13.706 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T00:09:13.773 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-05-09T00:09:13.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:13.777 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-05-09T00:09:13.828 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-05-09T00:09:13.828 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T00:09:13.828 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T00:09:13.828 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T00:09:13.828 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T00:09:13.828 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:13.829 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-05-09T00:09:13.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T00:09:13.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T00:09:13.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T00:09:13.829 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-05-09T00:09:13.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:14.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:14.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:14.546 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-05-09T00:09:14.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:14.586 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-05-09T00:09:14.670 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:14.670 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-05-09T00:09:14.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T00:09:14.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T00:09:14.670 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-05-09T00:09:14.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:14.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:14.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T00:09:14.888 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-05-09T00:09:14.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:15.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:15.170 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:15.171 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-05-09T00:09:15.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-05-09T00:09:15.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T00:09:15.171 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-05-09T00:09:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:15.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:15.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:09:15.357 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:15.398 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T00:09:15.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:09:15.399 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:15.484 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T00:09:15.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:15.484 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-05-09T00:09:15.717 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-05-09T00:09:15.718 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-05-09T00:09:15.718 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-05-09T00:09:16.428 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-05-09T00:09:16.428 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-05-09T00:09:16.428 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-05-09T00:09:16.428 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-09T00:09:16.428 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T00:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-05-09T00:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-05-09T00:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-05-09T00:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-09T00:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T00:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-09T00:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-09T00:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a,key=0,fsid=3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae" will pass to kernel 2024-05-09T00:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T00:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-05-09T00:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T00:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T00:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T00:09:16.497 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T00:09:16.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:16.497 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:16.578 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:09:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T00:09:16.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout:client4537 2024-05-09T00:09:16.714 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:09:16.714 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:09:16.762 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:09:16.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T00:09:16.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:16.942 INFO:teuthology.orchestra.run.smithi114.stdout:client4537 2024-05-09T00:09:16.942 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:09:17.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T00:09:17.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout:client4537 2024-05-09T00:09:17.092 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae.client4537/status') 2024-05-09T00:09:17.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:17.299 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4537 (3)172.21.15.114:0/792670472 2024-05-09T00:09:17.299 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-05-09T00:09:17.300 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-05-09T00:09:17.300 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-05-09T00:09:17.300 INFO:teuthology.orchestra.run.smithi114.stderr:70 bytes copied, 9.8467e-05 s, 711 kB/s 2024-05-09T00:09:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:17.315 INFO:tasks.kclient:client.1 config is {'syntax': 'v1', 'cephfs_name': 'b'} 2024-05-09T00:09:17.316 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T00:09:17.316 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:17.316 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T00:09:17.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.597+0000 7f7cfec00640 1 Processor -- start 2024-05-09T00:09:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.598+0000 7f7cfec00640 1 -- start start 2024-05-09T00:09:17.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cf8073510 0x7f7cf814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:17.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfec00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80c3d10 0x7f7cf80c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:17.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf80ac210 con 0x7f7cf80ae880 2024-05-09T00:09:17.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf8073e20 con 0x7f7cf8073510 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfec00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf80abf30 con 0x7f7cf80c3d10 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfd800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cf8073510 0x7f7cf814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfd800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cf8073510 0x7f7cf814ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58626/0 (socket says 172.21.15.114:58626) 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfd800640 1 -- 172.21.15.114:0/1690225686 learned_addr learned my addr 172.21.15.114:0/1690225686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfce00640 1 --1- 172.21.15.114:0/1690225686 >> v1:172.21.15.114:6789/0 conn(0x7f7cf80ae880 0x7f7cf80aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40082/0 (socket says 172.21.15.114:40082) 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.600+0000 7f7cfe200640 1 --2- 172.21.15.114:0/1690225686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80c3d10 0x7f7cf80c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.601+0000 7f7cfd800640 1 -- 172.21.15.114:0/1690225686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80c3d10 msgr2=0x7f7cf80c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.601+0000 7f7cfd800640 1 --2- 172.21.15.114:0/1690225686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80c3d10 0x7f7cf80c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.601+0000 7f7cfd800640 1 -- 172.21.15.114:0/1690225686 >> v1:172.21.15.114:6789/0 conn(0x7f7cf80ae880 legacy=0x7f7cf80aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:17.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.601+0000 7f7cfd800640 1 -- 172.21.15.114:0/1690225686 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8155830 con 0x7f7cf8073510 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.602+0000 7f7cfd800640 1 --2- 172.21.15.114:0/1690225686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf814ed80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009870 tx=0x7f7ce802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6f339bb3c129 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.602+0000 7f7cf7e00640 1 -- 172.21.15.114:0/1690225686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8037070 con 0x7f7cf8073510 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.602+0000 7f7cf7e00640 1 -- 172.21.15.114:0/1690225686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8032440 con 0x7f7cf8073510 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.602+0000 7f7cf7e00640 1 -- 172.21.15.114:0/1690225686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8032810 con 0x7f7cf8073510 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 -- 172.21.15.114:0/1690225686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 msgr2=0x7f7cf814ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1690225686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf814ed80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009870 tx=0x7f7ce802a130 comp rx=0 tx=0).stop 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 -- 172.21.15.114:0/1690225686 shutdown_connections 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1690225686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80c3d10 0x7f7cf80c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1690225686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf814ed80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 -- 172.21.15.114:0/1690225686 >> 172.21.15.114:0/1690225686 conn(0x7f7cf80c9730 msgr2=0x7f7cf80c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 -- 172.21.15.114:0/1690225686 shutdown_connections 2024-05-09T00:09:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.603+0000 7f7cfec00640 1 -- 172.21.15.114:0/1690225686 wait complete. 2024-05-09T00:09:17.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.605+0000 7f7cfec00640 1 Processor -- start 2024-05-09T00:09:17.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.605+0000 7f7cfec00640 1 -- start start 2024-05-09T00:09:17.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf8161a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:17.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfec00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80ae880 0x7f7cf8144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:17.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80c3d10 0x7f7cf8144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:17.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80af3a0 con 0x7f7cf8073510 2024-05-09T00:09:17.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8074070 con 0x7f7cf80c3d10 2024-05-09T00:09:17.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfec00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf80af520 con 0x7f7cf80ae880 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf8161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf8161a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58636/0 (socket says 172.21.15.114:58636) 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfd800640 1 -- 172.21.15.114:0/1638774423 learned_addr learned my addr 172.21.15.114:0/1638774423 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfce00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80ae880 0x7f7cf8144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.607+0000 7f7cfe200640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80c3d10 0x7f7cf8144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfd800640 1 -- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80ae880 msgr2=0x7f7cf8144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfd800640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80ae880 0x7f7cf8144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfd800640 1 -- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80c3d10 msgr2=0x7f7cf8144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfd800640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80c3d10 0x7f7cf8144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfd800640 1 -- 172.21.15.114:0/1638774423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8144fc0 con 0x7f7cf8073510 2024-05-09T00:09:17.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfe200640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80c3d10 0x7f7cf8144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:17.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfd800640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf8161a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009870 tx=0x7f7ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:17.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8041020 con 0x7f7cf8073510 2024-05-09T00:09:17.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce80306c0 con 0x7f7cf8073510 2024-05-09T00:09:17.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8037040 con 0x7f7cf8073510 2024-05-09T00:09:17.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.608+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf8143dd0 con 0x7f7cf8073510 2024-05-09T00:09:17.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.609+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf81626d0 con 0x7f7cf8073510 2024-05-09T00:09:17.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.610+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf81621e0 con 0x7f7cf8073510 2024-05-09T00:09:17.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.611+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ce8044020 con 0x7f7cf8073510 2024-05-09T00:09:17.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.612+0000 7f7cf5600640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cdc076300 0x7f7cdc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:17.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.612+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f7ce80b7da0 con 0x7f7cf8073510 2024-05-09T00:09:17.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.612+0000 7f7cfce00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cdc076300 0x7f7cdc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:17.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.613+0000 7f7cfce00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cdc076300 0x7f7cdc078810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8148da0 tx=0x7f7cec007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:17.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.617+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ce804b070 con 0x7f7cf8073510 2024-05-09T00:09:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.867+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7cf8078430 con 0x7f7cf8073510 2024-05-09T00:09:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.868+0000 7f7cf5600640 1 -- 172.21.15.114:0/1638774423 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+116 (secure 0 0 0) 0x7f7ce80813c0 con 0x7f7cf8073510 2024-05-09T00:09:17.865 INFO:teuthology.orchestra.run.smithi114.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-05-09T00:09:17.865 INFO:teuthology.orchestra.run.smithi114.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-05-09T00:09:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cdc076300 msgr2=0x7f7cdc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cdc076300 0x7f7cdc078810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8148da0 tx=0x7f7cec007ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 msgr2=0x7f7cf8161a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf8161a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009870 tx=0x7f7ce80046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 shutdown_connections 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cdc076300 0x7f7cdc078810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf80c3d10 0x7f7cf8144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf80ae880 0x7f7cf8144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 --2- 172.21.15.114:0/1638774423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf8073510 0x7f7cf8161a90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.871+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 >> 172.21.15.114:0/1638774423 conn(0x7f7cf80c9730 msgr2=0x7f7cf80aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.872+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 shutdown_connections 2024-05-09T00:09:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:17.872+0000 7f7cfec00640 1 -- 172.21.15.114:0/1638774423 wait complete. 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T00:09:17.893 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-09T00:09:17.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:17.894 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-05-09T00:09:17.951 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T00:09:17.951 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T00:09:17.951 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T00:09:17.951 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:09:17.951 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-05-09T00:09:17.952 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:09:17.953 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T00:09:17.954 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-09T00:09:18.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:18.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:18.431 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T00:09:18.501 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-05-09T00:09:18.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:18.504 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-05-09T00:09:18.558 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-05-09T00:09:18.559 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T00:09:18.559 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T00:09:18.559 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T00:09:18.559 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T00:09:18.560 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:18.560 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-09T00:09:18.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T00:09:18.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T00:09:18.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T00:09:18.560 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-09T00:09:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:19.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:19.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:19.288 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-09T00:09:19.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:19.341 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-05-09T00:09:19.394 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:19.394 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-09T00:09:19.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T00:09:19.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-09T00:09:19.394 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-09T00:09:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:19.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:19.578 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-09T00:09:19.579 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-09T00:09:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:19.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:19.873 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T00:09:19.873 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-09T00:09:19.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-05-09T00:09:19.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T00:09:19.873 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:20.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:20.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:09:20.067 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:20.110 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-09T00:09:20.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:09:20.111 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:20.204 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T00:09:20.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:20.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-05-09T00:09:20.410 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-05-09T00:09:20.410 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-05-09T00:09:20.410 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-09T00:09:21.103 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-05-09T00:09:21.103 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-05-09T00:09:21.103 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-09T00:09:21.103 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-09T00:09:21.103 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-09T00:09:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b,key=1,fsid=3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae" will pass to kernel 2024-05-09T00:09:21.151 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-09T00:09:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-05-09T00:09:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T00:09:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T00:09:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T00:09:21.157 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T00:09:21.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:09:21.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:21.242 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:09:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T00:09:21.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:21.383 INFO:teuthology.orchestra.run.smithi153.stdout:client4540 2024-05-09T00:09:21.383 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:09:21.383 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:09:21.433 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:09:21.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T00:09:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:21.615 INFO:teuthology.orchestra.run.smithi153.stdout:client4540 2024-05-09T00:09:21.615 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:09:21.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T00:09:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:21.748 INFO:teuthology.orchestra.run.smithi153.stdout:client4540 2024-05-09T00:09:21.749 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae.client4540/status') 2024-05-09T00:09:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T00:09:21.963 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4540 (3)192.168.0.1:0/4109092934 2024-05-09T00:09:21.963 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-05-09T00:09:21.963 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-05-09T00:09:21.963 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-05-09T00:09:21.963 INFO:teuthology.orchestra.run.smithi153.stderr:69 bytes copied, 0.000101953 s, 677 kB/s 2024-05-09T00:09:21.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-09T00:09:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T00:09:21.980 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-05-09T00:09:22.025 INFO:tasks.mds_thrash:mds thrasher using random seed: 1715213362 2024-05-09T00:09:22.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.309+0000 7fe385800640 1 Processor -- start 2024-05-09T00:09:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.309+0000 7fe385800640 1 -- start start 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe385800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe380155710 0x7fe380158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe385800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3800cb800 0x7fe3800cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe385800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38008f550 con 0x7fe3800c8730 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe385800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe3800b3460 con 0x7fe380155710 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe385800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe380155b20 con 0x7fe3800cb800 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe37f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe380155710 0x7fe380158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe37f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe380155710 0x7fe380158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38644/0 (socket says 172.21.15.114:38644) 2024-05-09T00:09:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.311+0000 7fe37f400640 1 -- 172.21.15.114:0/311663541 learned_addr learned my addr 172.21.15.114:0/311663541 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.312+0000 7fe384e00640 1 --2- 172.21.15.114:0/311663541 >> v2:172.21.15.153:3300/0 conn(0x7fe3800cb800 0x7fe3800cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.312+0000 7fe37f400640 1 -- 172.21.15.114:0/311663541 >> v2:172.21.15.153:3300/0 conn(0x7fe3800cb800 msgr2=0x7fe3800cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.312+0000 7fe37f400640 1 --2- 172.21.15.114:0/311663541 >> v2:172.21.15.153:3300/0 conn(0x7fe3800cb800 0x7fe3800cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.312+0000 7fe37f400640 1 -- 172.21.15.114:0/311663541 >> v1:172.21.15.153:6789/0 conn(0x7fe3800c8730 legacy=0x7fe3800ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.312+0000 7fe37f400640 1 -- 172.21.15.114:0/311663541 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38015b880 con 0x7fe380155710 2024-05-09T00:09:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.312+0000 7fe384e00640 1 --2- 172.21.15.114:0/311663541 >> v2:172.21.15.153:3300/0 conn(0x7fe3800cb800 0x7fe3800cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.313+0000 7fe37f400640 1 --2- 172.21.15.114:0/311663541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe380155710 0x7fe380158a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c8d60 tx=0x7fe36c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f49016506d1c9ff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.313+0000 7fe37ea00640 1 -- 172.21.15.114:0/311663541 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c037070 con 0x7fe380155710 2024-05-09T00:09:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.313+0000 7fe37ea00640 1 -- 172.21.15.114:0/311663541 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36c02ae00 con 0x7fe380155710 2024-05-09T00:09:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.313+0000 7fe37ea00640 1 -- 172.21.15.114:0/311663541 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c032660 con 0x7fe380155710 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 -- 172.21.15.114:0/311663541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe380155710 msgr2=0x7fe380158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 --2- 172.21.15.114:0/311663541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe380155710 0x7fe380158a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c8d60 tx=0x7fe36c02a0b0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 -- 172.21.15.114:0/311663541 shutdown_connections 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 --2- 172.21.15.114:0/311663541 >> v2:172.21.15.153:3300/0 conn(0x7fe3800cb800 0x7fe3800cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 --2- 172.21.15.114:0/311663541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe380155710 0x7fe380158a70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 -- 172.21.15.114:0/311663541 >> 172.21.15.114:0/311663541 conn(0x7fe3800af450 msgr2=0x7fe3800af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 -- 172.21.15.114:0/311663541 shutdown_connections 2024-05-09T00:09:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.314+0000 7fe385800640 1 -- 172.21.15.114:0/311663541 wait complete. 2024-05-09T00:09:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.316+0000 7fe385800640 1 Processor -- start 2024-05-09T00:09:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.317+0000 7fe385800640 1 -- start start 2024-05-09T00:09:22.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe385800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3800c8730 0x7fe3801f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe385800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 0x7fe3800c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe385800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe380155710 0x7fe3801f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe385800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe38015c1b0 con 0x7fe3800cb800 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe385800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe38015b630 con 0x7fe3800c8730 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe385800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe38015be40 con 0x7fe380155710 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe37f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 0x7fe3800c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe37f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 0x7fe3800c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38656/0 (socket says 172.21.15.114:38656) 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.318+0000 7fe37f400640 1 -- 172.21.15.114:0/1627141331 learned_addr learned my addr 172.21.15.114:0/1627141331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37fe00640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3800c8730 0x7fe3801f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37f400640 1 -- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe380155710 msgr2=0x7fe3801f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe384e00640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe380155710 0x7fe3801f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37f400640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe380155710 0x7fe3801f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37f400640 1 -- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3800c8730 msgr2=0x7fe3801f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37f400640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3800c8730 0x7fe3801f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37f400640 1 -- 172.21.15.114:0/1627141331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3801f2310 con 0x7fe3800cb800 2024-05-09T00:09:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37fe00640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3800c8730 0x7fe3801f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe37f400640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 0x7fe3800c1e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe36c02a0f0 tx=0x7fe36c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.319+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c041030 con 0x7fe3800cb800 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.320+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36c03c670 con 0x7fe3800cb800 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.320+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c037040 con 0x7fe3800cb800 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.320+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3800c3e00 con 0x7fe3800cb800 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.320+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3801ef630 con 0x7fe3800cb800 2024-05-09T00:09:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.321+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe380078430 con 0x7fe3800cb800 2024-05-09T00:09:22.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.322+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe36c044070 con 0x7fe3800cb800 2024-05-09T00:09:22.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.323+0000 7fe377e00640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe360076300 0x7fe360078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.323+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fe36c0b7bd0 con 0x7fe3800cb800 2024-05-09T00:09:22.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.323+0000 7fe37fe00640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe360076300 0x7fe360078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.324+0000 7fe37fe00640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe360076300 0x7fe360078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c0e90 tx=0x7fe370008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:22.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.329+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe36c04b070 con 0x7fe3800cb800 2024-05-09T00:09:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.543+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3800cb5e0 con 0x7fe3800cb800 2024-05-09T00:09:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.546+0000 7fe377e00640 1 -- 172.21.15.114:0/1627141331 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7fe36c081160 con 0x7fe3800cb800 2024-05-09T00:09:22.544 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:22.544 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe360076300 msgr2=0x7fe360078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe360076300 0x7fe360078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c0e90 tx=0x7fe370008040 comp rx=0 tx=0).stop 2024-05-09T00:09:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 msgr2=0x7fe3800c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 0x7fe3800c1e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe36c02a0f0 tx=0x7fe36c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 shutdown_connections 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe360076300 0x7fe360078810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe380155710 0x7fe3801f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800cb800 0x7fe3800c1e90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 --2- 172.21.15.114:0/1627141331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3800c8730 0x7fe3801f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 >> 172.21.15.114:0/1627141331 conn(0x7fe3800af450 msgr2=0x7fe380158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 shutdown_connections 2024-05-09T00:09:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.549+0000 7fe385800640 1 -- 172.21.15.114:0/1627141331 wait complete. 2024-05-09T00:09:22.571 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:08:38.315422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-09T00:08:42.283655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-09T00:08:43.588739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-09T00:08:52.408571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-09T00:08:53.695063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:09:22.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:09:22.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.846+0000 7f4cfca00640 1 Processor -- start 2024-05-09T00:09:22.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.846+0000 7f4cfca00640 1 -- start start 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.848+0000 7f4cfca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4cf8158b10 0x7f4cf80af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.848+0000 7f4cfca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 0x7f4cf80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.848+0000 7f4cfca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf815b7f0 con 0x7f4cf80c8760 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.848+0000 7f4cfca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf815c5b0 con 0x7f4cf8158b10 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.848+0000 7f4cfca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf815bad0 con 0x7f4cf80af570 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.848+0000 7f4cf7400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4cf80c8760 0x7f4cf8155740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41766/0 (socket says 172.21.15.114:41766) 2024-05-09T00:09:22.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf7400640 1 -- 172.21.15.114:0/1969164596 learned_addr learned my addr 172.21.15.114:0/1969164596 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 0x7f4cf80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6a00640 1 --2- 172.21.15.114:0/1969164596 >> v2:172.21.15.153:3300/0 conn(0x7f4cf8158b10 0x7f4cf80af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3981584947 0 0) 0x7f4cf815b7f0 con 0x7f4cf80c8760 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd8003520 con 0x7f4cf80c8760 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3961581008 0 0) 0x7f4cd8003520 con 0x7f4cf80c8760 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 msgr2=0x7f4cf80cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 0x7f4cf80cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 >> v2:172.21.15.153:3300/0 conn(0x7f4cf8158b10 msgr2=0x7f4cf80af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 --2- 172.21.15.114:0/1969164596 >> v2:172.21.15.153:3300/0 conn(0x7f4cf8158b10 0x7f4cf80af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf815bdb0 con 0x7f4cf80c8760 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.849+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f4ce8001710 con 0x7f4cf80c8760 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6a00640 1 --2- 172.21.15.114:0/1969164596 >> v2:172.21.15.153:3300/0 conn(0x7f4cf8158b10 0x7f4cf80af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 >> v1:172.21.15.114:6789/0 conn(0x7f4cf80c8760 legacy=0x7f4cf8155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 0x7f4cd8003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cd8004040 0x7f4cd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cd8004d40 0x7f4cd8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf815c5b0 con 0x7f4cd8004d40 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf815bad0 con 0x7f4cd8004040 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd800bbd0 con 0x7f4cf80af570 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cd8004d40 0x7f4cd8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7400640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 0x7f4cd8003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7e00640 1 -- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 msgr2=0x7f4cd8003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:22.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80af570 0x7f4cd8003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf6a00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cd8004040 0x7f4cd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7e00640 1 -- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cd8004040 msgr2=0x7f4cd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:22.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cd8004040 0x7f4cd8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.850+0000 7f4cf7e00640 1 -- 172.21.15.114:0/1969164596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd8003520 con 0x7f4cd8004d40 2024-05-09T00:09:22.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.851+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cd8004d40 0x7f4cd8005150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80b0160 tx=0x7f4cd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d00c780e8515fc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:22.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0036070 con 0x7f4cd8004d40 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf0031400 con 0x7f4cd8004d40 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cf6000640 1 -- 172.21.15.114:0/1969164596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0009690 con 0x7f4cd8004d40 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cfca00640 1 -- 172.21.15.114:0/1969164596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cd8004d40 msgr2=0x7f4cd8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cfca00640 1 --2- 172.21.15.114:0/1969164596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cd8004d40 0x7f4cd8005150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80b0160 tx=0x7f4cd8005830 comp rx=0 tx=0).stop 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cf7e00640 1 -- 172.21.15.114:0/1969164596 reap_dead start 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cfca00640 1 -- 172.21.15.114:0/1969164596 shutdown_connections 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.852+0000 7f4cfca00640 1 -- 172.21.15.114:0/1969164596 >> 172.21.15.114:0/1969164596 conn(0x7f4cf8068ef0 msgr2=0x7f4cf80cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.853+0000 7f4cfca00640 1 -- 172.21.15.114:0/1969164596 shutdown_connections 2024-05-09T00:09:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.853+0000 7f4cfca00640 1 -- 172.21.15.114:0/1969164596 wait complete. 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.855+0000 7f4cfca00640 1 Processor -- start 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.855+0000 7f4cfca00640 1 -- start start 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cfca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cd8004d40 0x7f4cf8154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cfca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8154c50 0x7f4cf81f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cfca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 0x7f4cf815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cfca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80cd1f0 con 0x7f4cf815a060 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cfca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80cd070 con 0x7f4cf8154c50 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cfca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf80cb430 con 0x7f4cd8004d40 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cf7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 0x7f4cf815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cf7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 0x7f4cf815a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38668/0 (socket says 172.21.15.114:38668) 2024-05-09T00:09:22.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.856+0000 7f4cf7e00640 1 -- 172.21.15.114:0/2609588930 learned_addr learned my addr 172.21.15.114:0/2609588930 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7400640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cd8004d40 0x7f4cf8154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf6a00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8154c50 0x7f4cf81f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7e00640 1 -- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cd8004d40 msgr2=0x7f4cf8154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cd8004d40 0x7f4cf8154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7e00640 1 -- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8154c50 msgr2=0x7f4cf81f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8154c50 0x7f4cf81f19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7e00640 1 -- 172.21.15.114:0/2609588930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf8154a40 con 0x7f4cf815a060 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7400640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cd8004d40 0x7f4cf8154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cf7e00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 0x7f4cf815a470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cf002ab50 tx=0x7f4cf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0036040 con 0x7f4cf815a060 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf0041070 con 0x7f4cf815a060 2024-05-09T00:09:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf815aae0 con 0x7f4cf815a060 2024-05-09T00:09:22.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.857+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0009690 con 0x7f4cf815a060 2024-05-09T00:09:22.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.858+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf81f11c0 con 0x7f4cf815a060 2024-05-09T00:09:22.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.859+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf80c7370 con 0x7f4cf815a060 2024-05-09T00:09:22.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.860+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cf0004270 con 0x7f4cf815a060 2024-05-09T00:09:22.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.861+0000 7f4cef400640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4cd4076300 0x7f4cd4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:22.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.861+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f4cf00b7340 con 0x7f4cf815a060 2024-05-09T00:09:22.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.861+0000 7f4cf7400640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4cd4076300 0x7f4cd4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:22.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.862+0000 7f4cf7400640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4cd4076300 0x7f4cd4078810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8001eb0 tx=0x7f4ce8000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:22.866+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4cf004a020 con 0x7f4cf815a060 2024-05-09T00:09:23.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.070+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cf8078430 con 0x7f4cf815a060 2024-05-09T00:09:23.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.071+0000 7f4cef400640 1 -- 172.21.15.114:0/2609588930 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f4cf0080970 con 0x7f4cf815a060 2024-05-09T00:09:23.068 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-05-09T00:09:23.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4cd4076300 msgr2=0x7f4cd4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4cd4076300 0x7f4cd4078810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8001eb0 tx=0x7f4ce8000ed0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 msgr2=0x7f4cf815a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 0x7f4cf815a470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cf002ab50 tx=0x7f4cf0004730 comp rx=0 tx=0).stop 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 shutdown_connections 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4cd4076300 0x7f4cd4078810 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cf815a060 0x7f4cf815a470 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8154c50 0x7f4cf81f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 --2- 172.21.15.114:0/2609588930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cd8004d40 0x7f4cf8154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.074+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 >> 172.21.15.114:0/2609588930 conn(0x7f4cf8068ef0 msgr2=0x7f4cf8156500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.075+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 shutdown_connections 2024-05-09T00:09:23.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.075+0000 7f4cfca00640 1 -- 172.21.15.114:0/2609588930 wait complete. 2024-05-09T00:09:23.100 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-09T00:09:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.375+0000 7f39c5c00640 1 Processor -- start 2024-05-09T00:09:23.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.376+0000 7f39c5c00640 1 -- start start 2024-05-09T00:09:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39c5c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39c0072720 0x7f39c00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39c5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39c01585c0 0x7f39c01589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39c5c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c0074040 con 0x7f39c0073800 2024-05-09T00:09:23.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39c5c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f39c0073df0 con 0x7f39c01585c0 2024-05-09T00:09:23.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39c5c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00c5f40 con 0x7f39c0072720 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39bf400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39c01585c0 0x7f39c01589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39bf400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39c01585c0 0x7f39c01589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38674/0 (socket says 172.21.15.114:38674) 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.378+0000 7f39bf400640 1 -- 172.21.15.114:0/2215551612 learned_addr learned my addr 172.21.15.114:0/2215551612 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.379+0000 7f39b7e00640 1 --2- 172.21.15.114:0/2215551612 >> v2:172.21.15.153:3300/0 conn(0x7f39c0072720 0x7f39c00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.379+0000 7f39bf400640 1 -- 172.21.15.114:0/2215551612 >> v2:172.21.15.153:3300/0 conn(0x7f39c0072720 msgr2=0x7f39c00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.379+0000 7f39bf400640 1 --2- 172.21.15.114:0/2215551612 >> v2:172.21.15.153:3300/0 conn(0x7f39c0072720 0x7f39c00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.379+0000 7f39bf400640 1 -- 172.21.15.114:0/2215551612 >> v1:172.21.15.153:6789/0 conn(0x7f39c0073800 legacy=0x7f39c00c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.379+0000 7f39bf400640 1 -- 172.21.15.114:0/2215551612 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00c58f0 con 0x7f39c01585c0 2024-05-09T00:09:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.379+0000 7f39b7e00640 1 --2- 172.21.15.114:0/2215551612 >> v2:172.21.15.153:3300/0 conn(0x7f39c0072720 0x7f39c00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.380+0000 7f39bf400640 1 --2- 172.21.15.114:0/2215551612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c01585c0 0x7f39c01589d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f39c00722f0 tx=0x7f39b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f777f89e6ceac94b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.380+0000 7f39be000640 1 -- 172.21.15.114:0/2215551612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8036070 con 0x7f39c01585c0 2024-05-09T00:09:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.380+0000 7f39be000640 1 -- 172.21.15.114:0/2215551612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8031600 con 0x7f39c01585c0 2024-05-09T00:09:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.380+0000 7f39be000640 1 -- 172.21.15.114:0/2215551612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80319d0 con 0x7f39c01585c0 2024-05-09T00:09:23.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 -- 172.21.15.114:0/2215551612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c01585c0 msgr2=0x7f39c01589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 --2- 172.21.15.114:0/2215551612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c01585c0 0x7f39c01589d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f39c00722f0 tx=0x7f39b802a6a0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 -- 172.21.15.114:0/2215551612 shutdown_connections 2024-05-09T00:09:23.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 --2- 172.21.15.114:0/2215551612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c01585c0 0x7f39c01589d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 --2- 172.21.15.114:0/2215551612 >> v2:172.21.15.153:3300/0 conn(0x7f39c0072720 0x7f39c00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 -- 172.21.15.114:0/2215551612 >> 172.21.15.114:0/2215551612 conn(0x7f39c006c680 msgr2=0x7f39c006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:23.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 -- 172.21.15.114:0/2215551612 shutdown_connections 2024-05-09T00:09:23.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.381+0000 7f39c5c00640 1 -- 172.21.15.114:0/2215551612 wait complete. 2024-05-09T00:09:23.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.384+0000 7f39c5c00640 1 Processor -- start 2024-05-09T00:09:23.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.384+0000 7f39c5c00640 1 -- start start 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39c5c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c0072720 0x7f39c014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39c5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 0x7f39c014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39c5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c01585c0 0x7f39c01488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39c5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0074320 con 0x7f39c0073800 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39c5c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0072b30 con 0x7f39c01585c0 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39c5c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f39c014c2e0 con 0x7f39c0072720 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 0x7f39c014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 0x7f39c014de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38684/0 (socket says 172.21.15.114:38684) 2024-05-09T00:09:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 -- 172.21.15.114:0/148030406 learned_addr learned my addr 172.21.15.114:0/148030406 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39bf400640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c01585c0 0x7f39c01488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39bea00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c0072720 0x7f39c014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 -- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c0072720 msgr2=0x7f39c014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c0072720 0x7f39c014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 -- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c01585c0 msgr2=0x7f39c01488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.386+0000 7f39b7e00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c01585c0 0x7f39c01488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39b7e00640 1 -- 172.21.15.114:0/148030406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0149b40 con 0x7f39c0073800 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39b7e00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 0x7f39c014de90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c7f0 tx=0x7f39a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8015070 con 0x7f39c0073800 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a80077c0 con 0x7f39c0073800 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8007b70 con 0x7f39c0073800 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c0149e20 con 0x7f39c0073800 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.387+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c014c060 con 0x7f39c0073800 2024-05-09T00:09:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.388+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c0077430 con 0x7f39c0073800 2024-05-09T00:09:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.390+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f39a8018070 con 0x7f39c0073800 2024-05-09T00:09:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.391+0000 7f39b6a00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f399c076300 0x7f399c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.391+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f39a8097950 con 0x7f39c0073800 2024-05-09T00:09:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.391+0000 7f39bea00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f399c076300 0x7f399c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.392+0000 7f39bea00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f399c076300 0x7f399c078810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39b0006fd0 tx=0x7f39b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.395+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f39a8060f70 con 0x7f39c0073800 2024-05-09T00:09:23.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.603+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f39c00c5630 con 0x7f39c0073800 2024-05-09T00:09:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.604+0000 7f39b6a00640 1 -- 172.21.15.114:0/148030406 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f39a8060870 con 0x7f39c0073800 2024-05-09T00:09:23.601 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-05-09T00:09:23.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f399c076300 msgr2=0x7f399c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f399c076300 0x7f399c078810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39b0006fd0 tx=0x7f39b0008040 comp rx=0 tx=0).stop 2024-05-09T00:09:23.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 msgr2=0x7f39c014de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 0x7f39c014de90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c7f0 tx=0x7f39a800ccb0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 shutdown_connections 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f399c076300 0x7f399c078810 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c01585c0 0x7f39c01488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c0073800 0x7f39c014de90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 --2- 172.21.15.114:0/148030406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c0072720 0x7f39c014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 >> 172.21.15.114:0/148030406 conn(0x7f39c006c680 msgr2=0x7f39c0157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 shutdown_connections 2024-05-09T00:09:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.607+0000 7f39c5c00640 1 -- 172.21.15.114:0/148030406 wait complete. 2024-05-09T00:09:23.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-09T00:09:23.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.907+0000 7f46bac00640 1 Processor -- start 2024-05-09T00:09:23.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.907+0000 7f46bac00640 1 -- start start 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46bac00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46b4154e60 0x7f46b4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46bac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46b40c4db0 0x7f46b40c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46bac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b40721a0 con 0x7f46b40af230 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46bac00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f46b4072ca0 con 0x7f46b4154e60 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46bac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f46b4158820 con 0x7f46b40c4db0 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46b8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46b4154e60 0x7f46b4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46b8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46b4154e60 0x7f46b4158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38696/0 (socket says 172.21.15.114:38696) 2024-05-09T00:09:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.909+0000 7f46b8e00640 1 -- 172.21.15.114:0/2582032289 learned_addr learned my addr 172.21.15.114:0/2582032289 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.910+0000 7f46ba200640 1 --2- 172.21.15.114:0/2582032289 >> v2:172.21.15.153:3300/0 conn(0x7f46b40c4db0 0x7f46b40c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.910+0000 7f46b8e00640 1 -- 172.21.15.114:0/2582032289 >> v2:172.21.15.153:3300/0 conn(0x7f46b40c4db0 msgr2=0x7f46b40c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.910+0000 7f46b8e00640 1 --2- 172.21.15.114:0/2582032289 >> v2:172.21.15.153:3300/0 conn(0x7f46b40c4db0 0x7f46b40c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.910+0000 7f46b8e00640 1 -- 172.21.15.114:0/2582032289 >> v1:172.21.15.153:6789/0 conn(0x7f46b40af230 legacy=0x7f46b4072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:23.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.910+0000 7f46b8e00640 1 -- 172.21.15.114:0/2582032289 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b41584f0 con 0x7f46b4154e60 2024-05-09T00:09:23.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.911+0000 7f46b8e00640 1 --2- 172.21.15.114:0/2582032289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b4154e60 0x7f46b4158cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f46b40ac4f0 tx=0x7f46a002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5fb7d8d8c18c49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.911+0000 7f46b3e00640 1 -- 172.21.15.114:0/2582032289 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0037070 con 0x7f46b4154e60 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.911+0000 7f46b3e00640 1 -- 172.21.15.114:0/2582032289 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a002ae00 con 0x7f46b4154e60 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.911+0000 7f46b3e00640 1 -- 172.21.15.114:0/2582032289 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0032660 con 0x7f46b4154e60 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 -- 172.21.15.114:0/2582032289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b4154e60 msgr2=0x7f46b4158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 --2- 172.21.15.114:0/2582032289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b4154e60 0x7f46b4158cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f46b40ac4f0 tx=0x7f46a002a0b0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 -- 172.21.15.114:0/2582032289 shutdown_connections 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 --2- 172.21.15.114:0/2582032289 >> v2:172.21.15.153:3300/0 conn(0x7f46b40c4db0 0x7f46b40c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 --2- 172.21.15.114:0/2582032289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b4154e60 0x7f46b4158cb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 -- 172.21.15.114:0/2582032289 >> 172.21.15.114:0/2582032289 conn(0x7f46b40c5ea0 msgr2=0x7f46b40c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 -- 172.21.15.114:0/2582032289 shutdown_connections 2024-05-09T00:09:23.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.912+0000 7f46bac00640 1 -- 172.21.15.114:0/2582032289 wait complete. 2024-05-09T00:09:23.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.915+0000 7f46bac00640 1 Processor -- start 2024-05-09T00:09:23.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.915+0000 7f46bac00640 1 -- start start 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.916+0000 7f46bac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 0x7f46b41ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.916+0000 7f46bac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40c4db0 0x7f46b41e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.916+0000 7f46bac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b4154e60 0x7f46b414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46bac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4155270 con 0x7f46b40af230 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46bac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40740e0 con 0x7f46b40c4db0 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46bac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f46b40743c0 con 0x7f46b4154e60 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 0x7f46b41ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 0x7f46b41ec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38704/0 (socket says 172.21.15.114:38704) 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 -- 172.21.15.114:0/1198594361 learned_addr learned my addr 172.21.15.114:0/1198594361 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b8e00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40c4db0 0x7f46b41e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 -- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b4154e60 msgr2=0x7f46b414e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b4154e60 0x7f46b414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 -- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40c4db0 msgr2=0x7f46b41e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:23.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40c4db0 0x7f46b41e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:23.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 -- 172.21.15.114:0/1198594361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b4151330 con 0x7f46b40af230 2024-05-09T00:09:23.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.917+0000 7f46b9800640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 0x7f46b41ec4a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46a800b3f0 tx=0x7f46a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.918+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8015020 con 0x7f46b40af230 2024-05-09T00:09:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.918+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a8011830 con 0x7f46b40af230 2024-05-09T00:09:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.918+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8011c20 con 0x7f46b40af230 2024-05-09T00:09:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.918+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41515a0 con 0x7f46b40af230 2024-05-09T00:09:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.918+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b406f2e0 con 0x7f46b40af230 2024-05-09T00:09:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.919+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4078430 con 0x7f46b40af230 2024-05-09T00:09:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.920+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46a8018020 con 0x7f46b40af230 2024-05-09T00:09:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.921+0000 7f46b1600640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46940762d0 0x7f46940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.921+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f46a8097620 con 0x7f46b40af230 2024-05-09T00:09:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.922+0000 7f46b8e00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46940762d0 0x7f46940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:23.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.922+0000 7f46b8e00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46940762d0 0x7f46940787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46a0034000 tx=0x7f46a002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:23.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:23.927+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f46a801f030 con 0x7f46b40af230 2024-05-09T00:09:24.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.121+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f46b4072370 con 0x7f46b40af230 2024-05-09T00:09:24.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.122+0000 7f46b1600640 1 -- 172.21.15.114:0/1198594361 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f46a8060bb0 con 0x7f46b40af230 2024-05-09T00:09:24.119 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-05-09T00:09:24.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46940762d0 msgr2=0x7f46940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46940762d0 0x7f46940787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46a0034000 tx=0x7f46a002e000 comp rx=0 tx=0).stop 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 msgr2=0x7f46b41ec4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 0x7f46b41ec4a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46a800b3f0 tx=0x7f46a800b8b0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 shutdown_connections 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46940762d0 0x7f46940787e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b4154e60 0x7f46b414e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40c4db0 0x7f46b41e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 --2- 172.21.15.114:0/1198594361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46b40af230 0x7f46b41ec4a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.124+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 >> 172.21.15.114:0/1198594361 conn(0x7f46b40c5ea0 msgr2=0x7f46b406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.125+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 shutdown_connections 2024-05-09T00:09:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.125+0000 7f46bac00640 1 -- 172.21.15.114:0/1198594361 wait complete. 2024-05-09T00:09:24.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-09T00:09:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.418+0000 7f9df9e00640 1 Processor -- start 2024-05-09T00:09:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.418+0000 7f9df9e00640 1 -- start start 2024-05-09T00:09:24.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.420+0000 7f9df9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 0x7f9df4072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.420+0000 7f9df9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9df40c4a70 0x7f9df40c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.420+0000 7f9df9e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df4074040 con 0x7f9df41585c0 2024-05-09T00:09:24.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.420+0000 7f9df9e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9df4073df0 con 0x7f9df40c4a70 2024-05-09T00:09:24.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.420+0000 7f9df9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9df40c5f40 con 0x7f9df4073800 2024-05-09T00:09:24.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.421+0000 7f9df2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 0x7f9df4072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.421+0000 7f9df2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 0x7f9df4072720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:56746/0 (socket says 172.21.15.114:56746) 2024-05-09T00:09:24.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.421+0000 7f9df2a00640 1 -- 172.21.15.114:0/284024302 learned_addr learned my addr 172.21.15.114:0/284024302 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:24.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.421+0000 7f9dea000640 1 --2- 172.21.15.114:0/284024302 >> v2:172.21.15.153:3300/0 conn(0x7f9df40c4a70 0x7f9df40c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.422+0000 7f9df2a00640 1 -- 172.21.15.114:0/284024302 >> v2:172.21.15.153:3300/0 conn(0x7f9df40c4a70 msgr2=0x7f9df40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.422+0000 7f9df2a00640 1 --2- 172.21.15.114:0/284024302 >> v2:172.21.15.153:3300/0 conn(0x7f9df40c4a70 0x7f9df40c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.422+0000 7f9df2a00640 1 -- 172.21.15.114:0/284024302 >> v1:172.21.15.153:6789/0 conn(0x7f9df41585c0 legacy=0x7f9df4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.422+0000 7f9df2a00640 1 -- 172.21.15.114:0/284024302 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df40c58f0 con 0x7f9df4073800 2024-05-09T00:09:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.423+0000 7f9df2a00640 1 --2- 172.21.15.114:0/284024302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 0x7f9df4072720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009870 tx=0x7f9de402c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=428af74458b49082 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.423+0000 7f9df2000640 1 -- 172.21.15.114:0/284024302 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4038070 con 0x7f9df4073800 2024-05-09T00:09:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df2000640 1 -- 172.21.15.114:0/284024302 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4031710 con 0x7f9df4073800 2024-05-09T00:09:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df2000640 1 -- 172.21.15.114:0/284024302 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4031ae0 con 0x7f9df4073800 2024-05-09T00:09:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df9e00640 1 -- 172.21.15.114:0/284024302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 msgr2=0x7f9df4072720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df9e00640 1 --2- 172.21.15.114:0/284024302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 0x7f9df4072720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009870 tx=0x7f9de402c480 comp rx=0 tx=0).stop 2024-05-09T00:09:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df9e00640 1 -- 172.21.15.114:0/284024302 shutdown_connections 2024-05-09T00:09:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df9e00640 1 --2- 172.21.15.114:0/284024302 >> v2:172.21.15.153:3300/0 conn(0x7f9df40c4a70 0x7f9df40c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df9e00640 1 --2- 172.21.15.114:0/284024302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df4073800 0x7f9df4072720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.424+0000 7f9df9e00640 1 -- 172.21.15.114:0/284024302 >> 172.21.15.114:0/284024302 conn(0x7f9df406c680 msgr2=0x7f9df406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.425+0000 7f9df9e00640 1 -- 172.21.15.114:0/284024302 shutdown_connections 2024-05-09T00:09:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.425+0000 7f9df9e00640 1 -- 172.21.15.114:0/284024302 wait complete. 2024-05-09T00:09:24.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.427+0000 7f9df9e00640 1 Processor -- start 2024-05-09T00:09:24.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.427+0000 7f9df9e00640 1 -- start start 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.428+0000 7f9df9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4073800 0x7f9df41edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.428+0000 7f9df9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 0x7f9df4150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.428+0000 7f9df9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df41585c0 0x7f9df414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.428+0000 7f9df9e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4074320 con 0x7f9df40c4a70 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.428+0000 7f9df9e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9df40c4e80 con 0x7f9df4073800 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.428+0000 7f9df9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9df414e7f0 con 0x7f9df41585c0 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 0x7f9df4150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 0x7f9df4150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38708/0 (socket says 172.21.15.114:38708) 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 -- 172.21.15.114:0/3629886224 learned_addr learned my addr 172.21.15.114:0/3629886224 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9df2a00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4073800 0x7f9df41edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 -- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df41585c0 msgr2=0x7f9df414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df41585c0 0x7f9df414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 -- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4073800 msgr2=0x7f9df41edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4073800 0x7f9df41edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 -- 172.21.15.114:0/3629886224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df4154ba0 con 0x7f9df40c4a70 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.429+0000 7f9dea000640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 0x7f9df4150490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00e870 tx=0x7f9ddc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.430+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc017070 con 0x7f9df40c4a70 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.430+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc00c940 con 0x7f9df40c4a70 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.430+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc00cd30 con 0x7f9df40c4a70 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.430+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df4154e80 con 0x7f9df40c4a70 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.430+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df4155440 con 0x7f9df40c4a70 2024-05-09T00:09:24.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.431+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df4077430 con 0x7f9df40c4a70 2024-05-09T00:09:24.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.432+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ddc01a070 con 0x7f9df40c4a70 2024-05-09T00:09:24.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.433+0000 7f9debe00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9dd0076300 0x7f9dd0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.434+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f9ddc097b50 con 0x7f9df40c4a70 2024-05-09T00:09:24.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.434+0000 7f9df2a00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9dd0076300 0x7f9dd0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.435+0000 7f9df2a00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9dd0076300 0x7f9dd0078810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9de4035000 tx=0x7f9de4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:24.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.438+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ddc061170 con 0x7f9df40c4a70 2024-05-09T00:09:24.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.644+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f9df40c5630 con 0x7f9df40c4a70 2024-05-09T00:09:24.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.645+0000 7f9debe00640 1 -- 172.21.15.114:0/3629886224 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f9ddc060a70 con 0x7f9df40c4a70 2024-05-09T00:09:24.642 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-05-09T00:09:24.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9dd0076300 msgr2=0x7f9dd0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9dd0076300 0x7f9dd0078810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9de4035000 tx=0x7f9de4008030 comp rx=0 tx=0).stop 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 msgr2=0x7f9df4150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 0x7f9df4150490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00e870 tx=0x7f9ddc00ed30 comp rx=0 tx=0).stop 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 shutdown_connections 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9dd0076300 0x7f9dd0078810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9df41585c0 0x7f9df414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df40c4a70 0x7f9df4150490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 --2- 172.21.15.114:0/3629886224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4073800 0x7f9df41edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.648+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 >> 172.21.15.114:0/3629886224 conn(0x7f9df406c680 msgr2=0x7f9df4075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.649+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 shutdown_connections 2024-05-09T00:09:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.649+0000 7f9df9e00640 1 -- 172.21.15.114:0/3629886224 wait complete. 2024-05-09T00:09:24.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-09T00:09:24.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.952+0000 7ffaafe00640 1 Processor -- start 2024-05-09T00:09:24.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.952+0000 7ffaafe00640 1 -- start start 2024-05-09T00:09:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.954+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c7880 0x7ffab015c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.954+0000 7ffaafe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffab0158ad0 0x7ffab00c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.954+0000 7ffaafe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00ca9b0 con 0x7ffab00c4920 2024-05-09T00:09:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.954+0000 7ffaafe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffab00ca760 con 0x7ffab0158ad0 2024-05-09T00:09:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.954+0000 7ffaafe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffab015b640 con 0x7ffab00c7880 2024-05-09T00:09:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.955+0000 7ffaae000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffab0158ad0 0x7ffab00c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.955+0000 7ffaaea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c7880 0x7ffab015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.955+0000 7ffaae000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffab0158ad0 0x7ffab00c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:43026/0 (socket says 172.21.15.114:43026) 2024-05-09T00:09:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.955+0000 7ffaae000640 1 -- 172.21.15.114:0/2882179090 learned_addr learned my addr 172.21.15.114:0/2882179090 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.956+0000 7ffaae000640 1 -- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c7880 msgr2=0x7ffab015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.956+0000 7ffaae000640 1 --2- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c7880 0x7ffab015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.956+0000 7ffaae000640 1 -- 172.21.15.114:0/2882179090 >> v1:172.21.15.153:6789/0 conn(0x7ffab00c4920 legacy=0x7ffab006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.956+0000 7ffaae000640 1 -- 172.21.15.114:0/2882179090 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab00cac90 con 0x7ffab0158ad0 2024-05-09T00:09:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.956+0000 7ffaaea00640 1 --2- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c7880 0x7ffab015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:09:24.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.958+0000 7ffaae000640 1 --2- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00c93f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009870 tx=0x7ffa9c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02cb94c6fc2c994 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:24.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.958+0000 7ffaad600640 1 -- 172.21.15.114:0/2882179090 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c037070 con 0x7ffab0158ad0 2024-05-09T00:09:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.958+0000 7ffaad600640 1 -- 172.21.15.114:0/2882179090 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c032440 con 0x7ffab0158ad0 2024-05-09T00:09:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.958+0000 7ffaad600640 1 -- 172.21.15.114:0/2882179090 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c032810 con 0x7ffab0158ad0 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 -- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 msgr2=0x7ffab00c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 --2- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00c93f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009870 tx=0x7ffa9c02a130 comp rx=0 tx=0).stop 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 -- 172.21.15.114:0/2882179090 shutdown_connections 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 --2- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00c93f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 --2- 172.21.15.114:0/2882179090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c7880 0x7ffab015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 -- 172.21.15.114:0/2882179090 >> 172.21.15.114:0/2882179090 conn(0x7ffab00ad2a0 msgr2=0x7ffab00ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.959+0000 7ffaafe00640 1 -- 172.21.15.114:0/2882179090 shutdown_connections 2024-05-09T00:09:24.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.960+0000 7ffaafe00640 1 -- 172.21.15.114:0/2882179090 wait complete. 2024-05-09T00:09:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.962+0000 7ffaafe00640 1 Processor -- start 2024-05-09T00:09:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.963+0000 7ffaafe00640 1 -- start start 2024-05-09T00:09:24.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c4920 0x7ffab01eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 0x7ffab0153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaafe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffab015c5d0 con 0x7ffab00c7880 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaafe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffab015bc00 con 0x7ffab0158ad0 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaafe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffab00c9930 con 0x7ffab00c4920 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 0x7ffab0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 0x7ffab0153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38710/0 (socket says 172.21.15.114:38710) 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaae000640 1 -- 172.21.15.114:0/3460839829 learned_addr learned my addr 172.21.15.114:0/3460839829 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaaea00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c4920 0x7ffab01eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.965+0000 7ffaaf400640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaae000640 1 -- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c4920 msgr2=0x7ffab01eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaae000640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c4920 0x7ffab01eeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaae000640 1 -- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 msgr2=0x7ffab00704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaae000640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaae000640 1 -- 172.21.15.114:0/3460839829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01540d0 con 0x7ffab00c7880 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaaea00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c4920 0x7ffab01eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaae000640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 0x7ffab0153160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c02a170 tx=0x7ffa9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.966+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c037040 con 0x7ffab00c7880 2024-05-09T00:09:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.967+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c042070 con 0x7ffab00c7880 2024-05-09T00:09:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.967+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c030880 con 0x7ffab00c7880 2024-05-09T00:09:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.967+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab01543b0 con 0x7ffab00c7880 2024-05-09T00:09:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.967+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab0152c40 con 0x7ffab00c7880 2024-05-09T00:09:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.968+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab0078430 con 0x7ffab00c7880 2024-05-09T00:09:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.970+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa9c030a20 con 0x7ffab00c7880 2024-05-09T00:09:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.971+0000 7ffaa6a00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa90076300 0x7ffa90078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.971+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ffa9c0b8ab0 con 0x7ffab00c7880 2024-05-09T00:09:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.971+0000 7ffaaea00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa90076300 0x7ffa90078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.972+0000 7ffaaea00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa90076300 0x7ffa90078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffab00cb420 tx=0x7ffaa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:24.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:24.975+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa9c082370 con 0x7ffab00c7880 2024-05-09T00:09:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.187+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7ffab00b15f0 con 0x7ffab00c7880 2024-05-09T00:09:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.188+0000 7ffaa6a00640 1 -- 172.21.15.114:0/3460839829 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7ffa9c088070 con 0x7ffab00c7880 2024-05-09T00:09:25.184 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-05-09T00:09:25.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.190+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa90076300 msgr2=0x7ffa90078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.190+0000 7ffaafe00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa90076300 0x7ffa90078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffab00cb420 tx=0x7ffaa0008040 comp rx=0 tx=0).stop 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.190+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 msgr2=0x7ffab0153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.190+0000 7ffaafe00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 0x7ffab0153160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c02a170 tx=0x7ffa9c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 shutdown_connections 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffa90076300 0x7ffa90078810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0158ad0 0x7ffab00704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab00c7880 0x7ffab0153160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 --2- 172.21.15.114:0/3460839829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffab00c4920 0x7ffab01eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 >> 172.21.15.114:0/3460839829 conn(0x7ffab00ad2a0 msgr2=0x7ffab015aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 shutdown_connections 2024-05-09T00:09:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.191+0000 7ffaafe00640 1 -- 172.21.15.114:0/3460839829 wait complete. 2024-05-09T00:09:25.211 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-05-09T00:09:25.212 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:25.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.472+0000 7f6e91400640 1 Processor -- start 2024-05-09T00:09:25.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.473+0000 7f6e91400640 1 -- start start 2024-05-09T00:09:25.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e91400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e8c0c0560 0x7f6e8c155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e91400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06c680 0x7f6e8c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e91400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6e8c15b830 0x7f6e8c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e91400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8c1585d0 con 0x7f6e8c0c0560 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e91400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8c1588b0 con 0x7f6e8c15b830 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e91400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e8c158b90 con 0x7f6e8c06c680 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e8c0c0560 0x7f6e8c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e8c0c0560 0x7f6e8c155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38720/0 (socket says 172.21.15.114:38720) 2024-05-09T00:09:25.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 -- 172.21.15.114:0/253208431 learned_addr learned my addr 172.21.15.114:0/253208431 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8b200640 1 --2- 172.21.15.114:0/253208431 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c15b830 0x7f6e8c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e89e00640 1 --2- 172.21.15.114:0/253208431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06c680 0x7f6e8c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 -- 172.21.15.114:0/253208431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06c680 msgr2=0x7f6e8c06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 --2- 172.21.15.114:0/253208431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06c680 0x7f6e8c06ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 -- 172.21.15.114:0/253208431 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c15b830 msgr2=0x7f6e8c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.475+0000 7f6e8a800640 1 --2- 172.21.15.114:0/253208431 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c15b830 0x7f6e8c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.476+0000 7f6e8a800640 1 -- 172.21.15.114:0/253208431 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c06d530 con 0x7f6e8c0c0560 2024-05-09T00:09:25.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.476+0000 7f6e8b200640 1 --2- 172.21.15.114:0/253208431 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c15b830 0x7f6e8c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:25.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.477+0000 7f6e8a800640 1 --2- 172.21.15.114:0/253208431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c0c0560 0x7f6e8c155950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c06d760 tx=0x7f6e7c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e50449a164fa761 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:25.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.477+0000 7f6e89400640 1 -- 172.21.15.114:0/253208431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c037070 con 0x7f6e8c0c0560 2024-05-09T00:09:25.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.477+0000 7f6e89400640 1 -- 172.21.15.114:0/253208431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c032440 con 0x7f6e8c0c0560 2024-05-09T00:09:25.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.477+0000 7f6e89400640 1 -- 172.21.15.114:0/253208431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c032810 con 0x7f6e8c0c0560 2024-05-09T00:09:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 -- 172.21.15.114:0/253208431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c0c0560 msgr2=0x7f6e8c155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 --2- 172.21.15.114:0/253208431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c0c0560 0x7f6e8c155950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c06d760 tx=0x7f6e7c02a1c0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 -- 172.21.15.114:0/253208431 shutdown_connections 2024-05-09T00:09:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 --2- 172.21.15.114:0/253208431 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c15b830 0x7f6e8c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 --2- 172.21.15.114:0/253208431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06c680 0x7f6e8c06ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 --2- 172.21.15.114:0/253208431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c0c0560 0x7f6e8c155950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 -- 172.21.15.114:0/253208431 >> 172.21.15.114:0/253208431 conn(0x7f6e8c0c7170 msgr2=0x7f6e8c0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:25.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 -- 172.21.15.114:0/253208431 shutdown_connections 2024-05-09T00:09:25.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.478+0000 7f6e91400640 1 -- 172.21.15.114:0/253208431 wait complete. 2024-05-09T00:09:25.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.480+0000 7f6e91400640 1 Processor -- start 2024-05-09T00:09:25.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.481+0000 7f6e91400640 1 -- start start 2024-05-09T00:09:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e91400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 0x7f6e8c1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e91400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c0c0560 0x7f6e8c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e91400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c15b830 0x7f6e8c147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e91400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c074810 con 0x7f6e8c06c680 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e91400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c0acc30 con 0x7f6e8c15b830 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e91400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e8c074990 con 0x7f6e8c0c0560 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e8a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 0x7f6e8c1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e8a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 0x7f6e8c1509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38724/0 (socket says 172.21.15.114:38724) 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.482+0000 7f6e8a800640 1 -- 172.21.15.114:0/2861840912 learned_addr learned my addr 172.21.15.114:0/2861840912 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e8a800640 1 -- 172.21.15.114:0/2861840912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c0c0560 msgr2=0x7f6e8c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e8a800640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c0c0560 0x7f6e8c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e8a800640 1 -- 172.21.15.114:0/2861840912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c15b830 msgr2=0x7f6e8c147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e8a800640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c15b830 0x7f6e8c147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e8a800640 1 -- 172.21.15.114:0/2861840912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c1537a0 con 0x7f6e8c06c680 2024-05-09T00:09:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e8a800640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 0x7f6e8c1509a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c000c00 tx=0x7f6e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.483+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c037040 con 0x7f6e8c06c680 2024-05-09T00:09:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.484+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c042070 con 0x7f6e8c06c680 2024-05-09T00:09:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.484+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c030bb0 con 0x7f6e8c06c680 2024-05-09T00:09:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.484+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c159650 con 0x7f6e8c06c680 2024-05-09T00:09:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.484+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c153d40 con 0x7f6e8c06c680 2024-05-09T00:09:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.485+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8c154120 con 0x7f6e8c06c680 2024-05-09T00:09:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.486+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e7c02ad10 con 0x7f6e8c06c680 2024-05-09T00:09:25.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.487+0000 7f6e82a00640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e68076300 0x7f6e68078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:25.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.488+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6e7c0b82c0 con 0x7f6e8c06c680 2024-05-09T00:09:25.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.488+0000 7f6e89e00640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e68076300 0x7f6e68078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.488+0000 7f6e89e00640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e68076300 0x7f6e68078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c152530 tx=0x7f6e74008200 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.492+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6e8c154120 con 0x7f6e8c06c680 2024-05-09T00:09:25.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.739+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e8c077430 con 0x7f6e8c06c680 2024-05-09T00:09:25.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.740+0000 7f6e82a00640 1 -- 172.21.15.114:0/2861840912 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f6e7c0818f0 con 0x7f6e8c06c680 2024-05-09T00:09:25.737 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:25.737 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:25.737 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e68076300 msgr2=0x7f6e68078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e68076300 0x7f6e68078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c152530 tx=0x7f6e74008200 comp rx=0 tx=0).stop 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 msgr2=0x7f6e8c1509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 0x7f6e8c1509a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c000c00 tx=0x7f6e7c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 shutdown_connections 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e68076300 0x7f6e68078810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c15b830 0x7f6e8c147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c0c0560 0x7f6e8c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 --2- 172.21.15.114:0/2861840912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e8c06c680 0x7f6e8c1509a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:25.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 >> 172.21.15.114:0/2861840912 conn(0x7f6e8c0c7170 msgr2=0x7f6e8c075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:25.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 shutdown_connections 2024-05-09T00:09:25.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:25.743+0000 7f6e91400640 1 -- 172.21.15.114:0/2861840912 wait complete. 2024-05-09T00:09:25.766 INFO:tasks.mds_thrash:Ready to start thrashing 2024-05-09T00:09:25.766 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-05-09T00:09:25.766 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:26.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.036+0000 7fcd6bc00640 1 Processor -- start 2024-05-09T00:09:26.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.036+0000 7fcd6bc00640 1 -- start start 2024-05-09T00:09:26.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.038+0000 7fcd6bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 0x7fcd640c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.038+0000 7fcd6bc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd64074040 con 0x7fcd64073800 2024-05-09T00:09:26.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.038+0000 7fcd6bc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd640c58f0 con 0x7fcd641585c0 2024-05-09T00:09:26.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.038+0000 7fcd6bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd64073df0 con 0x7fcd64072720 2024-05-09T00:09:26.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.038+0000 7fcd69200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcd64073800 0x7fcd640c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41782/0 (socket says 172.21.15.114:41782) 2024-05-09T00:09:26.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.038+0000 7fcd69200640 1 -- 172.21.15.114:0/2678576478 learned_addr learned my addr 172.21.15.114:0/2678576478 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:26.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747454058 0 0) 0x7fcd64074040 con 0x7fcd64073800 2024-05-09T00:09:26.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd48003520 con 0x7fcd64073800 2024-05-09T00:09:26.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd5be00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 0x7fcd640c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2275179152 0 0) 0x7fcd48003520 con 0x7fcd64073800 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 msgr2=0x7fcd640c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 0x7fcd640c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 >> v1:172.21.15.153:6789/0 conn(0x7fcd641585c0 legacy=0x7fcd6415f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd640c5bd0 con 0x7fcd64073800 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fcd540016f0 con 0x7fcd64073800 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 >> v1:172.21.15.114:6789/0 conn(0x7fcd64073800 legacy=0x7fcd640c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.039+0000 7fcd63e00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48003ad0 0x7fcd48003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd63e00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 0x7fcd48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd63e00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd48004f40 0x7fcd4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd64073df0 con 0x7fcd48004f40 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48005620 con 0x7fcd48003ad0 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4800e140 con 0x7fcd64072720 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69c00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd48004f40 0x7fcd4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd5be00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 0x7fcd48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69c00640 1 -- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 msgr2=0x7fcd48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69200640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48003ad0 0x7fcd48003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69c00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd64072720 0x7fcd48004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69c00640 1 -- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48003ad0 msgr2=0x7fcd48003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69c00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48003ad0 0x7fcd48003f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.040+0000 7fcd69c00640 1 -- 172.21.15.114:0/2678576478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd48003520 con 0x7fcd48004f40 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.041+0000 7fcd69c00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd48004f40 0x7fcd4800b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd640c6cd0 tx=0x7fcd48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62d58109d2f5273 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c001a50 con 0x7fcd48004f40 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd5c02adb0 con 0x7fcd48004f40 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd63e00640 1 -- 172.21.15.114:0/2678576478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c003b70 con 0x7fcd48004f40 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2678576478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd48004f40 msgr2=0x7fcd4800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2678576478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd48004f40 0x7fcd4800b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd640c6cd0 tx=0x7fcd48005830 comp rx=0 tx=0).stop 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd69c00640 1 -- 172.21.15.114:0/2678576478 reap_dead start 2024-05-09T00:09:26.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2678576478 shutdown_connections 2024-05-09T00:09:26.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.042+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2678576478 >> 172.21.15.114:0/2678576478 conn(0x7fcd6406c680 msgr2=0x7fcd6406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:26.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.043+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2678576478 shutdown_connections 2024-05-09T00:09:26.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.043+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2678576478 wait complete. 2024-05-09T00:09:26.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.045+0000 7fcd6bc00640 1 Processor -- start 2024-05-09T00:09:26.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.045+0000 7fcd6bc00640 1 -- start start 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd6bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48004f40 0x7fcd64148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd6bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 0x7fcd641f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd6bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd6414a010 0x7fcd6414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd6bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd64074320 con 0x7fcd64148890 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd6bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd640c5f40 con 0x7fcd48004f40 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd6bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcd641ee260 con 0x7fcd6414a010 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.046+0000 7fcd5be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 0x7fcd641f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 0x7fcd641f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38746/0 (socket says 172.21.15.114:38746) 2024-05-09T00:09:26.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 -- 172.21.15.114:0/2372438625 learned_addr learned my addr 172.21.15.114:0/2372438625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 -- 172.21.15.114:0/2372438625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd6414a010 msgr2=0x7fcd6414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd6414a010 0x7fcd6414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 -- 172.21.15.114:0/2372438625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48004f40 msgr2=0x7fcd64148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48004f40 0x7fcd64148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 -- 172.21.15.114:0/2372438625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd641edd90 con 0x7fcd64148890 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd5be00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 0x7fcd641f1b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e7e0 tx=0x7fcd4c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c017070 con 0x7fcd64148890 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.047+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00c5f0 con 0x7fcd64148890 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.048+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00f040 con 0x7fcd64148890 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.048+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6414ed10 con 0x7fcd64148890 2024-05-09T00:09:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.048+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6414da90 con 0x7fcd64148890 2024-05-09T00:09:26.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.049+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd64077430 con 0x7fcd64148890 2024-05-09T00:09:26.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.050+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcd4c01a070 con 0x7fcd64148890 2024-05-09T00:09:26.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.052+0000 7fcd61600640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcd400762d0 0x7fcd400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.052+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fcd4c097520 con 0x7fcd64148890 2024-05-09T00:09:26.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.052+0000 7fcd69200640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcd400762d0 0x7fcd400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.053+0000 7fcd69200640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcd400762d0 0x7fcd400787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd540079b0 tx=0x7fcd54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.056+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcd4c060ab0 con 0x7fcd64148890 2024-05-09T00:09:26.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.259+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd6414f050 con 0x7fcd400762d0 2024-05-09T00:09:26.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.283+0000 7fcd61600640 1 -- 172.21.15.114:0/2372438625 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490327 (secure 0 0 0) 0x7fcd6414f050 con 0x7fcd400762d0 2024-05-09T00:09:26.287 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:26.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcd400762d0 msgr2=0x7fcd400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcd400762d0 0x7fcd400787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd540079b0 tx=0x7fcd54009040 comp rx=0 tx=0).stop 2024-05-09T00:09:26.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 msgr2=0x7fcd641f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 0x7fcd641f1b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e7e0 tx=0x7fcd4c00eca0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 shutdown_connections 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcd400762d0 0x7fcd400787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd6414a010 0x7fcd6414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd64148890 0x7fcd641f1b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 --2- 172.21.15.114:0/2372438625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd48004f40 0x7fcd64148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.291+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 >> 172.21.15.114:0/2372438625 conn(0x7fcd6406c680 msgr2=0x7fcd6406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.292+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 shutdown_connections 2024-05-09T00:09:26.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.292+0000 7fcd6bc00640 1 -- 172.21.15.114:0/2372438625 wait complete. 2024-05-09T00:09:26.319 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-05-09T00:09:24.302464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597678,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3481600,"data_stored":2030334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2490,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004767"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478651+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:58.478651+0000","last_peered":"2024-05-09T00:08:58.478651+0000","last_clean":"2024-05-09T00:08:58.478651+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:58.478651+0000","last_undegraded":"2024-05-09T00:08:58.478651+0000","last_fullsized":"2024-05-09T00:08:58.478651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476848+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:58.476848+0000","last_peered":"2024-05-09T00:08:58.476848+0000","last_clean":"2024-05-09T00:08:58.476848+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:58.476848+0000","last_undegraded":"2024-05-09T00:08:58.476848+0000","last_fullsized":"2024-05-09T00:08:58.476848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481099+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:58.481099+0000","last_peered":"2024-05-09T00:08:58.481099+0000","last_clean":"2024-05-09T00:08:58.481099+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:58.481099+0000","last_undegraded":"2024-05-09T00:08:58.481099+0000","last_fullsized":"2024-05-09T00:08:58.481099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480820+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:58.480820+0000","last_peered":"2024-05-09T00:08:58.480820+0000","last_clean":"2024-05-09T00:08:58.480820+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:58.480820+0000","last_undegraded":"2024-05-09T00:08:58.480820+0000","last_fullsized":"2024-05-09T00:08:58.480820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479058+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:58.479058+0000","last_peered":"2024-05-09T00:08:58.479058+0000","last_clean":"2024-05-09T00:08:58.479058+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:58.479058+0000","last_undegraded":"2024-05-09T00:08:58.479058+0000","last_fullsized":"2024-05-09T00:08:58.479058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480776+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:58.480776+0000","last_peered":"2024-05-09T00:08:58.480776+0000","last_clean":"2024-05-09T00:08:58.480776+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:58.480776+0000","last_undegraded":"2024-05-09T00:08:58.480776+0000","last_fullsized":"2024-05-09T00:08:58.480776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478159+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:58.478159+0000","last_peered":"2024-05-09T00:08:58.478159+0000","last_clean":"2024-05-09T00:08:58.478159+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:58.478159+0000","last_undegraded":"2024-05-09T00:08:58.478159+0000","last_fullsized":"2024-05-09T00:08:58.478159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475636+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:58.475636+0000","last_peered":"2024-05-09T00:08:58.475636+0000","last_clean":"2024-05-09T00:08:58.475636+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:58.475636+0000","last_undegraded":"2024-05-09T00:08:58.475636+0000","last_fullsized":"2024-05-09T00:08:58.475636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483407+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:58.483407+0000","last_peered":"2024-05-09T00:08:58.483407+0000","last_clean":"2024-05-09T00:08:58.483407+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:58.483407+0000","last_undegraded":"2024-05-09T00:08:58.483407+0000","last_fullsized":"2024-05-09T00:08:58.483407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480021+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:58.480021+0000","last_peered":"2024-05-09T00:08:58.480021+0000","last_clean":"2024-05-09T00:08:58.480021+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:58.480021+0000","last_undegraded":"2024-05-09T00:08:58.480021+0000","last_fullsized":"2024-05-09T00:08:58.480021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476066+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:58.476066+0000","last_peered":"2024-05-09T00:08:58.476066+0000","last_clean":"2024-05-09T00:08:58.476066+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:58.476066+0000","last_undegraded":"2024-05-09T00:08:58.476066+0000","last_fullsized":"2024-05-09T00:08:58.476066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483024+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:58.483024+0000","last_peered":"2024-05-09T00:08:58.483024+0000","last_clean":"2024-05-09T00:08:58.483024+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:58.483024+0000","last_undegraded":"2024-05-09T00:08:58.483024+0000","last_fullsized":"2024-05-09T00:08:58.483024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478064+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:58.478064+0000","last_peered":"2024-05-09T00:08:58.478064+0000","last_clean":"2024-05-09T00:08:58.478064+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:58.478064+0000","last_undegraded":"2024-05-09T00:08:58.478064+0000","last_fullsized":"2024-05-09T00:08:58.478064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477477+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:58.477477+0000","last_peered":"2024-05-09T00:08:58.477477+0000","last_clean":"2024-05-09T00:08:58.477477+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:58.477477+0000","last_undegraded":"2024-05-09T00:08:58.477477+0000","last_fullsized":"2024-05-09T00:08:58.477477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480993+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:58.480993+0000","last_peered":"2024-05-09T00:08:58.480993+0000","last_clean":"2024-05-09T00:08:58.480993+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:58.480993+0000","last_undegraded":"2024-05-09T00:08:58.480993+0000","last_fullsized":"2024-05-09T00:08:58.480993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478741+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:58.478741+0000","last_peered":"2024-05-09T00:08:58.478741+0000","last_clean":"2024-05-09T00:08:58.478741+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:58.478741+0000","last_undegraded":"2024-05-09T00:08:58.478741+0000","last_fullsized":"2024-05-09T00:08:58.478741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478705+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:58.478705+0000","last_peered":"2024-05-09T00:08:58.478705+0000","last_clean":"2024-05-09T00:08:58.478705+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:58.478705+0000","last_undegraded":"2024-05-09T00:08:58.478705+0000","last_fullsized":"2024-05-09T00:08:58.478705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483900+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:58.483900+0000","last_peered":"2024-05-09T00:08:58.483900+0000","last_clean":"2024-05-09T00:08:58.483900+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:58.483900+0000","last_undegraded":"2024-05-09T00:08:58.483900+0000","last_fullsized":"2024-05-09T00:08:58.483900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479091+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:58.479091+0000","last_peered":"2024-05-09T00:08:58.479091+0000","last_clean":"2024-05-09T00:08:58.479091+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:58.479091+0000","last_undegraded":"2024-05-09T00:08:58.479091+0000","last_fullsized":"2024-05-09T00:08:58.479091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477426+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:58.477426+0000","last_peered":"2024-05-09T00:08:58.477426+0000","last_clean":"2024-05-09T00:08:58.477426+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:58.477426+0000","last_undegraded":"2024-05-09T00:08:58.477426+0000","last_fullsized":"2024-05-09T00:08:58.477426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:09:21.137343+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:09:21.137343+0000","last_peered":"2024-05-09T00:09:21.137343+0000","last_clean":"2024-05-09T00:09:21.137343+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:09:21.137343+0000","last_undegraded":"2024-05-09T00:09:21.137343+0000","last_fullsized":"2024-05-09T00:09:21.137343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476732+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:58.476732+0000","last_peered":"2024-05-09T00:08:58.476732+0000","last_clean":"2024-05-09T00:08:58.476732+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:58.476732+0000","last_undegraded":"2024-05-09T00:08:58.476732+0000","last_fullsized":"2024-05-09T00:08:58.476732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:09:16.473330+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:09:16.473330+0000","last_peered":"2024-05-09T00:09:16.473330+0000","last_clean":"2024-05-09T00:09:16.473330+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:09:16.473330+0000","last_undegraded":"2024-05-09T00:09:16.473330+0000","last_fullsized":"2024-05-09T00:09:16.473330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481463+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:58.481463+0000","last_peered":"2024-05-09T00:08:58.481463+0000","last_clean":"2024-05-09T00:08:58.481463+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:58.481463+0000","last_undegraded":"2024-05-09T00:08:58.481463+0000","last_fullsized":"2024-05-09T00:08:58.481463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477387+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:58.477387+0000","last_peered":"2024-05-09T00:08:58.477387+0000","last_clean":"2024-05-09T00:08:58.477387+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:58.477387+0000","last_undegraded":"2024-05-09T00:08:58.477387+0000","last_fullsized":"2024-05-09T00:08:58.477387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478333+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:58.478333+0000","last_peered":"2024-05-09T00:08:58.478333+0000","last_clean":"2024-05-09T00:08:58.478333+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:58.478333+0000","last_undegraded":"2024-05-09T00:08:58.478333+0000","last_fullsized":"2024-05-09T00:08:58.478333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483817+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:58.483817+0000","last_peered":"2024-05-09T00:08:58.483817+0000","last_clean":"2024-05-09T00:08:58.483817+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:58.483817+0000","last_undegraded":"2024-05-09T00:08:58.483817+0000","last_fullsized":"2024-05-09T00:08:58.483817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483648+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:58.483648+0000","last_peered":"2024-05-09T00:08:58.483648+0000","last_clean":"2024-05-09T00:08:58.483648+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:58.483648+0000","last_undegraded":"2024-05-09T00:08:58.483648+0000","last_fullsized":"2024-05-09T00:08:58.483648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482784+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:58.482784+0000","last_peered":"2024-05-09T00:08:58.482784+0000","last_clean":"2024-05-09T00:08:58.482784+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:58.482784+0000","last_undegraded":"2024-05-09T00:08:58.482784+0000","last_fullsized":"2024-05-09T00:08:58.482784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479553+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:58.479553+0000","last_peered":"2024-05-09T00:08:58.479553+0000","last_clean":"2024-05-09T00:08:58.479553+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:58.479553+0000","last_undegraded":"2024-05-09T00:08:58.479553+0000","last_fullsized":"2024-05-09T00:08:58.479553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482839+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:58.482839+0000","last_peered":"2024-05-09T00:08:58.482839+0000","last_clean":"2024-05-09T00:08:58.482839+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:58.482839+0000","last_undegraded":"2024-05-09T00:08:58.482839+0000","last_fullsized":"2024-05-09T00:08:58.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475873+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:58.475873+0000","last_peered":"2024-05-09T00:08:58.475873+0000","last_clean":"2024-05-09T00:08:58.475873+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:58.475873+0000","last_undegraded":"2024-05-09T00:08:58.475873+0000","last_fullsized":"2024-05-09T00:08:58.475873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476268+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:58.476268+0000","last_peered":"2024-05-09T00:08:58.476268+0000","last_clean":"2024-05-09T00:08:58.476268+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:58.476268+0000","last_undegraded":"2024-05-09T00:08:58.476268+0000","last_fullsized":"2024-05-09T00:08:58.476268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:59.670906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483620+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:58.483620+0000","last_peered":"2024-05-09T00:08:58.483620+0000","last_clean":"2024-05-09T00:08:58.483620+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:58.483620+0000","last_undegraded":"2024-05-09T00:08:58.483620+0000","last_fullsized":"2024-05-09T00:08:58.483620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480061+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:58.480061+0000","last_peered":"2024-05-09T00:08:58.480061+0000","last_clean":"2024-05-09T00:08:58.480061+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:58.480061+0000","last_undegraded":"2024-05-09T00:08:58.480061+0000","last_fullsized":"2024-05-09T00:08:58.480061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480789+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:58.480789+0000","last_peered":"2024-05-09T00:08:58.480789+0000","last_clean":"2024-05-09T00:08:58.480789+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:58.480789+0000","last_undegraded":"2024-05-09T00:08:58.480789+0000","last_fullsized":"2024-05-09T00:08:58.480789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:49.557566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478428+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:58.478428+0000","last_peered":"2024-05-09T00:08:58.478428+0000","last_clean":"2024-05-09T00:08:58.478428+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:58.478428+0000","last_undegraded":"2024-05-09T00:08:58.478428+0000","last_fullsized":"2024-05-09T00:08:58.478428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477100+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:58.477100+0000","last_peered":"2024-05-09T00:08:58.477100+0000","last_clean":"2024-05-09T00:08:58.477100+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:58.477100+0000","last_undegraded":"2024-05-09T00:08:58.477100+0000","last_fullsized":"2024-05-09T00:08:58.477100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477818+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:58.477818+0000","last_peered":"2024-05-09T00:08:58.477818+0000","last_clean":"2024-05-09T00:08:58.477818+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:58.477818+0000","last_undegraded":"2024-05-09T00:08:58.477818+0000","last_fullsized":"2024-05-09T00:08:58.477818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477905+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:58.477905+0000","last_peered":"2024-05-09T00:08:58.477905+0000","last_clean":"2024-05-09T00:08:58.477905+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:58.477905+0000","last_undegraded":"2024-05-09T00:08:58.477905+0000","last_fullsized":"2024-05-09T00:08:58.477905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476613+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:58.476613+0000","last_peered":"2024-05-09T00:08:58.476613+0000","last_clean":"2024-05-09T00:08:58.476613+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:58.476613+0000","last_undegraded":"2024-05-09T00:08:58.476613+0000","last_fullsized":"2024-05-09T00:08:58.476613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475819+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:58.475819+0000","last_peered":"2024-05-09T00:08:58.475819+0000","last_clean":"2024-05-09T00:08:58.475819+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:58.475819+0000","last_undegraded":"2024-05-09T00:08:58.475819+0000","last_fullsized":"2024-05-09T00:08:58.475819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477248+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:58.477248+0000","last_peered":"2024-05-09T00:08:58.477248+0000","last_clean":"2024-05-09T00:08:58.477248+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:58.477248+0000","last_undegraded":"2024-05-09T00:08:58.477248+0000","last_fullsized":"2024-05-09T00:08:58.477248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476388+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:58.476388+0000","last_peered":"2024-05-09T00:08:58.476388+0000","last_clean":"2024-05-09T00:08:58.476388+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:58.476388+0000","last_undegraded":"2024-05-09T00:08:58.476388+0000","last_fullsized":"2024-05-09T00:08:58.476388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483808+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:58.483808+0000","last_peered":"2024-05-09T00:08:58.483808+0000","last_clean":"2024-05-09T00:08:58.483808+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:58.483808+0000","last_undegraded":"2024-05-09T00:08:58.483808+0000","last_fullsized":"2024-05-09T00:08:58.483808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477114+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:58.477114+0000","last_peered":"2024-05-09T00:08:58.477114+0000","last_clean":"2024-05-09T00:08:58.477114+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:58.477114+0000","last_undegraded":"2024-05-09T00:08:58.477114+0000","last_fullsized":"2024-05-09T00:08:58.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481101+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:58.481101+0000","last_peered":"2024-05-09T00:08:58.481101+0000","last_clean":"2024-05-09T00:08:58.481101+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:58.481101+0000","last_undegraded":"2024-05-09T00:08:58.481101+0000","last_fullsized":"2024-05-09T00:08:58.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478553+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:58.478553+0000","last_peered":"2024-05-09T00:08:58.478553+0000","last_clean":"2024-05-09T00:08:58.478553+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:58.478553+0000","last_undegraded":"2024-05-09T00:08:58.478553+0000","last_fullsized":"2024-05-09T00:08:58.478553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483038+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:58.483038+0000","last_peered":"2024-05-09T00:08:58.483038+0000","last_clean":"2024-05-09T00:08:58.483038+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:58.483038+0000","last_undegraded":"2024-05-09T00:08:58.483038+0000","last_fullsized":"2024-05-09T00:08:58.483038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479550+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:58.479550+0000","last_peered":"2024-05-09T00:08:58.479550+0000","last_clean":"2024-05-09T00:08:58.479550+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:58.479550+0000","last_undegraded":"2024-05-09T00:08:58.479550+0000","last_fullsized":"2024-05-09T00:08:58.479550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479863+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:58.479863+0000","last_peered":"2024-05-09T00:08:58.479863+0000","last_clean":"2024-05-09T00:08:58.479863+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:58.479863+0000","last_undegraded":"2024-05-09T00:08:58.479863+0000","last_fullsized":"2024-05-09T00:08:58.479863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478406+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:58.478406+0000","last_peered":"2024-05-09T00:08:58.478406+0000","last_clean":"2024-05-09T00:08:58.478406+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:58.478406+0000","last_undegraded":"2024-05-09T00:08:58.478406+0000","last_fullsized":"2024-05-09T00:08:58.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":107510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":110040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:26.327 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.629+0000 7f2fefe00640 1 Processor -- start 2024-05-09T00:09:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.630+0000 7f2fefe00640 1 -- start start 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fefe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ff00aba00 0x7f2ff00accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fefe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ff01566f0 0x7f2ff00ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fefe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff00ad340 con 0x7f2ff0156b00 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fefe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff0156260 con 0x7f2ff00aba00 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fefe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff0155f10 con 0x7f2ff01566f0 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2feea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ff00aba00 0x7f2ff00accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2feea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ff00aba00 0x7f2ff00accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38760/0 (socket says 172.21.15.114:38760) 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2feea00640 1 -- 172.21.15.114:0/1962562315 learned_addr learned my addr 172.21.15.114:0/1962562315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fef400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2ff0156b00 0x7f2ff00aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41796/0 (socket says 172.21.15.114:41796) 2024-05-09T00:09:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2fe6000640 1 --2- 172.21.15.114:0/1962562315 >> v2:172.21.15.153:3300/0 conn(0x7f2ff01566f0 0x7f2ff00ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.632+0000 7f2feea00640 1 -- 172.21.15.114:0/1962562315 >> v2:172.21.15.153:3300/0 conn(0x7f2ff01566f0 msgr2=0x7f2ff00ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.633+0000 7f2feea00640 1 --2- 172.21.15.114:0/1962562315 >> v2:172.21.15.153:3300/0 conn(0x7f2ff01566f0 0x7f2ff00ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.633+0000 7f2feea00640 1 -- 172.21.15.114:0/1962562315 >> v1:172.21.15.114:6789/0 conn(0x7f2ff0156b00 legacy=0x7f2ff00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.633+0000 7f2feea00640 1 -- 172.21.15.114:0/1962562315 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff00c4f40 con 0x7f2ff00aba00 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.633+0000 7f2fee000640 1 -- 172.21.15.114:0/1962562315 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092583636 0 0) 0x7f2ff00ad340 con 0x7f2ff0156b00 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.633+0000 7f2fe6000640 1 --2- 172.21.15.114:0/1962562315 >> v2:172.21.15.153:3300/0 conn(0x7f2ff01566f0 0x7f2ff00ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.634+0000 7f2feea00640 1 --2- 172.21.15.114:0/1962562315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00accb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00715e0 tx=0x7f2fe002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b782fba312a3ef8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.634+0000 7f2fee000640 1 -- 172.21.15.114:0/1962562315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0036070 con 0x7f2ff00aba00 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.634+0000 7f2fee000640 1 -- 172.21.15.114:0/1962562315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0031600 con 0x7f2ff00aba00 2024-05-09T00:09:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.634+0000 7f2fee000640 1 -- 172.21.15.114:0/1962562315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00319d0 con 0x7f2ff00aba00 2024-05-09T00:09:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 -- 172.21.15.114:0/1962562315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 msgr2=0x7f2ff00accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 --2- 172.21.15.114:0/1962562315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00accb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00715e0 tx=0x7f2fe002a740 comp rx=0 tx=0).stop 2024-05-09T00:09:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 -- 172.21.15.114:0/1962562315 shutdown_connections 2024-05-09T00:09:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 --2- 172.21.15.114:0/1962562315 >> v2:172.21.15.153:3300/0 conn(0x7f2ff01566f0 0x7f2ff00ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 --2- 172.21.15.114:0/1962562315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00accb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 -- 172.21.15.114:0/1962562315 >> 172.21.15.114:0/1962562315 conn(0x7f2ff00c9730 msgr2=0x7f2ff00c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:26.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 -- 172.21.15.114:0/1962562315 shutdown_connections 2024-05-09T00:09:26.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.635+0000 7f2fefe00640 1 -- 172.21.15.114:0/1962562315 wait complete. 2024-05-09T00:09:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.637+0000 7f2fefe00640 1 Processor -- start 2024-05-09T00:09:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.637+0000 7f2fefe00640 1 -- start start 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.638+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ff01566f0 0x7f2ff01eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ff0156b00 0x7f2ff01e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2fefe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff00af470 con 0x7f2ff00aba00 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2fefe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff00c4920 con 0x7f2ff01566f0 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2fefe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff013e830 con 0x7f2ff0156b00 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38768/0 (socket says 172.21.15.114:38768) 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 -- 172.21.15.114:0/41501117 learned_addr learned my addr 172.21.15.114:0/41501117 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 -- 172.21.15.114:0/41501117 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ff0156b00 msgr2=0x7f2ff01e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ff0156b00 0x7f2ff01e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 -- 172.21.15.114:0/41501117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ff01566f0 msgr2=0x7f2ff01eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ff01566f0 0x7f2ff01eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.639+0000 7f2feea00640 1 -- 172.21.15.114:0/41501117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff01ef8a0 con 0x7f2ff00aba00 2024-05-09T00:09:26.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.640+0000 7f2feea00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00c8360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009f40 tx=0x7f2fe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.640+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0036050 con 0x7f2ff00aba00 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.640+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0042070 con 0x7f2ff00aba00 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.640+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0009510 con 0x7f2ff00aba00 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.640+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff00c7b60 con 0x7f2ff00aba00 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.640+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff0135530 con 0x7f2ff00aba00 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.641+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff0078430 con 0x7f2ff00aba00 2024-05-09T00:09:26.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.642+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fe0007c50 con 0x7f2ff00aba00 2024-05-09T00:09:26.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.643+0000 7f2fe7400640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fcc0762d0 0x7f2fcc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:26.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.643+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f2fe00b8970 con 0x7f2ff00aba00 2024-05-09T00:09:26.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.643+0000 7f2fe6000640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fcc0762d0 0x7f2fcc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:26.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.644+0000 7f2fe6000640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fcc0762d0 0x7f2fcc0787e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8006fd0 tx=0x7f2fd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:26.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.648+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fe0081f90 con 0x7f2ff00aba00 2024-05-09T00:09:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.848+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ff01539e0 con 0x7f2fcc0762d0 2024-05-09T00:09:26.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.865+0000 7f2fe7400640 1 -- 172.21.15.114:0/41501117 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490327 (secure 0 0 0) 0x7f2ff01539e0 con 0x7f2fcc0762d0 2024-05-09T00:09:26.869 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:26.872 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fcc0762d0 msgr2=0x7f2fcc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fcc0762d0 0x7f2fcc0787e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8006fd0 tx=0x7f2fd8008040 comp rx=0 tx=0).stop 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 msgr2=0x7f2ff00c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00c8360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009f40 tx=0x7f2fe0004a40 comp rx=0 tx=0).stop 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 shutdown_connections 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2fcc0762d0 0x7f2fcc0787e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ff0156b00 0x7f2ff01e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ff01566f0 0x7f2ff01eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 --2- 172.21.15.114:0/41501117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ff00aba00 0x7f2ff00c8360 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 >> 172.21.15.114:0/41501117 conn(0x7f2ff00c9730 msgr2=0x7f2ff0154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 shutdown_connections 2024-05-09T00:09:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:26.875+0000 7f2fefe00640 1 -- 172.21.15.114:0/41501117 wait complete. 2024-05-09T00:09:26.898 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-09T00:09:26.303493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597678,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3481600,"data_stored":2030334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2490,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005095"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478651+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:58.478651+0000","last_peered":"2024-05-09T00:08:58.478651+0000","last_clean":"2024-05-09T00:08:58.478651+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:58.478651+0000","last_undegraded":"2024-05-09T00:08:58.478651+0000","last_fullsized":"2024-05-09T00:08:58.478651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476848+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:58.476848+0000","last_peered":"2024-05-09T00:08:58.476848+0000","last_clean":"2024-05-09T00:08:58.476848+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:58.476848+0000","last_undegraded":"2024-05-09T00:08:58.476848+0000","last_fullsized":"2024-05-09T00:08:58.476848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481099+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:58.481099+0000","last_peered":"2024-05-09T00:08:58.481099+0000","last_clean":"2024-05-09T00:08:58.481099+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:58.481099+0000","last_undegraded":"2024-05-09T00:08:58.481099+0000","last_fullsized":"2024-05-09T00:08:58.481099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480820+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:58.480820+0000","last_peered":"2024-05-09T00:08:58.480820+0000","last_clean":"2024-05-09T00:08:58.480820+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:58.480820+0000","last_undegraded":"2024-05-09T00:08:58.480820+0000","last_fullsized":"2024-05-09T00:08:58.480820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479058+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:58.479058+0000","last_peered":"2024-05-09T00:08:58.479058+0000","last_clean":"2024-05-09T00:08:58.479058+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:58.479058+0000","last_undegraded":"2024-05-09T00:08:58.479058+0000","last_fullsized":"2024-05-09T00:08:58.479058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480776+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:58.480776+0000","last_peered":"2024-05-09T00:08:58.480776+0000","last_clean":"2024-05-09T00:08:58.480776+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:58.480776+0000","last_undegraded":"2024-05-09T00:08:58.480776+0000","last_fullsized":"2024-05-09T00:08:58.480776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478159+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:58.478159+0000","last_peered":"2024-05-09T00:08:58.478159+0000","last_clean":"2024-05-09T00:08:58.478159+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:58.478159+0000","last_undegraded":"2024-05-09T00:08:58.478159+0000","last_fullsized":"2024-05-09T00:08:58.478159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475636+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:58.475636+0000","last_peered":"2024-05-09T00:08:58.475636+0000","last_clean":"2024-05-09T00:08:58.475636+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:58.475636+0000","last_undegraded":"2024-05-09T00:08:58.475636+0000","last_fullsized":"2024-05-09T00:08:58.475636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483407+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:58.483407+0000","last_peered":"2024-05-09T00:08:58.483407+0000","last_clean":"2024-05-09T00:08:58.483407+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:58.483407+0000","last_undegraded":"2024-05-09T00:08:58.483407+0000","last_fullsized":"2024-05-09T00:08:58.483407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480021+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:58.480021+0000","last_peered":"2024-05-09T00:08:58.480021+0000","last_clean":"2024-05-09T00:08:58.480021+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:58.480021+0000","last_undegraded":"2024-05-09T00:08:58.480021+0000","last_fullsized":"2024-05-09T00:08:58.480021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476066+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:58.476066+0000","last_peered":"2024-05-09T00:08:58.476066+0000","last_clean":"2024-05-09T00:08:58.476066+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:58.476066+0000","last_undegraded":"2024-05-09T00:08:58.476066+0000","last_fullsized":"2024-05-09T00:08:58.476066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483024+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:58.483024+0000","last_peered":"2024-05-09T00:08:58.483024+0000","last_clean":"2024-05-09T00:08:58.483024+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:58.483024+0000","last_undegraded":"2024-05-09T00:08:58.483024+0000","last_fullsized":"2024-05-09T00:08:58.483024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478064+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:58.478064+0000","last_peered":"2024-05-09T00:08:58.478064+0000","last_clean":"2024-05-09T00:08:58.478064+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:58.478064+0000","last_undegraded":"2024-05-09T00:08:58.478064+0000","last_fullsized":"2024-05-09T00:08:58.478064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477477+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:58.477477+0000","last_peered":"2024-05-09T00:08:58.477477+0000","last_clean":"2024-05-09T00:08:58.477477+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:58.477477+0000","last_undegraded":"2024-05-09T00:08:58.477477+0000","last_fullsized":"2024-05-09T00:08:58.477477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480993+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:58.480993+0000","last_peered":"2024-05-09T00:08:58.480993+0000","last_clean":"2024-05-09T00:08:58.480993+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:58.480993+0000","last_undegraded":"2024-05-09T00:08:58.480993+0000","last_fullsized":"2024-05-09T00:08:58.480993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478741+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:58.478741+0000","last_peered":"2024-05-09T00:08:58.478741+0000","last_clean":"2024-05-09T00:08:58.478741+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:58.478741+0000","last_undegraded":"2024-05-09T00:08:58.478741+0000","last_fullsized":"2024-05-09T00:08:58.478741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478705+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:58.478705+0000","last_peered":"2024-05-09T00:08:58.478705+0000","last_clean":"2024-05-09T00:08:58.478705+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:58.478705+0000","last_undegraded":"2024-05-09T00:08:58.478705+0000","last_fullsized":"2024-05-09T00:08:58.478705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483900+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:58.483900+0000","last_peered":"2024-05-09T00:08:58.483900+0000","last_clean":"2024-05-09T00:08:58.483900+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:58.483900+0000","last_undegraded":"2024-05-09T00:08:58.483900+0000","last_fullsized":"2024-05-09T00:08:58.483900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479091+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:58.479091+0000","last_peered":"2024-05-09T00:08:58.479091+0000","last_clean":"2024-05-09T00:08:58.479091+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:58.479091+0000","last_undegraded":"2024-05-09T00:08:58.479091+0000","last_fullsized":"2024-05-09T00:08:58.479091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477426+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:58.477426+0000","last_peered":"2024-05-09T00:08:58.477426+0000","last_clean":"2024-05-09T00:08:58.477426+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:58.477426+0000","last_undegraded":"2024-05-09T00:08:58.477426+0000","last_fullsized":"2024-05-09T00:08:58.477426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:09:21.137343+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:09:21.137343+0000","last_peered":"2024-05-09T00:09:21.137343+0000","last_clean":"2024-05-09T00:09:21.137343+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:09:21.137343+0000","last_undegraded":"2024-05-09T00:09:21.137343+0000","last_fullsized":"2024-05-09T00:09:21.137343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476732+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:58.476732+0000","last_peered":"2024-05-09T00:08:58.476732+0000","last_clean":"2024-05-09T00:08:58.476732+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:58.476732+0000","last_undegraded":"2024-05-09T00:08:58.476732+0000","last_fullsized":"2024-05-09T00:08:58.476732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:09:16.473330+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:09:16.473330+0000","last_peered":"2024-05-09T00:09:16.473330+0000","last_clean":"2024-05-09T00:09:16.473330+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:09:16.473330+0000","last_undegraded":"2024-05-09T00:09:16.473330+0000","last_fullsized":"2024-05-09T00:09:16.473330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481463+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:58.481463+0000","last_peered":"2024-05-09T00:08:58.481463+0000","last_clean":"2024-05-09T00:08:58.481463+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:58.481463+0000","last_undegraded":"2024-05-09T00:08:58.481463+0000","last_fullsized":"2024-05-09T00:08:58.481463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477387+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:58.477387+0000","last_peered":"2024-05-09T00:08:58.477387+0000","last_clean":"2024-05-09T00:08:58.477387+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:58.477387+0000","last_undegraded":"2024-05-09T00:08:58.477387+0000","last_fullsized":"2024-05-09T00:08:58.477387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478333+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:58.478333+0000","last_peered":"2024-05-09T00:08:58.478333+0000","last_clean":"2024-05-09T00:08:58.478333+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:58.478333+0000","last_undegraded":"2024-05-09T00:08:58.478333+0000","last_fullsized":"2024-05-09T00:08:58.478333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483817+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:58.483817+0000","last_peered":"2024-05-09T00:08:58.483817+0000","last_clean":"2024-05-09T00:08:58.483817+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:58.483817+0000","last_undegraded":"2024-05-09T00:08:58.483817+0000","last_fullsized":"2024-05-09T00:08:58.483817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483648+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:58.483648+0000","last_peered":"2024-05-09T00:08:58.483648+0000","last_clean":"2024-05-09T00:08:58.483648+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:58.483648+0000","last_undegraded":"2024-05-09T00:08:58.483648+0000","last_fullsized":"2024-05-09T00:08:58.483648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482784+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:58.482784+0000","last_peered":"2024-05-09T00:08:58.482784+0000","last_clean":"2024-05-09T00:08:58.482784+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:58.482784+0000","last_undegraded":"2024-05-09T00:08:58.482784+0000","last_fullsized":"2024-05-09T00:08:58.482784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479553+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:58.479553+0000","last_peered":"2024-05-09T00:08:58.479553+0000","last_clean":"2024-05-09T00:08:58.479553+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:58.479553+0000","last_undegraded":"2024-05-09T00:08:58.479553+0000","last_fullsized":"2024-05-09T00:08:58.479553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482839+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:58.482839+0000","last_peered":"2024-05-09T00:08:58.482839+0000","last_clean":"2024-05-09T00:08:58.482839+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:58.482839+0000","last_undegraded":"2024-05-09T00:08:58.482839+0000","last_fullsized":"2024-05-09T00:08:58.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475873+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:58.475873+0000","last_peered":"2024-05-09T00:08:58.475873+0000","last_clean":"2024-05-09T00:08:58.475873+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:58.475873+0000","last_undegraded":"2024-05-09T00:08:58.475873+0000","last_fullsized":"2024-05-09T00:08:58.475873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476268+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:58.476268+0000","last_peered":"2024-05-09T00:08:58.476268+0000","last_clean":"2024-05-09T00:08:58.476268+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:58.476268+0000","last_undegraded":"2024-05-09T00:08:58.476268+0000","last_fullsized":"2024-05-09T00:08:58.476268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:59.670906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483620+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:58.483620+0000","last_peered":"2024-05-09T00:08:58.483620+0000","last_clean":"2024-05-09T00:08:58.483620+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:58.483620+0000","last_undegraded":"2024-05-09T00:08:58.483620+0000","last_fullsized":"2024-05-09T00:08:58.483620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480061+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:58.480061+0000","last_peered":"2024-05-09T00:08:58.480061+0000","last_clean":"2024-05-09T00:08:58.480061+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:58.480061+0000","last_undegraded":"2024-05-09T00:08:58.480061+0000","last_fullsized":"2024-05-09T00:08:58.480061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480789+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:58.480789+0000","last_peered":"2024-05-09T00:08:58.480789+0000","last_clean":"2024-05-09T00:08:58.480789+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:58.480789+0000","last_undegraded":"2024-05-09T00:08:58.480789+0000","last_fullsized":"2024-05-09T00:08:58.480789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:49.557566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478428+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:58.478428+0000","last_peered":"2024-05-09T00:08:58.478428+0000","last_clean":"2024-05-09T00:08:58.478428+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:58.478428+0000","last_undegraded":"2024-05-09T00:08:58.478428+0000","last_fullsized":"2024-05-09T00:08:58.478428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477100+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:58.477100+0000","last_peered":"2024-05-09T00:08:58.477100+0000","last_clean":"2024-05-09T00:08:58.477100+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:58.477100+0000","last_undegraded":"2024-05-09T00:08:58.477100+0000","last_fullsized":"2024-05-09T00:08:58.477100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477818+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:58.477818+0000","last_peered":"2024-05-09T00:08:58.477818+0000","last_clean":"2024-05-09T00:08:58.477818+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:58.477818+0000","last_undegraded":"2024-05-09T00:08:58.477818+0000","last_fullsized":"2024-05-09T00:08:58.477818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477905+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:58.477905+0000","last_peered":"2024-05-09T00:08:58.477905+0000","last_clean":"2024-05-09T00:08:58.477905+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:58.477905+0000","last_undegraded":"2024-05-09T00:08:58.477905+0000","last_fullsized":"2024-05-09T00:08:58.477905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476613+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:58.476613+0000","last_peered":"2024-05-09T00:08:58.476613+0000","last_clean":"2024-05-09T00:08:58.476613+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:58.476613+0000","last_undegraded":"2024-05-09T00:08:58.476613+0000","last_fullsized":"2024-05-09T00:08:58.476613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475819+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:58.475819+0000","last_peered":"2024-05-09T00:08:58.475819+0000","last_clean":"2024-05-09T00:08:58.475819+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:58.475819+0000","last_undegraded":"2024-05-09T00:08:58.475819+0000","last_fullsized":"2024-05-09T00:08:58.475819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477248+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:58.477248+0000","last_peered":"2024-05-09T00:08:58.477248+0000","last_clean":"2024-05-09T00:08:58.477248+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:58.477248+0000","last_undegraded":"2024-05-09T00:08:58.477248+0000","last_fullsized":"2024-05-09T00:08:58.477248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476388+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:58.476388+0000","last_peered":"2024-05-09T00:08:58.476388+0000","last_clean":"2024-05-09T00:08:58.476388+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:58.476388+0000","last_undegraded":"2024-05-09T00:08:58.476388+0000","last_fullsized":"2024-05-09T00:08:58.476388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483808+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:58.483808+0000","last_peered":"2024-05-09T00:08:58.483808+0000","last_clean":"2024-05-09T00:08:58.483808+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:58.483808+0000","last_undegraded":"2024-05-09T00:08:58.483808+0000","last_fullsized":"2024-05-09T00:08:58.483808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477114+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:58.477114+0000","last_peered":"2024-05-09T00:08:58.477114+0000","last_clean":"2024-05-09T00:08:58.477114+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:58.477114+0000","last_undegraded":"2024-05-09T00:08:58.477114+0000","last_fullsized":"2024-05-09T00:08:58.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481101+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:58.481101+0000","last_peered":"2024-05-09T00:08:58.481101+0000","last_clean":"2024-05-09T00:08:58.481101+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:58.481101+0000","last_undegraded":"2024-05-09T00:08:58.481101+0000","last_fullsized":"2024-05-09T00:08:58.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478553+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:58.478553+0000","last_peered":"2024-05-09T00:08:58.478553+0000","last_clean":"2024-05-09T00:08:58.478553+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:58.478553+0000","last_undegraded":"2024-05-09T00:08:58.478553+0000","last_fullsized":"2024-05-09T00:08:58.478553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483038+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:58.483038+0000","last_peered":"2024-05-09T00:08:58.483038+0000","last_clean":"2024-05-09T00:08:58.483038+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:58.483038+0000","last_undegraded":"2024-05-09T00:08:58.483038+0000","last_fullsized":"2024-05-09T00:08:58.483038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479550+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:58.479550+0000","last_peered":"2024-05-09T00:08:58.479550+0000","last_clean":"2024-05-09T00:08:58.479550+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:58.479550+0000","last_undegraded":"2024-05-09T00:08:58.479550+0000","last_fullsized":"2024-05-09T00:08:58.479550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479863+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:58.479863+0000","last_peered":"2024-05-09T00:08:58.479863+0000","last_clean":"2024-05-09T00:08:58.479863+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:58.479863+0000","last_undegraded":"2024-05-09T00:08:58.479863+0000","last_fullsized":"2024-05-09T00:08:58.479863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478406+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:58.478406+0000","last_peered":"2024-05-09T00:08:58.478406+0000","last_clean":"2024-05-09T00:08:58.478406+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:58.478406+0000","last_undegraded":"2024-05-09T00:08:58.478406+0000","last_fullsized":"2024-05-09T00:08:58.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":107510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":110040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:26.906 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-05-09T00:09:26.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:09:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.214+0000 7fb442e00640 1 Processor -- start 2024-05-09T00:09:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.214+0000 7fb442e00640 1 -- start start 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb442e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb43c0ca170 0x7fb43c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb442e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb43c072cf0 0x7fb43c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb442e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c158700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb442e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c0c9440 con 0x7fb43c072cf0 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb442e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c0c9ce0 con 0x7fb43c0ca170 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb442e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0cad50 con 0x7fb43c0c4eb0 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.216+0000 7fb43b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb43c072cf0 0x7fb43c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb43c072cf0 0x7fb43c1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38780/0 (socket says 172.21.15.114:38780) 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 -- 172.21.15.114:0/2519662065 learned_addr learned my addr 172.21.15.114:0/2519662065 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb440e00640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43be00640 1 --2- 172.21.15.114:0/2519662065 >> v2:172.21.15.153:3300/0 conn(0x7fb43c0ca170 0x7fb43c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 -- 172.21.15.114:0/2519662065 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 msgr2=0x7fb43c158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 -- 172.21.15.114:0/2519662065 >> v2:172.21.15.153:3300/0 conn(0x7fb43c0ca170 msgr2=0x7fb43c0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 --2- 172.21.15.114:0/2519662065 >> v2:172.21.15.153:3300/0 conn(0x7fb43c0ca170 0x7fb43c0c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43b400640 1 -- 172.21.15.114:0/2519662065 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c0c9690 con 0x7fb43c072cf0 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb440e00640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:27.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.217+0000 7fb43be00640 1 --2- 172.21.15.114:0/2519662065 >> v2:172.21.15.153:3300/0 conn(0x7fb43c0ca170 0x7fb43c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:27.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.218+0000 7fb43b400640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c1581c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0cc560 tx=0x7fb42802a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ef5c541b86ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:27.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.218+0000 7fb43aa00640 1 -- 172.21.15.114:0/2519662065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428037070 con 0x7fb43c072cf0 2024-05-09T00:09:27.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.218+0000 7fb43aa00640 1 -- 172.21.15.114:0/2519662065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42802ae10 con 0x7fb43c072cf0 2024-05-09T00:09:27.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.218+0000 7fb43aa00640 1 -- 172.21.15.114:0/2519662065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428032660 con 0x7fb43c072cf0 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 -- 172.21.15.114:0/2519662065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 msgr2=0x7fb43c1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c1581c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0cc560 tx=0x7fb42802a0c0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 -- 172.21.15.114:0/2519662065 shutdown_connections 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 --2- 172.21.15.114:0/2519662065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c1581c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 --2- 172.21.15.114:0/2519662065 >> v2:172.21.15.153:3300/0 conn(0x7fb43c0ca170 0x7fb43c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 -- 172.21.15.114:0/2519662065 >> 172.21.15.114:0/2519662065 conn(0x7fb43c0cbb70 msgr2=0x7fb43c0ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 -- 172.21.15.114:0/2519662065 shutdown_connections 2024-05-09T00:09:27.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.219+0000 7fb442e00640 1 -- 172.21.15.114:0/2519662065 wait complete. 2024-05-09T00:09:27.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.221+0000 7fb442e00640 1 Processor -- start 2024-05-09T00:09:27.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.222+0000 7fb442e00640 1 -- start start 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb442e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb442e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb442e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c0aec60 0x7fb43c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb442e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0ca7b0 con 0x7fb43c072cf0 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb442e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c06f470 con 0x7fb43c0aec60 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb442e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0ca930 con 0x7fb43c0c4eb0 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb43be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb43be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38784/0 (socket says 172.21.15.114:38784) 2024-05-09T00:09:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.223+0000 7fb43be00640 1 -- 172.21.15.114:0/4060622143 learned_addr learned my addr 172.21.15.114:0/4060622143 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:27.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb440e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c0aec60 0x7fb43c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43b400640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43be00640 1 -- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 msgr2=0x7fb43c159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43be00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43be00640 1 -- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c0aec60 msgr2=0x7fb43c15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43be00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c0aec60 0x7fb43c15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43be00640 1 -- 172.21.15.114:0/4060622143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c1ee2a0 con 0x7fb43c072cf0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb440e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c0aec60 0x7fb43c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb43be00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c157030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00c820 tx=0x7fb42c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c015070 con 0x7fb43c072cf0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c007a30 con 0x7fb43c072cf0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c007e20 con 0x7fb43c072cf0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c159630 con 0x7fb43c072cf0 2024-05-09T00:09:27.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.224+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c0b0610 con 0x7fb43c072cf0 2024-05-09T00:09:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.225+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c0b0840 con 0x7fb43c072cf0 2024-05-09T00:09:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.227+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb42c018070 con 0x7fb43c072cf0 2024-05-09T00:09:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.228+0000 7fb433e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb41c0762d0 0x7fb41c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.228+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb42c097520 con 0x7fb43c072cf0 2024-05-09T00:09:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.228+0000 7fb43b400640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb41c0762d0 0x7fb41c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.229+0000 7fb43b400640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb41c0762d0 0x7fb41c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb428034000 tx=0x7fb42802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.233+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb43c0b0840 con 0x7fb43c072cf0 2024-05-09T00:09:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.422+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb43c15ab10 con 0x7fb41c0762d0 2024-05-09T00:09:27.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.439+0000 7fb433e00640 1 -- 172.21.15.114:0/4060622143 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490327 (secure 0 0 0) 0x7fb43c15ab10 con 0x7fb41c0762d0 2024-05-09T00:09:27.439 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb41c0762d0 msgr2=0x7fb41c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb41c0762d0 0x7fb41c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb428034000 tx=0x7fb42802e000 comp rx=0 tx=0).stop 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 msgr2=0x7fb43c157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c157030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00c820 tx=0x7fb42c00cce0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 shutdown_connections 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb41c0762d0 0x7fb41c0787e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43c0aec60 0x7fb43c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb43c0c4eb0 0x7fb43c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.449+0000 7fb442e00640 1 --2- 172.21.15.114:0/4060622143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb43c072cf0 0x7fb43c157030 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.450+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 >> 172.21.15.114:0/4060622143 conn(0x7fb43c0cbb70 msgr2=0x7fb43c154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:27.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.450+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 shutdown_connections 2024-05-09T00:09:27.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.450+0000 7fb442e00640 1 -- 172.21.15.114:0/4060622143 wait complete. 2024-05-09T00:09:27.471 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-09T00:09:26.303493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597678,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3481600,"data_stored":2030334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2490,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005095"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889084+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:08:56.889084+0000","last_peered":"2024-05-09T00:08:56.889084+0000","last_clean":"2024-05-09T00:08:56.889084+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:08:56.889084+0000","last_undegraded":"2024-05-09T00:08:56.889084+0000","last_fullsized":"2024-05-09T00:08:56.889084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202080+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:08:56.202080+0000","last_peered":"2024-05-09T00:08:56.202080+0000","last_clean":"2024-05-09T00:08:56.202080+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:08:56.202080+0000","last_undegraded":"2024-05-09T00:08:56.202080+0000","last_fullsized":"2024-05-09T00:08:56.202080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202983+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:08:56.202983+0000","last_peered":"2024-05-09T00:08:56.202983+0000","last_clean":"2024-05-09T00:08:56.202983+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:08:56.202983+0000","last_undegraded":"2024-05-09T00:08:56.202983+0000","last_fullsized":"2024-05-09T00:08:56.202983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207705+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:08:57.207705+0000","last_peered":"2024-05-09T00:08:57.207705+0000","last_clean":"2024-05-09T00:08:57.207705+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:08:57.207705+0000","last_undegraded":"2024-05-09T00:08:57.207705+0000","last_fullsized":"2024-05-09T00:08:57.207705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197248+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:08:56.197248+0000","last_peered":"2024-05-09T00:08:56.197248+0000","last_clean":"2024-05-09T00:08:56.197248+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:08:56.197248+0000","last_undegraded":"2024-05-09T00:08:56.197248+0000","last_fullsized":"2024-05-09T00:08:56.197248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203326+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:08:56.203326+0000","last_peered":"2024-05-09T00:08:56.203326+0000","last_clean":"2024-05-09T00:08:56.203326+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:08:56.203326+0000","last_undegraded":"2024-05-09T00:08:56.203326+0000","last_fullsized":"2024-05-09T00:08:56.203326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203582+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:08:56.203582+0000","last_peered":"2024-05-09T00:08:56.203582+0000","last_clean":"2024-05-09T00:08:56.203582+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:08:56.203582+0000","last_undegraded":"2024-05-09T00:08:56.203582+0000","last_fullsized":"2024-05-09T00:08:56.203582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478651+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:08:58.478651+0000","last_peered":"2024-05-09T00:08:58.478651+0000","last_clean":"2024-05-09T00:08:58.478651+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:08:58.478651+0000","last_undegraded":"2024-05-09T00:08:58.478651+0000","last_fullsized":"2024-05-09T00:08:58.478651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890533+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:08:56.890533+0000","last_peered":"2024-05-09T00:08:56.890533+0000","last_clean":"2024-05-09T00:08:56.890533+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:08:56.890533+0000","last_undegraded":"2024-05-09T00:08:56.890533+0000","last_fullsized":"2024-05-09T00:08:56.890533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476848+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:08:58.476848+0000","last_peered":"2024-05-09T00:08:58.476848+0000","last_clean":"2024-05-09T00:08:58.476848+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:08:58.476848+0000","last_undegraded":"2024-05-09T00:08:58.476848+0000","last_fullsized":"2024-05-09T00:08:58.476848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890247+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:08:56.890247+0000","last_peered":"2024-05-09T00:08:56.890247+0000","last_clean":"2024-05-09T00:08:56.890247+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:08:56.890247+0000","last_undegraded":"2024-05-09T00:08:56.890247+0000","last_fullsized":"2024-05-09T00:08:56.890247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481099+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:08:58.481099+0000","last_peered":"2024-05-09T00:08:58.481099+0000","last_clean":"2024-05-09T00:08:58.481099+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:08:58.481099+0000","last_undegraded":"2024-05-09T00:08:58.481099+0000","last_fullsized":"2024-05-09T00:08:58.481099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480820+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:08:58.480820+0000","last_peered":"2024-05-09T00:08:58.480820+0000","last_clean":"2024-05-09T00:08:58.480820+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:08:58.480820+0000","last_undegraded":"2024-05-09T00:08:58.480820+0000","last_fullsized":"2024-05-09T00:08:58.480820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479058+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:08:58.479058+0000","last_peered":"2024-05-09T00:08:58.479058+0000","last_clean":"2024-05-09T00:08:58.479058+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:08:58.479058+0000","last_undegraded":"2024-05-09T00:08:58.479058+0000","last_fullsized":"2024-05-09T00:08:58.479058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194927+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:08:56.194927+0000","last_peered":"2024-05-09T00:08:56.194927+0000","last_clean":"2024-05-09T00:08:56.194927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:08:56.194927+0000","last_undegraded":"2024-05-09T00:08:56.194927+0000","last_fullsized":"2024-05-09T00:08:56.194927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480776+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:08:58.480776+0000","last_peered":"2024-05-09T00:08:58.480776+0000","last_clean":"2024-05-09T00:08:58.480776+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:08:58.480776+0000","last_undegraded":"2024-05-09T00:08:58.480776+0000","last_fullsized":"2024-05-09T00:08:58.480776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199534+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:08:56.199534+0000","last_peered":"2024-05-09T00:08:56.199534+0000","last_clean":"2024-05-09T00:08:56.199534+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:08:56.199534+0000","last_undegraded":"2024-05-09T00:08:56.199534+0000","last_fullsized":"2024-05-09T00:08:56.199534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193491+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:08:56.193491+0000","last_peered":"2024-05-09T00:08:56.193491+0000","last_clean":"2024-05-09T00:08:56.193491+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:08:56.193491+0000","last_undegraded":"2024-05-09T00:08:56.193491+0000","last_fullsized":"2024-05-09T00:08:56.193491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193655+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:08:56.193655+0000","last_peered":"2024-05-09T00:08:56.193655+0000","last_clean":"2024-05-09T00:08:56.193655+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:08:56.193655+0000","last_undegraded":"2024-05-09T00:08:56.193655+0000","last_fullsized":"2024-05-09T00:08:56.193655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194640+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:08:56.194640+0000","last_peered":"2024-05-09T00:08:56.194640+0000","last_clean":"2024-05-09T00:08:56.194640+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:08:56.194640+0000","last_undegraded":"2024-05-09T00:08:56.194640+0000","last_fullsized":"2024-05-09T00:08:56.194640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208919+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:08:57.208919+0000","last_peered":"2024-05-09T00:08:57.208919+0000","last_clean":"2024-05-09T00:08:57.208919+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:08:57.208919+0000","last_undegraded":"2024-05-09T00:08:57.208919+0000","last_fullsized":"2024-05-09T00:08:57.208919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208149+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:08:57.208149+0000","last_peered":"2024-05-09T00:08:57.208149+0000","last_clean":"2024-05-09T00:08:57.208149+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:08:57.208149+0000","last_undegraded":"2024-05-09T00:08:57.208149+0000","last_fullsized":"2024-05-09T00:08:57.208149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391779+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:08:57.391779+0000","last_peered":"2024-05-09T00:08:57.391779+0000","last_clean":"2024-05-09T00:08:57.391779+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:08:57.391779+0000","last_undegraded":"2024-05-09T00:08:57.391779+0000","last_fullsized":"2024-05-09T00:08:57.391779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478159+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:08:58.478159+0000","last_peered":"2024-05-09T00:08:58.478159+0000","last_clean":"2024-05-09T00:08:58.478159+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:08:58.478159+0000","last_undegraded":"2024-05-09T00:08:58.478159+0000","last_fullsized":"2024-05-09T00:08:58.478159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194572+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:08:56.194572+0000","last_peered":"2024-05-09T00:08:56.194572+0000","last_clean":"2024-05-09T00:08:56.194572+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:08:56.194572+0000","last_undegraded":"2024-05-09T00:08:56.194572+0000","last_fullsized":"2024-05-09T00:08:56.194572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198056+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:08:56.198056+0000","last_peered":"2024-05-09T00:08:56.198056+0000","last_clean":"2024-05-09T00:08:56.198056+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:08:56.198056+0000","last_undegraded":"2024-05-09T00:08:56.198056+0000","last_fullsized":"2024-05-09T00:08:56.198056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197932+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:08:56.197932+0000","last_peered":"2024-05-09T00:08:56.197932+0000","last_clean":"2024-05-09T00:08:56.197932+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:08:56.197932+0000","last_undegraded":"2024-05-09T00:08:56.197932+0000","last_fullsized":"2024-05-09T00:08:56.197932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208587+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:08:57.208587+0000","last_peered":"2024-05-09T00:08:57.208587+0000","last_clean":"2024-05-09T00:08:57.208587+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:08:57.208587+0000","last_undegraded":"2024-05-09T00:08:57.208587+0000","last_fullsized":"2024-05-09T00:08:57.208587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890815+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:08:56.890815+0000","last_peered":"2024-05-09T00:08:56.890815+0000","last_clean":"2024-05-09T00:08:56.890815+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:08:56.890815+0000","last_undegraded":"2024-05-09T00:08:56.890815+0000","last_fullsized":"2024-05-09T00:08:56.890815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193366+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.193366+0000","last_peered":"2024-05-09T00:08:56.193366+0000","last_clean":"2024-05-09T00:08:56.193366+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:08:56.193366+0000","last_undegraded":"2024-05-09T00:08:56.193366+0000","last_fullsized":"2024-05-09T00:08:56.193366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475636+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:08:58.475636+0000","last_peered":"2024-05-09T00:08:58.475636+0000","last_clean":"2024-05-09T00:08:58.475636+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:08:58.475636+0000","last_undegraded":"2024-05-09T00:08:58.475636+0000","last_fullsized":"2024-05-09T00:08:58.475636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483407+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:08:58.483407+0000","last_peered":"2024-05-09T00:08:58.483407+0000","last_clean":"2024-05-09T00:08:58.483407+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:08:58.483407+0000","last_undegraded":"2024-05-09T00:08:58.483407+0000","last_fullsized":"2024-05-09T00:08:58.483407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198718+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:08:56.198718+0000","last_peered":"2024-05-09T00:08:56.198718+0000","last_clean":"2024-05-09T00:08:56.198718+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:08:56.198718+0000","last_undegraded":"2024-05-09T00:08:56.198718+0000","last_fullsized":"2024-05-09T00:08:56.198718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203181+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:08:56.203181+0000","last_peered":"2024-05-09T00:08:56.203181+0000","last_clean":"2024-05-09T00:08:56.203181+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:08:56.203181+0000","last_undegraded":"2024-05-09T00:08:56.203181+0000","last_fullsized":"2024-05-09T00:08:56.203181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195184+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:08:56.195184+0000","last_peered":"2024-05-09T00:08:56.195184+0000","last_clean":"2024-05-09T00:08:56.195184+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:08:56.195184+0000","last_undegraded":"2024-05-09T00:08:56.195184+0000","last_fullsized":"2024-05-09T00:08:56.195184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480021+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:08:58.480021+0000","last_peered":"2024-05-09T00:08:58.480021+0000","last_clean":"2024-05-09T00:08:58.480021+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:08:58.480021+0000","last_undegraded":"2024-05-09T00:08:58.480021+0000","last_fullsized":"2024-05-09T00:08:58.480021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192846+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:08:56.192846+0000","last_peered":"2024-05-09T00:08:56.192846+0000","last_clean":"2024-05-09T00:08:56.192846+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:08:56.192846+0000","last_undegraded":"2024-05-09T00:08:56.192846+0000","last_fullsized":"2024-05-09T00:08:56.192846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201451+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:08:56.201451+0000","last_peered":"2024-05-09T00:08:56.201451+0000","last_clean":"2024-05-09T00:08:56.201451+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:08:56.201451+0000","last_undegraded":"2024-05-09T00:08:56.201451+0000","last_fullsized":"2024-05-09T00:08:56.201451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203953+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:08:56.203953+0000","last_peered":"2024-05-09T00:08:56.203953+0000","last_clean":"2024-05-09T00:08:56.203953+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:08:56.203953+0000","last_undegraded":"2024-05-09T00:08:56.203953+0000","last_fullsized":"2024-05-09T00:08:56.203953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197903+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:08:56.197903+0000","last_peered":"2024-05-09T00:08:56.197903+0000","last_clean":"2024-05-09T00:08:56.197903+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:08:56.197903+0000","last_undegraded":"2024-05-09T00:08:56.197903+0000","last_fullsized":"2024-05-09T00:08:56.197903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476066+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:08:58.476066+0000","last_peered":"2024-05-09T00:08:58.476066+0000","last_clean":"2024-05-09T00:08:58.476066+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:08:58.476066+0000","last_undegraded":"2024-05-09T00:08:58.476066+0000","last_fullsized":"2024-05-09T00:08:58.476066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392120+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:08:57.392120+0000","last_peered":"2024-05-09T00:08:57.392120+0000","last_clean":"2024-05-09T00:08:57.392120+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:08:57.392120+0000","last_undegraded":"2024-05-09T00:08:57.392120+0000","last_fullsized":"2024-05-09T00:08:57.392120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195385+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:08:56.195385+0000","last_peered":"2024-05-09T00:08:56.195385+0000","last_clean":"2024-05-09T00:08:56.195385+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:08:56.195385+0000","last_undegraded":"2024-05-09T00:08:56.195385+0000","last_fullsized":"2024-05-09T00:08:56.195385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391736+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:08:57.391736+0000","last_peered":"2024-05-09T00:08:57.391736+0000","last_clean":"2024-05-09T00:08:57.391736+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:08:57.391736+0000","last_undegraded":"2024-05-09T00:08:57.391736+0000","last_fullsized":"2024-05-09T00:08:57.391736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198233+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:08:56.198233+0000","last_peered":"2024-05-09T00:08:56.198233+0000","last_clean":"2024-05-09T00:08:56.198233+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:08:56.198233+0000","last_undegraded":"2024-05-09T00:08:56.198233+0000","last_fullsized":"2024-05-09T00:08:56.198233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483024+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:08:58.483024+0000","last_peered":"2024-05-09T00:08:58.483024+0000","last_clean":"2024-05-09T00:08:58.483024+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:08:58.483024+0000","last_undegraded":"2024-05-09T00:08:58.483024+0000","last_fullsized":"2024-05-09T00:08:58.483024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201124+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:08:56.201124+0000","last_peered":"2024-05-09T00:08:56.201124+0000","last_clean":"2024-05-09T00:08:56.201124+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:08:56.201124+0000","last_undegraded":"2024-05-09T00:08:56.201124+0000","last_fullsized":"2024-05-09T00:08:56.201124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390403+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:08:57.390403+0000","last_peered":"2024-05-09T00:08:57.390403+0000","last_clean":"2024-05-09T00:08:57.390403+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:08:57.390403+0000","last_undegraded":"2024-05-09T00:08:57.390403+0000","last_fullsized":"2024-05-09T00:08:57.390403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209180+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:08:57.209180+0000","last_peered":"2024-05-09T00:08:57.209180+0000","last_clean":"2024-05-09T00:08:57.209180+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:08:57.209180+0000","last_undegraded":"2024-05-09T00:08:57.209180+0000","last_fullsized":"2024-05-09T00:08:57.209180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478064+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:08:58.478064+0000","last_peered":"2024-05-09T00:08:58.478064+0000","last_clean":"2024-05-09T00:08:58.478064+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:08:58.478064+0000","last_undegraded":"2024-05-09T00:08:58.478064+0000","last_fullsized":"2024-05-09T00:08:58.478064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194130+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:08:56.194130+0000","last_peered":"2024-05-09T00:08:56.194130+0000","last_clean":"2024-05-09T00:08:56.194130+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:08:56.194130+0000","last_undegraded":"2024-05-09T00:08:56.194130+0000","last_fullsized":"2024-05-09T00:08:56.194130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391761+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:08:57.391761+0000","last_peered":"2024-05-09T00:08:57.391761+0000","last_clean":"2024-05-09T00:08:57.391761+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:08:57.391761+0000","last_undegraded":"2024-05-09T00:08:57.391761+0000","last_fullsized":"2024-05-09T00:08:57.391761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208687+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:08:57.208687+0000","last_peered":"2024-05-09T00:08:57.208687+0000","last_clean":"2024-05-09T00:08:57.208687+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:08:57.208687+0000","last_undegraded":"2024-05-09T00:08:57.208687+0000","last_fullsized":"2024-05-09T00:08:57.208687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196304+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:08:56.196304+0000","last_peered":"2024-05-09T00:08:56.196304+0000","last_clean":"2024-05-09T00:08:56.196304+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:08:56.196304+0000","last_undegraded":"2024-05-09T00:08:56.196304+0000","last_fullsized":"2024-05-09T00:08:56.196304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207759+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:08:57.207759+0000","last_peered":"2024-05-09T00:08:57.207759+0000","last_clean":"2024-05-09T00:08:57.207759+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:08:57.207759+0000","last_undegraded":"2024-05-09T00:08:57.207759+0000","last_fullsized":"2024-05-09T00:08:57.207759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391408+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:08:57.391408+0000","last_peered":"2024-05-09T00:08:57.391408+0000","last_clean":"2024-05-09T00:08:57.391408+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:08:57.391408+0000","last_undegraded":"2024-05-09T00:08:57.391408+0000","last_fullsized":"2024-05-09T00:08:57.391408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193737+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:08:56.193737+0000","last_peered":"2024-05-09T00:08:56.193737+0000","last_clean":"2024-05-09T00:08:56.193737+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:08:56.193737+0000","last_undegraded":"2024-05-09T00:08:56.193737+0000","last_fullsized":"2024-05-09T00:08:56.193737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390504+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:08:57.390504+0000","last_peered":"2024-05-09T00:08:57.390504+0000","last_clean":"2024-05-09T00:08:57.390504+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:08:57.390504+0000","last_undegraded":"2024-05-09T00:08:57.390504+0000","last_fullsized":"2024-05-09T00:08:57.390504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192954+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:08:56.192954+0000","last_peered":"2024-05-09T00:08:56.192954+0000","last_clean":"2024-05-09T00:08:56.192954+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:08:56.192954+0000","last_undegraded":"2024-05-09T00:08:56.192954+0000","last_fullsized":"2024-05-09T00:08:56.192954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203327+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:08:56.203327+0000","last_peered":"2024-05-09T00:08:56.203327+0000","last_clean":"2024-05-09T00:08:56.203327+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:08:56.203327+0000","last_undegraded":"2024-05-09T00:08:56.203327+0000","last_fullsized":"2024-05-09T00:08:56.203327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477477+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:08:58.477477+0000","last_peered":"2024-05-09T00:08:58.477477+0000","last_clean":"2024-05-09T00:08:58.477477+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:08:58.477477+0000","last_undegraded":"2024-05-09T00:08:58.477477+0000","last_fullsized":"2024-05-09T00:08:58.477477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199116+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:08:56.199116+0000","last_peered":"2024-05-09T00:08:56.199116+0000","last_clean":"2024-05-09T00:08:56.199116+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:08:56.199116+0000","last_undegraded":"2024-05-09T00:08:56.199116+0000","last_fullsized":"2024-05-09T00:08:56.199116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193969+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:08:56.193969+0000","last_peered":"2024-05-09T00:08:56.193969+0000","last_clean":"2024-05-09T00:08:56.193969+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:08:56.193969+0000","last_undegraded":"2024-05-09T00:08:56.193969+0000","last_fullsized":"2024-05-09T00:08:56.193969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889577+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:08:56.889577+0000","last_peered":"2024-05-09T00:08:56.889577+0000","last_clean":"2024-05-09T00:08:56.889577+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:08:56.889577+0000","last_undegraded":"2024-05-09T00:08:56.889577+0000","last_fullsized":"2024-05-09T00:08:56.889577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195126+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:08:56.195126+0000","last_peered":"2024-05-09T00:08:56.195126+0000","last_clean":"2024-05-09T00:08:56.195126+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:08:56.195126+0000","last_undegraded":"2024-05-09T00:08:56.195126+0000","last_fullsized":"2024-05-09T00:08:56.195126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199919+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:08:56.199919+0000","last_peered":"2024-05-09T00:08:56.199919+0000","last_clean":"2024-05-09T00:08:56.199919+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:08:56.199919+0000","last_undegraded":"2024-05-09T00:08:56.199919+0000","last_fullsized":"2024-05-09T00:08:56.199919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195192+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:08:56.195192+0000","last_peered":"2024-05-09T00:08:56.195192+0000","last_clean":"2024-05-09T00:08:56.195192+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:08:56.195192+0000","last_undegraded":"2024-05-09T00:08:56.195192+0000","last_fullsized":"2024-05-09T00:08:56.195192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392380+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:08:57.392380+0000","last_peered":"2024-05-09T00:08:57.392380+0000","last_clean":"2024-05-09T00:08:57.392380+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:08:57.392380+0000","last_undegraded":"2024-05-09T00:08:57.392380+0000","last_fullsized":"2024-05-09T00:08:57.392380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480993+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:08:58.480993+0000","last_peered":"2024-05-09T00:08:58.480993+0000","last_clean":"2024-05-09T00:08:58.480993+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:08:58.480993+0000","last_undegraded":"2024-05-09T00:08:58.480993+0000","last_fullsized":"2024-05-09T00:08:58.480993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390969+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:08:57.390969+0000","last_peered":"2024-05-09T00:08:57.390969+0000","last_clean":"2024-05-09T00:08:57.390969+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:08:57.390969+0000","last_undegraded":"2024-05-09T00:08:57.390969+0000","last_fullsized":"2024-05-09T00:08:57.390969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478741+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:08:58.478741+0000","last_peered":"2024-05-09T00:08:58.478741+0000","last_clean":"2024-05-09T00:08:58.478741+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:08:58.478741+0000","last_undegraded":"2024-05-09T00:08:58.478741+0000","last_fullsized":"2024-05-09T00:08:58.478741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202119+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:08:56.202119+0000","last_peered":"2024-05-09T00:08:56.202119+0000","last_clean":"2024-05-09T00:08:56.202119+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:08:56.202119+0000","last_undegraded":"2024-05-09T00:08:56.202119+0000","last_fullsized":"2024-05-09T00:08:56.202119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200029+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:08:56.200029+0000","last_peered":"2024-05-09T00:08:56.200029+0000","last_clean":"2024-05-09T00:08:56.200029+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:08:56.200029+0000","last_undegraded":"2024-05-09T00:08:56.200029+0000","last_fullsized":"2024-05-09T00:08:56.200029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889267+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:08:56.889267+0000","last_peered":"2024-05-09T00:08:56.889267+0000","last_clean":"2024-05-09T00:08:56.889267+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:08:56.889267+0000","last_undegraded":"2024-05-09T00:08:56.889267+0000","last_fullsized":"2024-05-09T00:08:56.889267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478705+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:08:58.478705+0000","last_peered":"2024-05-09T00:08:58.478705+0000","last_clean":"2024-05-09T00:08:58.478705+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:08:58.478705+0000","last_undegraded":"2024-05-09T00:08:58.478705+0000","last_fullsized":"2024-05-09T00:08:58.478705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203899+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:08:56.203899+0000","last_peered":"2024-05-09T00:08:56.203899+0000","last_clean":"2024-05-09T00:08:56.203899+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:08:56.203899+0000","last_undegraded":"2024-05-09T00:08:56.203899+0000","last_fullsized":"2024-05-09T00:08:56.203899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192212+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:08:56.192212+0000","last_peered":"2024-05-09T00:08:56.192212+0000","last_clean":"2024-05-09T00:08:56.192212+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:08:56.192212+0000","last_undegraded":"2024-05-09T00:08:56.192212+0000","last_fullsized":"2024-05-09T00:08:56.192212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390489+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:08:57.390489+0000","last_peered":"2024-05-09T00:08:57.390489+0000","last_clean":"2024-05-09T00:08:57.390489+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:08:57.390489+0000","last_undegraded":"2024-05-09T00:08:57.390489+0000","last_fullsized":"2024-05-09T00:08:57.390489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483900+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:08:58.483900+0000","last_peered":"2024-05-09T00:08:58.483900+0000","last_clean":"2024-05-09T00:08:58.483900+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:08:58.483900+0000","last_undegraded":"2024-05-09T00:08:58.483900+0000","last_fullsized":"2024-05-09T00:08:58.483900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479091+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:08:58.479091+0000","last_peered":"2024-05-09T00:08:58.479091+0000","last_clean":"2024-05-09T00:08:58.479091+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:08:58.479091+0000","last_undegraded":"2024-05-09T00:08:58.479091+0000","last_fullsized":"2024-05-09T00:08:58.479091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889471+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:08:56.889471+0000","last_peered":"2024-05-09T00:08:56.889471+0000","last_clean":"2024-05-09T00:08:56.889471+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:08:56.889471+0000","last_undegraded":"2024-05-09T00:08:56.889471+0000","last_fullsized":"2024-05-09T00:08:56.889471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200989+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:08:56.200989+0000","last_peered":"2024-05-09T00:08:56.200989+0000","last_clean":"2024-05-09T00:08:56.200989+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:08:56.200989+0000","last_undegraded":"2024-05-09T00:08:56.200989+0000","last_fullsized":"2024-05-09T00:08:56.200989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192996+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:08:56.192996+0000","last_peered":"2024-05-09T00:08:56.192996+0000","last_clean":"2024-05-09T00:08:56.192996+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:08:56.192996+0000","last_undegraded":"2024-05-09T00:08:56.192996+0000","last_fullsized":"2024-05-09T00:08:56.192996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198964+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:08:56.198964+0000","last_peered":"2024-05-09T00:08:56.198964+0000","last_clean":"2024-05-09T00:08:56.198964+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:08:56.198964+0000","last_undegraded":"2024-05-09T00:08:56.198964+0000","last_fullsized":"2024-05-09T00:08:56.198964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202503+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:08:56.202503+0000","last_peered":"2024-05-09T00:08:56.202503+0000","last_clean":"2024-05-09T00:08:56.202503+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:08:56.202503+0000","last_undegraded":"2024-05-09T00:08:56.202503+0000","last_fullsized":"2024-05-09T00:08:56.202503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194089+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:08:56.194089+0000","last_peered":"2024-05-09T00:08:56.194089+0000","last_clean":"2024-05-09T00:08:56.194089+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:08:56.194089+0000","last_undegraded":"2024-05-09T00:08:56.194089+0000","last_fullsized":"2024-05-09T00:08:56.194089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889310+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:08:56.889310+0000","last_peered":"2024-05-09T00:08:56.889310+0000","last_clean":"2024-05-09T00:08:56.889310+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:08:56.889310+0000","last_undegraded":"2024-05-09T00:08:56.889310+0000","last_fullsized":"2024-05-09T00:08:56.889310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477426+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:08:58.477426+0000","last_peered":"2024-05-09T00:08:58.477426+0000","last_clean":"2024-05-09T00:08:58.477426+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:08:58.477426+0000","last_undegraded":"2024-05-09T00:08:58.477426+0000","last_fullsized":"2024-05-09T00:08:58.477426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203080+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:08:56.203080+0000","last_peered":"2024-05-09T00:08:56.203080+0000","last_clean":"2024-05-09T00:08:56.203080+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:08:56.203080+0000","last_undegraded":"2024-05-09T00:08:56.203080+0000","last_fullsized":"2024-05-09T00:08:56.203080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194422+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:08:56.194422+0000","last_peered":"2024-05-09T00:08:56.194422+0000","last_clean":"2024-05-09T00:08:56.194422+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:08:56.194422+0000","last_undegraded":"2024-05-09T00:08:56.194422+0000","last_fullsized":"2024-05-09T00:08:56.194422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193338+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:08:56.193338+0000","last_peered":"2024-05-09T00:08:56.193338+0000","last_clean":"2024-05-09T00:08:56.193338+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:08:56.193338+0000","last_undegraded":"2024-05-09T00:08:56.193338+0000","last_fullsized":"2024-05-09T00:08:56.193338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193776+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:08:56.193776+0000","last_peered":"2024-05-09T00:08:56.193776+0000","last_clean":"2024-05-09T00:08:56.193776+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:08:56.193776+0000","last_undegraded":"2024-05-09T00:08:56.193776+0000","last_fullsized":"2024-05-09T00:08:56.193776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:09:21.137343+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:09:21.137343+0000","last_peered":"2024-05-09T00:09:21.137343+0000","last_clean":"2024-05-09T00:09:21.137343+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:09:21.137343+0000","last_undegraded":"2024-05-09T00:09:21.137343+0000","last_fullsized":"2024-05-09T00:09:21.137343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199525+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:08:56.199525+0000","last_peered":"2024-05-09T00:08:56.199525+0000","last_clean":"2024-05-09T00:08:56.199525+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:08:56.199525+0000","last_undegraded":"2024-05-09T00:08:56.199525+0000","last_fullsized":"2024-05-09T00:08:56.199525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391451+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:08:57.391451+0000","last_peered":"2024-05-09T00:08:57.391451+0000","last_clean":"2024-05-09T00:08:57.391451+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:08:57.391451+0000","last_undegraded":"2024-05-09T00:08:57.391451+0000","last_fullsized":"2024-05-09T00:08:57.391451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208737+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:08:57.208737+0000","last_peered":"2024-05-09T00:08:57.208737+0000","last_clean":"2024-05-09T00:08:57.208737+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:08:57.208737+0000","last_undegraded":"2024-05-09T00:08:57.208737+0000","last_fullsized":"2024-05-09T00:08:57.208737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194807+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:08:56.194807+0000","last_peered":"2024-05-09T00:08:56.194807+0000","last_clean":"2024-05-09T00:08:56.194807+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:08:56.194807+0000","last_undegraded":"2024-05-09T00:08:56.194807+0000","last_fullsized":"2024-05-09T00:08:56.194807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201219+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:08:56.201219+0000","last_peered":"2024-05-09T00:08:56.201219+0000","last_clean":"2024-05-09T00:08:56.201219+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:08:56.201219+0000","last_undegraded":"2024-05-09T00:08:56.201219+0000","last_fullsized":"2024-05-09T00:08:56.201219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476732+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:08:58.476732+0000","last_peered":"2024-05-09T00:08:58.476732+0000","last_clean":"2024-05-09T00:08:58.476732+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:08:58.476732+0000","last_undegraded":"2024-05-09T00:08:58.476732+0000","last_fullsized":"2024-05-09T00:08:58.476732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:09:16.473330+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:09:16.473330+0000","last_peered":"2024-05-09T00:09:16.473330+0000","last_clean":"2024-05-09T00:09:16.473330+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:09:16.473330+0000","last_undegraded":"2024-05-09T00:09:16.473330+0000","last_fullsized":"2024-05-09T00:09:16.473330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198756+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:08:56.198756+0000","last_peered":"2024-05-09T00:08:56.198756+0000","last_clean":"2024-05-09T00:08:56.198756+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:08:56.198756+0000","last_undegraded":"2024-05-09T00:08:56.198756+0000","last_fullsized":"2024-05-09T00:08:56.198756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391211+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:08:57.391211+0000","last_peered":"2024-05-09T00:08:57.391211+0000","last_clean":"2024-05-09T00:08:57.391211+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:08:57.391211+0000","last_undegraded":"2024-05-09T00:08:57.391211+0000","last_fullsized":"2024-05-09T00:08:57.391211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193118+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:08:56.193118+0000","last_peered":"2024-05-09T00:08:56.193118+0000","last_clean":"2024-05-09T00:08:56.193118+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:08:56.193118+0000","last_undegraded":"2024-05-09T00:08:56.193118+0000","last_fullsized":"2024-05-09T00:08:56.193118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209522+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:08:57.209522+0000","last_peered":"2024-05-09T00:08:57.209522+0000","last_clean":"2024-05-09T00:08:57.209522+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:08:57.209522+0000","last_undegraded":"2024-05-09T00:08:57.209522+0000","last_fullsized":"2024-05-09T00:08:57.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481463+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:08:58.481463+0000","last_peered":"2024-05-09T00:08:58.481463+0000","last_clean":"2024-05-09T00:08:58.481463+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:08:58.481463+0000","last_undegraded":"2024-05-09T00:08:58.481463+0000","last_fullsized":"2024-05-09T00:08:58.481463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192564+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:08:56.192564+0000","last_peered":"2024-05-09T00:08:56.192564+0000","last_clean":"2024-05-09T00:08:56.192564+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:08:56.192564+0000","last_undegraded":"2024-05-09T00:08:56.192564+0000","last_fullsized":"2024-05-09T00:08:56.192564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203731+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:08:56.203731+0000","last_peered":"2024-05-09T00:08:56.203731+0000","last_clean":"2024-05-09T00:08:56.203731+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:08:56.203731+0000","last_undegraded":"2024-05-09T00:08:56.203731+0000","last_fullsized":"2024-05-09T00:08:56.203731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477387+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:08:58.477387+0000","last_peered":"2024-05-09T00:08:58.477387+0000","last_clean":"2024-05-09T00:08:58.477387+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:08:58.477387+0000","last_undegraded":"2024-05-09T00:08:58.477387+0000","last_fullsized":"2024-05-09T00:08:58.477387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207395+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:08:57.207395+0000","last_peered":"2024-05-09T00:08:57.207395+0000","last_clean":"2024-05-09T00:08:57.207395+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:08:57.207395+0000","last_undegraded":"2024-05-09T00:08:57.207395+0000","last_fullsized":"2024-05-09T00:08:57.207395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478333+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:08:58.478333+0000","last_peered":"2024-05-09T00:08:58.478333+0000","last_clean":"2024-05-09T00:08:58.478333+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:08:58.478333+0000","last_undegraded":"2024-05-09T00:08:58.478333+0000","last_fullsized":"2024-05-09T00:08:58.478333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483817+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:08:58.483817+0000","last_peered":"2024-05-09T00:08:58.483817+0000","last_clean":"2024-05-09T00:08:58.483817+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:08:58.483817+0000","last_undegraded":"2024-05-09T00:08:58.483817+0000","last_fullsized":"2024-05-09T00:08:58.483817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890962+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:08:56.890962+0000","last_peered":"2024-05-09T00:08:56.890962+0000","last_clean":"2024-05-09T00:08:56.890962+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:08:56.890962+0000","last_undegraded":"2024-05-09T00:08:56.890962+0000","last_fullsized":"2024-05-09T00:08:56.890962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197051+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:08:56.197051+0000","last_peered":"2024-05-09T00:08:56.197051+0000","last_clean":"2024-05-09T00:08:56.197051+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:08:56.197051+0000","last_undegraded":"2024-05-09T00:08:56.197051+0000","last_fullsized":"2024-05-09T00:08:56.197051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483648+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:08:58.483648+0000","last_peered":"2024-05-09T00:08:58.483648+0000","last_clean":"2024-05-09T00:08:58.483648+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:08:58.483648+0000","last_undegraded":"2024-05-09T00:08:58.483648+0000","last_fullsized":"2024-05-09T00:08:58.483648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203001+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:08:56.203001+0000","last_peered":"2024-05-09T00:08:56.203001+0000","last_clean":"2024-05-09T00:08:56.203001+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:08:56.203001+0000","last_undegraded":"2024-05-09T00:08:56.203001+0000","last_fullsized":"2024-05-09T00:08:56.203001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200765+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:08:56.200765+0000","last_peered":"2024-05-09T00:08:56.200765+0000","last_clean":"2024-05-09T00:08:56.200765+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:08:56.200765+0000","last_undegraded":"2024-05-09T00:08:56.200765+0000","last_fullsized":"2024-05-09T00:08:56.200765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192950+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:08:56.192950+0000","last_peered":"2024-05-09T00:08:56.192950+0000","last_clean":"2024-05-09T00:08:56.192950+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:08:56.192950+0000","last_undegraded":"2024-05-09T00:08:56.192950+0000","last_fullsized":"2024-05-09T00:08:56.192950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392699+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:08:57.392699+0000","last_peered":"2024-05-09T00:08:57.392699+0000","last_clean":"2024-05-09T00:08:57.392699+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:08:57.392699+0000","last_undegraded":"2024-05-09T00:08:57.392699+0000","last_fullsized":"2024-05-09T00:08:57.392699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193833+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:08:56.193833+0000","last_peered":"2024-05-09T00:08:56.193833+0000","last_clean":"2024-05-09T00:08:56.193833+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:08:56.193833+0000","last_undegraded":"2024-05-09T00:08:56.193833+0000","last_fullsized":"2024-05-09T00:08:56.193833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196411+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:08:56.196411+0000","last_peered":"2024-05-09T00:08:56.196411+0000","last_clean":"2024-05-09T00:08:56.196411+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:08:56.196411+0000","last_undegraded":"2024-05-09T00:08:56.196411+0000","last_fullsized":"2024-05-09T00:08:56.196411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390854+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:08:57.390854+0000","last_peered":"2024-05-09T00:08:57.390854+0000","last_clean":"2024-05-09T00:08:57.390854+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:08:57.390854+0000","last_undegraded":"2024-05-09T00:08:57.390854+0000","last_fullsized":"2024-05-09T00:08:57.390854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201112+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:08:56.201112+0000","last_peered":"2024-05-09T00:08:56.201112+0000","last_clean":"2024-05-09T00:08:56.201112+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:08:56.201112+0000","last_undegraded":"2024-05-09T00:08:56.201112+0000","last_fullsized":"2024-05-09T00:08:56.201112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193732+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:08:56.193732+0000","last_peered":"2024-05-09T00:08:56.193732+0000","last_clean":"2024-05-09T00:08:56.193732+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:08:56.193732+0000","last_undegraded":"2024-05-09T00:08:56.193732+0000","last_fullsized":"2024-05-09T00:08:56.193732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:08:56.200164+0000","last_peered":"2024-05-09T00:08:56.200164+0000","last_clean":"2024-05-09T00:08:56.200164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:08:56.200164+0000","last_undegraded":"2024-05-09T00:08:56.200164+0000","last_fullsized":"2024-05-09T00:08:56.200164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202110+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:08:56.202110+0000","last_peered":"2024-05-09T00:08:56.202110+0000","last_clean":"2024-05-09T00:08:56.202110+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:08:56.202110+0000","last_undegraded":"2024-05-09T00:08:56.202110+0000","last_fullsized":"2024-05-09T00:08:56.202110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482784+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:08:58.482784+0000","last_peered":"2024-05-09T00:08:58.482784+0000","last_clean":"2024-05-09T00:08:58.482784+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:08:58.482784+0000","last_undegraded":"2024-05-09T00:08:58.482784+0000","last_fullsized":"2024-05-09T00:08:58.482784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200591+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:08:56.200591+0000","last_peered":"2024-05-09T00:08:56.200591+0000","last_clean":"2024-05-09T00:08:56.200591+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:08:56.200591+0000","last_undegraded":"2024-05-09T00:08:56.200591+0000","last_fullsized":"2024-05-09T00:08:56.200591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889976+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:08:56.889976+0000","last_peered":"2024-05-09T00:08:56.889976+0000","last_clean":"2024-05-09T00:08:56.889976+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:08:56.889976+0000","last_undegraded":"2024-05-09T00:08:56.889976+0000","last_fullsized":"2024-05-09T00:08:56.889976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209268+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:08:57.209268+0000","last_peered":"2024-05-09T00:08:57.209268+0000","last_clean":"2024-05-09T00:08:57.209268+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:08:57.209268+0000","last_undegraded":"2024-05-09T00:08:57.209268+0000","last_fullsized":"2024-05-09T00:08:57.209268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203840+0000","last_change":"2024-05-09T00:08:55.233084+0000","last_active":"2024-05-09T00:08:56.203840+0000","last_peered":"2024-05-09T00:08:56.203840+0000","last_clean":"2024-05-09T00:08:56.203840+0000","last_became_active":"2024-05-09T00:08:55.232717+0000","last_became_peered":"2024-05-09T00:08:55.232717+0000","last_unstale":"2024-05-09T00:08:56.203840+0000","last_undegraded":"2024-05-09T00:08:56.203840+0000","last_fullsized":"2024-05-09T00:08:56.203840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:17.144317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479553+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:08:58.479553+0000","last_peered":"2024-05-09T00:08:58.479553+0000","last_clean":"2024-05-09T00:08:58.479553+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:08:58.479553+0000","last_undegraded":"2024-05-09T00:08:58.479553+0000","last_fullsized":"2024-05-09T00:08:58.479553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202145+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:08:56.202145+0000","last_peered":"2024-05-09T00:08:56.202145+0000","last_clean":"2024-05-09T00:08:56.202145+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:08:56.202145+0000","last_undegraded":"2024-05-09T00:08:56.202145+0000","last_fullsized":"2024-05-09T00:08:56.202145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.207457+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:08:57.207457+0000","last_peered":"2024-05-09T00:08:57.207457+0000","last_clean":"2024-05-09T00:08:57.207457+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:08:57.207457+0000","last_undegraded":"2024-05-09T00:08:57.207457+0000","last_fullsized":"2024-05-09T00:08:57.207457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.482839+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:08:58.482839+0000","last_peered":"2024-05-09T00:08:58.482839+0000","last_clean":"2024-05-09T00:08:58.482839+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:08:58.482839+0000","last_undegraded":"2024-05-09T00:08:58.482839+0000","last_fullsized":"2024-05-09T00:08:58.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.193028+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:08:56.193028+0000","last_peered":"2024-05-09T00:08:56.193028+0000","last_clean":"2024-05-09T00:08:56.193028+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:08:56.193028+0000","last_undegraded":"2024-05-09T00:08:56.193028+0000","last_fullsized":"2024-05-09T00:08:56.193028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201944+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:08:56.201944+0000","last_peered":"2024-05-09T00:08:56.201944+0000","last_clean":"2024-05-09T00:08:56.201944+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:08:56.201944+0000","last_undegraded":"2024-05-09T00:08:56.201944+0000","last_fullsized":"2024-05-09T00:08:56.201944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.200283+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:08:56.200283+0000","last_peered":"2024-05-09T00:08:56.200283+0000","last_clean":"2024-05-09T00:08:56.200283+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:08:56.200283+0000","last_undegraded":"2024-05-09T00:08:56.200283+0000","last_fullsized":"2024-05-09T00:08:56.200283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475873+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:08:58.475873+0000","last_peered":"2024-05-09T00:08:58.475873+0000","last_clean":"2024-05-09T00:08:58.475873+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:08:58.475873+0000","last_undegraded":"2024-05-09T00:08:58.475873+0000","last_fullsized":"2024-05-09T00:08:58.475873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391826+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:08:57.391826+0000","last_peered":"2024-05-09T00:08:57.391826+0000","last_clean":"2024-05-09T00:08:57.391826+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:08:57.391826+0000","last_undegraded":"2024-05-09T00:08:57.391826+0000","last_fullsized":"2024-05-09T00:08:57.391826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476268+0000","last_change":"2024-05-09T00:08:55.244535+0000","last_active":"2024-05-09T00:08:58.476268+0000","last_peered":"2024-05-09T00:08:58.476268+0000","last_clean":"2024-05-09T00:08:58.476268+0000","last_became_active":"2024-05-09T00:08:55.241846+0000","last_became_peered":"2024-05-09T00:08:55.241846+0000","last_unstale":"2024-05-09T00:08:58.476268+0000","last_undegraded":"2024-05-09T00:08:58.476268+0000","last_fullsized":"2024-05-09T00:08:58.476268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:59.670906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392091+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:08:57.392091+0000","last_peered":"2024-05-09T00:08:57.392091+0000","last_clean":"2024-05-09T00:08:57.392091+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:08:57.392091+0000","last_undegraded":"2024-05-09T00:08:57.392091+0000","last_fullsized":"2024-05-09T00:08:57.392091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192414+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:08:56.192414+0000","last_peered":"2024-05-09T00:08:56.192414+0000","last_clean":"2024-05-09T00:08:56.192414+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:08:56.192414+0000","last_undegraded":"2024-05-09T00:08:56.192414+0000","last_fullsized":"2024-05-09T00:08:56.192414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483620+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:08:58.483620+0000","last_peered":"2024-05-09T00:08:58.483620+0000","last_clean":"2024-05-09T00:08:58.483620+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:08:58.483620+0000","last_undegraded":"2024-05-09T00:08:58.483620+0000","last_fullsized":"2024-05-09T00:08:58.483620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480061+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:08:58.480061+0000","last_peered":"2024-05-09T00:08:58.480061+0000","last_clean":"2024-05-09T00:08:58.480061+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:08:58.480061+0000","last_undegraded":"2024-05-09T00:08:58.480061+0000","last_fullsized":"2024-05-09T00:08:58.480061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203390+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:08:56.203390+0000","last_peered":"2024-05-09T00:08:56.203390+0000","last_clean":"2024-05-09T00:08:56.203390+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:08:56.203390+0000","last_undegraded":"2024-05-09T00:08:56.203390+0000","last_fullsized":"2024-05-09T00:08:56.203390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208491+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:08:57.208491+0000","last_peered":"2024-05-09T00:08:57.208491+0000","last_clean":"2024-05-09T00:08:57.208491+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:08:57.208491+0000","last_undegraded":"2024-05-09T00:08:57.208491+0000","last_fullsized":"2024-05-09T00:08:57.208491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192642+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:08:56.192642+0000","last_peered":"2024-05-09T00:08:56.192642+0000","last_clean":"2024-05-09T00:08:56.192642+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:08:56.192642+0000","last_undegraded":"2024-05-09T00:08:56.192642+0000","last_fullsized":"2024-05-09T00:08:56.192642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194878+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:08:56.194878+0000","last_peered":"2024-05-09T00:08:56.194878+0000","last_clean":"2024-05-09T00:08:56.194878+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:08:56.194878+0000","last_undegraded":"2024-05-09T00:08:56.194878+0000","last_fullsized":"2024-05-09T00:08:56.194878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.197258+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:08:56.197258+0000","last_peered":"2024-05-09T00:08:56.197258+0000","last_clean":"2024-05-09T00:08:56.197258+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:08:56.197258+0000","last_undegraded":"2024-05-09T00:08:56.197258+0000","last_fullsized":"2024-05-09T00:08:56.197258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391526+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:08:57.391526+0000","last_peered":"2024-05-09T00:08:57.391526+0000","last_clean":"2024-05-09T00:08:57.391526+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:08:57.391526+0000","last_undegraded":"2024-05-09T00:08:57.391526+0000","last_fullsized":"2024-05-09T00:08:57.391526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889612+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:08:56.889612+0000","last_peered":"2024-05-09T00:08:56.889612+0000","last_clean":"2024-05-09T00:08:56.889612+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:08:56.889612+0000","last_undegraded":"2024-05-09T00:08:56.889612+0000","last_fullsized":"2024-05-09T00:08:56.889612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208419+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:08:57.208419+0000","last_peered":"2024-05-09T00:08:57.208419+0000","last_clean":"2024-05-09T00:08:57.208419+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:08:57.208419+0000","last_undegraded":"2024-05-09T00:08:57.208419+0000","last_fullsized":"2024-05-09T00:08:57.208419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199865+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:08:56.199865+0000","last_peered":"2024-05-09T00:08:56.199865+0000","last_clean":"2024-05-09T00:08:56.199865+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:08:56.199865+0000","last_undegraded":"2024-05-09T00:08:56.199865+0000","last_fullsized":"2024-05-09T00:08:56.199865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.480789+0000","last_change":"2024-05-09T00:08:55.235078+0000","last_active":"2024-05-09T00:08:58.480789+0000","last_peered":"2024-05-09T00:08:58.480789+0000","last_clean":"2024-05-09T00:08:58.480789+0000","last_became_active":"2024-05-09T00:08:55.234724+0000","last_became_peered":"2024-05-09T00:08:55.234724+0000","last_unstale":"2024-05-09T00:08:58.480789+0000","last_undegraded":"2024-05-09T00:08:58.480789+0000","last_fullsized":"2024-05-09T00:08:58.480789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:49.557566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478428+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:08:58.478428+0000","last_peered":"2024-05-09T00:08:58.478428+0000","last_clean":"2024-05-09T00:08:58.478428+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:08:58.478428+0000","last_undegraded":"2024-05-09T00:08:58.478428+0000","last_fullsized":"2024-05-09T00:08:58.478428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477100+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:08:58.477100+0000","last_peered":"2024-05-09T00:08:58.477100+0000","last_clean":"2024-05-09T00:08:58.477100+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:08:58.477100+0000","last_undegraded":"2024-05-09T00:08:58.477100+0000","last_fullsized":"2024-05-09T00:08:58.477100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195384+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:08:56.195384+0000","last_peered":"2024-05-09T00:08:56.195384+0000","last_clean":"2024-05-09T00:08:56.195384+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:08:56.195384+0000","last_undegraded":"2024-05-09T00:08:56.195384+0000","last_fullsized":"2024-05-09T00:08:56.195384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477818+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:08:58.477818+0000","last_peered":"2024-05-09T00:08:58.477818+0000","last_clean":"2024-05-09T00:08:58.477818+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:08:58.477818+0000","last_undegraded":"2024-05-09T00:08:58.477818+0000","last_fullsized":"2024-05-09T00:08:58.477818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.209094+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:08:57.209094+0000","last_peered":"2024-05-09T00:08:57.209094+0000","last_clean":"2024-05-09T00:08:57.209094+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:08:57.209094+0000","last_undegraded":"2024-05-09T00:08:57.209094+0000","last_fullsized":"2024-05-09T00:08:57.209094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.390760+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:08:57.390760+0000","last_peered":"2024-05-09T00:08:57.390760+0000","last_clean":"2024-05-09T00:08:57.390760+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:08:57.390760+0000","last_undegraded":"2024-05-09T00:08:57.390760+0000","last_fullsized":"2024-05-09T00:08:57.390760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.195032+0000","last_change":"2024-05-09T00:08:45.104025+0000","last_active":"2024-05-09T00:08:56.195032+0000","last_peered":"2024-05-09T00:08:56.195032+0000","last_clean":"2024-05-09T00:08:56.195032+0000","last_became_active":"2024-05-09T00:08:45.103746+0000","last_became_peered":"2024-05-09T00:08:45.103746+0000","last_unstale":"2024-05-09T00:08:56.195032+0000","last_undegraded":"2024-05-09T00:08:56.195032+0000","last_fullsized":"2024-05-09T00:08:56.195032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:18.136412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.203798+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:08:56.203798+0000","last_peered":"2024-05-09T00:08:56.203798+0000","last_clean":"2024-05-09T00:08:56.203798+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:08:56.203798+0000","last_undegraded":"2024-05-09T00:08:56.203798+0000","last_fullsized":"2024-05-09T00:08:56.203798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.192629+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:08:56.192629+0000","last_peered":"2024-05-09T00:08:56.192629+0000","last_clean":"2024-05-09T00:08:56.192629+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:08:56.192629+0000","last_undegraded":"2024-05-09T00:08:56.192629+0000","last_fullsized":"2024-05-09T00:08:56.192629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890359+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:08:56.890359+0000","last_peered":"2024-05-09T00:08:56.890359+0000","last_clean":"2024-05-09T00:08:56.890359+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:08:56.890359+0000","last_undegraded":"2024-05-09T00:08:56.890359+0000","last_fullsized":"2024-05-09T00:08:56.890359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196305+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:08:56.196305+0000","last_peered":"2024-05-09T00:08:56.196305+0000","last_clean":"2024-05-09T00:08:56.196305+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:08:56.196305+0000","last_undegraded":"2024-05-09T00:08:56.196305+0000","last_fullsized":"2024-05-09T00:08:56.196305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890049+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:08:56.890049+0000","last_peered":"2024-05-09T00:08:56.890049+0000","last_clean":"2024-05-09T00:08:56.890049+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:08:56.890049+0000","last_undegraded":"2024-05-09T00:08:56.890049+0000","last_fullsized":"2024-05-09T00:08:56.890049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.391151+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:08:57.391151+0000","last_peered":"2024-05-09T00:08:57.391151+0000","last_clean":"2024-05-09T00:08:57.391151+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:08:57.391151+0000","last_undegraded":"2024-05-09T00:08:57.391151+0000","last_fullsized":"2024-05-09T00:08:57.391151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.194404+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:08:56.194404+0000","last_peered":"2024-05-09T00:08:56.194404+0000","last_clean":"2024-05-09T00:08:56.194404+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:08:56.194404+0000","last_undegraded":"2024-05-09T00:08:56.194404+0000","last_fullsized":"2024-05-09T00:08:56.194404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392564+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:08:57.392564+0000","last_peered":"2024-05-09T00:08:57.392564+0000","last_clean":"2024-05-09T00:08:57.392564+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:08:57.392564+0000","last_undegraded":"2024-05-09T00:08:57.392564+0000","last_fullsized":"2024-05-09T00:08:57.392564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.198404+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:08:56.198404+0000","last_peered":"2024-05-09T00:08:56.198404+0000","last_clean":"2024-05-09T00:08:56.198404+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:08:56.198404+0000","last_undegraded":"2024-05-09T00:08:56.198404+0000","last_fullsized":"2024-05-09T00:08:56.198404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477905+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:08:58.477905+0000","last_peered":"2024-05-09T00:08:58.477905+0000","last_clean":"2024-05-09T00:08:58.477905+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:08:58.477905+0000","last_undegraded":"2024-05-09T00:08:58.477905+0000","last_fullsized":"2024-05-09T00:08:58.477905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.392407+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:08:57.392407+0000","last_peered":"2024-05-09T00:08:57.392407+0000","last_clean":"2024-05-09T00:08:57.392407+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:08:57.392407+0000","last_undegraded":"2024-05-09T00:08:57.392407+0000","last_fullsized":"2024-05-09T00:08:57.392407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476613+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:08:58.476613+0000","last_peered":"2024-05-09T00:08:58.476613+0000","last_clean":"2024-05-09T00:08:58.476613+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:08:58.476613+0000","last_undegraded":"2024-05-09T00:08:58.476613+0000","last_fullsized":"2024-05-09T00:08:58.476613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.475819+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:08:58.475819+0000","last_peered":"2024-05-09T00:08:58.475819+0000","last_clean":"2024-05-09T00:08:58.475819+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:08:58.475819+0000","last_undegraded":"2024-05-09T00:08:58.475819+0000","last_fullsized":"2024-05-09T00:08:58.475819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477248+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:08:58.477248+0000","last_peered":"2024-05-09T00:08:58.477248+0000","last_clean":"2024-05-09T00:08:58.477248+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:08:58.477248+0000","last_undegraded":"2024-05-09T00:08:58.477248+0000","last_fullsized":"2024-05-09T00:08:58.477248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.476388+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:08:58.476388+0000","last_peered":"2024-05-09T00:08:58.476388+0000","last_clean":"2024-05-09T00:08:58.476388+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:08:58.476388+0000","last_undegraded":"2024-05-09T00:08:58.476388+0000","last_fullsized":"2024-05-09T00:08:58.476388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.890836+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:08:56.890836+0000","last_peered":"2024-05-09T00:08:56.890836+0000","last_clean":"2024-05-09T00:08:56.890836+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:08:56.890836+0000","last_undegraded":"2024-05-09T00:08:56.890836+0000","last_fullsized":"2024-05-09T00:08:56.890836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.201717+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:08:56.201717+0000","last_peered":"2024-05-09T00:08:56.201717+0000","last_clean":"2024-05-09T00:08:56.201717+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:08:56.201717+0000","last_undegraded":"2024-05-09T00:08:56.201717+0000","last_fullsized":"2024-05-09T00:08:56.201717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.196109+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:08:56.196109+0000","last_peered":"2024-05-09T00:08:56.196109+0000","last_clean":"2024-05-09T00:08:56.196109+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:08:56.196109+0000","last_undegraded":"2024-05-09T00:08:56.196109+0000","last_fullsized":"2024-05-09T00:08:56.196109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483808+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:08:58.483808+0000","last_peered":"2024-05-09T00:08:58.483808+0000","last_clean":"2024-05-09T00:08:58.483808+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:08:58.483808+0000","last_undegraded":"2024-05-09T00:08:58.483808+0000","last_fullsized":"2024-05-09T00:08:58.483808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.477114+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:08:58.477114+0000","last_peered":"2024-05-09T00:08:58.477114+0000","last_clean":"2024-05-09T00:08:58.477114+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:08:58.477114+0000","last_undegraded":"2024-05-09T00:08:58.477114+0000","last_fullsized":"2024-05-09T00:08:58.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199054+0000","last_change":"2024-05-09T00:08:55.237921+0000","last_active":"2024-05-09T00:08:56.199054+0000","last_peered":"2024-05-09T00:08:56.199054+0000","last_clean":"2024-05-09T00:08:56.199054+0000","last_became_active":"2024-05-09T00:08:55.235634+0000","last_became_peered":"2024-05-09T00:08:55.235634+0000","last_unstale":"2024-05-09T00:08:56.199054+0000","last_undegraded":"2024-05-09T00:08:56.199054+0000","last_fullsized":"2024-05-09T00:08:56.199054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:00:10.548921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.481101+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:08:58.481101+0000","last_peered":"2024-05-09T00:08:58.481101+0000","last_clean":"2024-05-09T00:08:58.481101+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:08:58.481101+0000","last_undegraded":"2024-05-09T00:08:58.481101+0000","last_fullsized":"2024-05-09T00:08:58.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.889693+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:08:56.889693+0000","last_peered":"2024-05-09T00:08:56.889693+0000","last_clean":"2024-05-09T00:08:56.889693+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:08:56.889693+0000","last_undegraded":"2024-05-09T00:08:56.889693+0000","last_fullsized":"2024-05-09T00:08:56.889693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478553+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:08:58.478553+0000","last_peered":"2024-05-09T00:08:58.478553+0000","last_clean":"2024-05-09T00:08:58.478553+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:08:58.478553+0000","last_undegraded":"2024-05-09T00:08:58.478553+0000","last_fullsized":"2024-05-09T00:08:58.478553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:57.208050+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:08:57.208050+0000","last_peered":"2024-05-09T00:08:57.208050+0000","last_clean":"2024-05-09T00:08:57.208050+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:08:57.208050+0000","last_undegraded":"2024-05-09T00:08:57.208050+0000","last_fullsized":"2024-05-09T00:08:57.208050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.483038+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:08:58.483038+0000","last_peered":"2024-05-09T00:08:58.483038+0000","last_clean":"2024-05-09T00:08:58.483038+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:08:58.483038+0000","last_undegraded":"2024-05-09T00:08:58.483038+0000","last_fullsized":"2024-05-09T00:08:58.483038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.199866+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:08:56.199866+0000","last_peered":"2024-05-09T00:08:56.199866+0000","last_clean":"2024-05-09T00:08:56.199866+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:08:56.199866+0000","last_undegraded":"2024-05-09T00:08:56.199866+0000","last_fullsized":"2024-05-09T00:08:56.199866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202014+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:08:56.202014+0000","last_peered":"2024-05-09T00:08:56.202014+0000","last_clean":"2024-05-09T00:08:56.202014+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:08:56.202014+0000","last_undegraded":"2024-05-09T00:08:56.202014+0000","last_fullsized":"2024-05-09T00:08:56.202014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479550+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:08:58.479550+0000","last_peered":"2024-05-09T00:08:58.479550+0000","last_clean":"2024-05-09T00:08:58.479550+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:08:58.479550+0000","last_undegraded":"2024-05-09T00:08:58.479550+0000","last_fullsized":"2024-05-09T00:08:58.479550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:56.202889+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:08:56.202889+0000","last_peered":"2024-05-09T00:08:56.202889+0000","last_clean":"2024-05-09T00:08:56.202889+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:08:56.202889+0000","last_undegraded":"2024-05-09T00:08:56.202889+0000","last_fullsized":"2024-05-09T00:08:56.202889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.479863+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:08:58.479863+0000","last_peered":"2024-05-09T00:08:58.479863+0000","last_clean":"2024-05-09T00:08:58.479863+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:08:58.479863+0000","last_undegraded":"2024-05-09T00:08:58.479863+0000","last_fullsized":"2024-05-09T00:08:58.479863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-09T00:08:58.478406+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:08:58.478406+0000","last_peered":"2024-05-09T00:08:58.478406+0000","last_clean":"2024-05-09T00:08:58.478406+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:08:58.478406+0000","last_undegraded":"2024-05-09T00:08:58.478406+0000","last_fullsized":"2024-05-09T00:08:58.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":695661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":107510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":104765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":110040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:09:27.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.779+0000 7fe92e400640 1 Processor -- start 2024-05-09T00:09:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.779+0000 7fe92e400640 1 -- start start 2024-05-09T00:09:27.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.781+0000 7fe92e400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe9280accb0 0x7fe9280ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.781+0000 7fe92e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 0x7fe9280af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.781+0000 7fe92e400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280ad0c0 con 0x7fe9280aba00 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.781+0000 7fe92e400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe928156260 con 0x7fe9280accb0 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.781+0000 7fe92e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe9280ad340 con 0x7fe9280aed60 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe92d000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9280aba00 0x7fe9281566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41806/0 (socket says 172.21.15.114:41806) 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe92d000640 1 -- 172.21.15.114:0/4262061210 learned_addr learned my addr 172.21.15.114:0/4262061210 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865076743 0 0) 0x7fe91c001110 con 0x7fe9280aba00 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe910003520 con 0x7fe9280aba00 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927e00640 1 --2- 172.21.15.114:0/4262061210 >> v2:172.21.15.153:3300/0 conn(0x7fe9280accb0 0x7fe9280ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe92da00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 0x7fe9280af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087375114 0 0) 0x7fe910003520 con 0x7fe9280aba00 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 msgr2=0x7fe9280af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 0x7fe9280af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 >> v2:172.21.15.153:3300/0 conn(0x7fe9280accb0 msgr2=0x7fe9280ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 --2- 172.21.15.114:0/4262061210 >> v2:172.21.15.153:3300/0 conn(0x7fe9280accb0 0x7fe9280ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe928155f10 con 0x7fe9280aba00 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.782+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fe91c0018c0 con 0x7fe9280aba00 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 >> v1:172.21.15.114:6789/0 conn(0x7fe9280aba00 legacy=0x7fe9281566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 0x7fe910003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe910004080 0x7fe910004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004d40 0x7fe910005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe928156260 con 0x7fe910004080 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280ad340 con 0x7fe910004d40 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe91000bca0 con 0x7fe9280aed60 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927e00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe910004080 0x7fe910004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe92da00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004d40 0x7fe910005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe92d000640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 0x7fe910003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927e00640 1 -- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 msgr2=0x7fe910003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:27.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927e00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9280aed60 0x7fe910003a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927e00640 1 -- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004d40 msgr2=0x7fe910005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:27.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927e00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004d40 0x7fe910005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe927e00640 1 -- 172.21.15.114:0/4262061210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe910003520 con 0x7fe910004080 2024-05-09T00:09:27.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.783+0000 7fe92da00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004d40 0x7fe910005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:27.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.784+0000 7fe927e00640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe910004080 0x7fe910004800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe91400ba00 tx=0x7fe910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471ef04963eab03 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:27.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914030070 con 0x7fe910004080 2024-05-09T00:09:27.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91402ade0 con 0x7fe910004080 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe927400640 1 -- 172.21.15.114:0/4262061210 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91400b600 con 0x7fe910004080 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe92e400640 1 -- 172.21.15.114:0/4262061210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe910004080 msgr2=0x7fe910004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe92e400640 1 --2- 172.21.15.114:0/4262061210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe910004080 0x7fe910004800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe91400ba00 tx=0x7fe910005830 comp rx=0 tx=0).stop 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe92da00640 1 -- 172.21.15.114:0/4262061210 reap_dead start 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe92e400640 1 -- 172.21.15.114:0/4262061210 shutdown_connections 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.785+0000 7fe92e400640 1 -- 172.21.15.114:0/4262061210 >> 172.21.15.114:0/4262061210 conn(0x7fe9280c9730 msgr2=0x7fe9280c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.786+0000 7fe92e400640 1 -- 172.21.15.114:0/4262061210 shutdown_connections 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.786+0000 7fe92e400640 1 -- 172.21.15.114:0/4262061210 wait complete. 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.788+0000 7fe92e400640 1 Processor -- start 2024-05-09T00:09:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.788+0000 7fe92e400640 1 -- start start 2024-05-09T00:09:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe92e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004080 0x7fe9281ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe92e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 0x7fe928139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe92e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe928139a90 0x7fe928136fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe92e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280c5220 con 0x7fe928137b80 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe92e400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280c4f40 con 0x7fe910004080 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe92e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe9280c4920 con 0x7fe928139a90 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.789+0000 7fe927e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 0x7fe928139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 0x7fe928139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38800/0 (socket says 172.21.15.114:38800) 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 -- 172.21.15.114:0/3310901504 learned_addr learned my addr 172.21.15.114:0/3310901504 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe92d000640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004080 0x7fe9281ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe92da00640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe928139a90 0x7fe928136fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 -- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe928139a90 msgr2=0x7fe928136fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe928139a90 0x7fe928136fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 -- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004080 msgr2=0x7fe9281ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004080 0x7fe9281ed360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 -- 172.21.15.114:0/3310901504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9281edcc0 con 0x7fe928137b80 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.790+0000 7fe927e00640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 0x7fe928139550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe91400baf0 tx=0x7fe9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.791+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914043030 con 0x7fe928137b80 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.791+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe914035eb0 con 0x7fe928137b80 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.791+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914004020 con 0x7fe928137b80 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.791+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9281edfa0 con 0x7fe928137b80 2024-05-09T00:09:27.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.791+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92813cd50 con 0x7fe928137b80 2024-05-09T00:09:27.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.792+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92813d130 con 0x7fe928137b80 2024-05-09T00:09:27.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.793+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe914046070 con 0x7fe928137b80 2024-05-09T00:09:27.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.794+0000 7fe924c00640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9080762a0 0x7fe9080787b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:27.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.794+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fe9140b85b0 con 0x7fe928137b80 2024-05-09T00:09:27.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.794+0000 7fe92d000640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9080762a0 0x7fe9080787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:27.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.795+0000 7fe92d000640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9080762a0 0x7fe9080787b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe91c001410 tx=0x7fe91c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:27.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:27.800+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe92813d130 con 0x7fe928137b80 2024-05-09T00:09:28.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.046+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe928078430 con 0x7fe928137b80 2024-05-09T00:09:28.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.048+0000 7fe924c00640 1 -- 172.21.15.114:0/3310901504 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fe914081bd0 con 0x7fe928137b80 2024-05-09T00:09:28.045 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:28.045 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:28.045 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9080762a0 msgr2=0x7fe9080787b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9080762a0 0x7fe9080787b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe91c001410 tx=0x7fe91c009040 comp rx=0 tx=0).stop 2024-05-09T00:09:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 msgr2=0x7fe928139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 0x7fe928139550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe91400baf0 tx=0x7fe9140046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 shutdown_connections 2024-05-09T00:09:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9080762a0 0x7fe9080787b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe928139a90 0x7fe928136fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe928137b80 0x7fe928139550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 --2- 172.21.15.114:0/3310901504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910004080 0x7fe9281ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.050+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 >> 172.21.15.114:0/3310901504 conn(0x7fe9280c9730 msgr2=0x7fe928155330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:28.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.051+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 shutdown_connections 2024-05-09T00:09:28.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.051+0000 7fe92e400640 1 -- 172.21.15.114:0/3310901504 wait complete. 2024-05-09T00:09:28.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:28.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.343+0000 7feece400640 1 Processor -- start 2024-05-09T00:09:28.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.344+0000 7feece400640 1 -- start start 2024-05-09T00:09:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feece400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feec80c43c0 0x7feec8153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feece400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feec8159830 0x7feec8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feece400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec8156bb0 con 0x7feec815a180 2024-05-09T00:09:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feece400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7feec80ac710 con 0x7feec8159830 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feece400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7feec8156e90 con 0x7feec80c43c0 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feec6a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feec8159830 0x7feec8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feec7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feec815a180 0x7feec806f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32916/0 (socket says 172.21.15.114:32916) 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feec7e00640 1 -- 172.21.15.114:0/1087394056 learned_addr learned my addr 172.21.15.114:0/1087394056 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.346+0000 7feec6a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feec8159830 0x7feec8159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58358/0 (socket says 172.21.15.114:58358) 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.347+0000 7feec7400640 1 --2- 172.21.15.114:0/1087394056 >> v2:172.21.15.153:3300/0 conn(0x7feec80c43c0 0x7feec8153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.347+0000 7feec6a00640 1 -- 172.21.15.114:0/1087394056 >> v2:172.21.15.153:3300/0 conn(0x7feec80c43c0 msgr2=0x7feec8153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.347+0000 7feec6a00640 1 --2- 172.21.15.114:0/1087394056 >> v2:172.21.15.153:3300/0 conn(0x7feec80c43c0 0x7feec8153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.347+0000 7feec6a00640 1 -- 172.21.15.114:0/1087394056 >> v1:172.21.15.114:6789/0 conn(0x7feec815a180 legacy=0x7feec806f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.347+0000 7feec6a00640 1 -- 172.21.15.114:0/1087394056 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80ac960 con 0x7feec8159830 2024-05-09T00:09:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.347+0000 7feec6000640 1 -- 172.21.15.114:0/1087394056 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759440272 0 0) 0x7feec8156bb0 con 0x7feec815a180 2024-05-09T00:09:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.348+0000 7feec6a00640 1 --2- 172.21.15.114:0/1087394056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8159c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feec8071b30 tx=0x7feeb002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cc7a14b1967b9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.348+0000 7feec6000640 1 -- 172.21.15.114:0/1087394056 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0037070 con 0x7feec8159830 2024-05-09T00:09:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.348+0000 7feec6000640 1 -- 172.21.15.114:0/1087394056 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb0032440 con 0x7feec8159830 2024-05-09T00:09:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.348+0000 7feec6000640 1 -- 172.21.15.114:0/1087394056 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb002ae60 con 0x7feec8159830 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 -- 172.21.15.114:0/1087394056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 msgr2=0x7feec8159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 --2- 172.21.15.114:0/1087394056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8159c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feec8071b30 tx=0x7feeb002a110 comp rx=0 tx=0).stop 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 -- 172.21.15.114:0/1087394056 shutdown_connections 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 --2- 172.21.15.114:0/1087394056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8159c40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 --2- 172.21.15.114:0/1087394056 >> v2:172.21.15.153:3300/0 conn(0x7feec80c43c0 0x7feec8153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 -- 172.21.15.114:0/1087394056 >> 172.21.15.114:0/1087394056 conn(0x7feec806c680 msgr2=0x7feec806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 -- 172.21.15.114:0/1087394056 shutdown_connections 2024-05-09T00:09:28.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.349+0000 7feece400640 1 -- 172.21.15.114:0/1087394056 wait complete. 2024-05-09T00:09:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.352+0000 7feece400640 1 Processor -- start 2024-05-09T00:09:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.352+0000 7feece400640 1 -- start start 2024-05-09T00:09:28.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feece400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec80c43c0 0x7feec81e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feece400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feece400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feec815a180 0x7feec8144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feece400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feec806fab0 con 0x7feec8159830 2024-05-09T00:09:28.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feece400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feec80ad3c0 con 0x7feec80c43c0 2024-05-09T00:09:28.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feece400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feec806fc30 con 0x7feec815a180 2024-05-09T00:09:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.353+0000 7feec6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58370/0 (socket says 172.21.15.114:58370) 2024-05-09T00:09:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 -- 172.21.15.114:0/3179974005 learned_addr learned my addr 172.21.15.114:0/3179974005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 -- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feec815a180 msgr2=0x7feec8144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feec815a180 0x7feec8144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec7400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec80c43c0 0x7feec81e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 -- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec80c43c0 msgr2=0x7feec81e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec80c43c0 0x7feec81e1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 -- 172.21.15.114:0/3179974005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec81df790 con 0x7feec8159830 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.354+0000 7feec6a00640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8157200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009890 tx=0x7feeb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.355+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0037040 con 0x7feec8159830 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.355+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb0042070 con 0x7feec8159830 2024-05-09T00:09:28.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.355+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0030bd0 con 0x7feec8159830 2024-05-09T00:09:28.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.355+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec81dfa30 con 0x7feec8159830 2024-05-09T00:09:28.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.355+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81e24e0 con 0x7feec8159830 2024-05-09T00:09:28.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.356+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec8077430 con 0x7feec8159830 2024-05-09T00:09:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.357+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feeb0047460 con 0x7feec8159830 2024-05-09T00:09:28.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.359+0000 7feebf400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feea4076300 0x7feea4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.359+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7feeb00b84d0 con 0x7feec8159830 2024-05-09T00:09:28.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.359+0000 7feec7400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feea4076300 0x7feea4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.360+0000 7feec7400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feea4076300 0x7feea4078810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feeb8006fd0 tx=0x7feeb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.364+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feeb0032e20 con 0x7feec8159830 2024-05-09T00:09:28.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.561+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feec8145350 con 0x7feec8159830 2024-05-09T00:09:28.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.565+0000 7feebf400640 1 -- 172.21.15.114:0/3179974005 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7feeb0081af0 con 0x7feec8159830 2024-05-09T00:09:28.563 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:28.563 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:28.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.568+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feea4076300 msgr2=0x7feea4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.568+0000 7feece400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feea4076300 0x7feea4078810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feeb8006fd0 tx=0x7feeb8008040 comp rx=0 tx=0).stop 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.568+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 msgr2=0x7feec8157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.568+0000 7feece400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8157200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009890 tx=0x7feeb00046c0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 shutdown_connections 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feea4076300 0x7feea4078810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feec815a180 0x7feec8144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feec8159830 0x7feec8157200 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 --2- 172.21.15.114:0/3179974005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec80c43c0 0x7feec81e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 >> 172.21.15.114:0/3179974005 conn(0x7feec806c680 msgr2=0x7feec806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 shutdown_connections 2024-05-09T00:09:28.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.569+0000 7feece400640 1 -- 172.21.15.114:0/3179974005 wait complete. 2024-05-09T00:09:28.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:28.592 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2024-05-09T00:09:28.592 INFO:tasks.mds_thrash.fs.[a]:waiting for 99 secs before thrashing 2024-05-09T00:09:28.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.860+0000 7fe88cc00640 1 Processor -- start 2024-05-09T00:09:28.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.860+0000 7fe88cc00640 1 -- start start 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe88cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe888072720 0x7fe8880c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe88cc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8881585c0 0x7fe8881589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe88cc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe888074040 con 0x7fe888073800 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe88cc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe888073df0 con 0x7fe888072720 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe88cc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe8880c5f40 con 0x7fe8881585c0 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe885e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe888073800 0x7fe8880c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32926/0 (socket says 172.21.15.114:32926) 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe885e00640 1 -- 172.21.15.114:0/1376484095 learned_addr learned my addr 172.21.15.114:0/1376484095 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:09:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe87d400640 1 --2- 172.21.15.114:0/1376484095 >> v2:172.21.15.114:3300/0 conn(0x7fe888072720 0x7fe8880c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe886800640 1 --2- 172.21.15.114:0/1376484095 >> v2:172.21.15.153:3300/0 conn(0x7fe8881585c0 0x7fe8881589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.862+0000 7fe885400640 1 -- 172.21.15.114:0/1376484095 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472574535 0 0) 0x7fe888074040 con 0x7fe888073800 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.863+0000 7fe885400640 1 -- 172.21.15.114:0/1376484095 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86c005730 con 0x7fe888073800 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.863+0000 7fe87d400640 1 -- 172.21.15.114:0/1376484095 >> v2:172.21.15.153:3300/0 conn(0x7fe8881585c0 msgr2=0x7fe8881589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.863+0000 7fe87d400640 1 --2- 172.21.15.114:0/1376484095 >> v2:172.21.15.153:3300/0 conn(0x7fe8881585c0 0x7fe8881589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.863+0000 7fe87d400640 1 -- 172.21.15.114:0/1376484095 >> v1:172.21.15.114:6789/0 conn(0x7fe888073800 legacy=0x7fe8880c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.863+0000 7fe87d400640 1 -- 172.21.15.114:0/1376484095 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880c58f0 con 0x7fe888072720 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.864+0000 7fe87d400640 1 --2- 172.21.15.114:0/1376484095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c63d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe88806d740 tx=0x7fe87002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2121d3cc63294240 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.864+0000 7fe885400640 1 -- 172.21.15.114:0/1376484095 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870037070 con 0x7fe888072720 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.864+0000 7fe885400640 1 -- 172.21.15.114:0/1376484095 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870032440 con 0x7fe888072720 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.864+0000 7fe885400640 1 -- 172.21.15.114:0/1376484095 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8700327f0 con 0x7fe888072720 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 -- 172.21.15.114:0/1376484095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 msgr2=0x7fe8880c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1376484095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c63d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe88806d740 tx=0x7fe87002a1a0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 -- 172.21.15.114:0/1376484095 shutdown_connections 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1376484095 >> v2:172.21.15.153:3300/0 conn(0x7fe8881585c0 0x7fe8881589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1376484095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c63d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 -- 172.21.15.114:0/1376484095 >> 172.21.15.114:0/1376484095 conn(0x7fe88806c680 msgr2=0x7fe88806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 -- 172.21.15.114:0/1376484095 shutdown_connections 2024-05-09T00:09:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.865+0000 7fe88cc00640 1 -- 172.21.15.114:0/1376484095 wait complete. 2024-05-09T00:09:28.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.867+0000 7fe88cc00640 1 Processor -- start 2024-05-09T00:09:28.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.867+0000 7fe88cc00640 1 -- start start 2024-05-09T00:09:28.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe88cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe88cc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe888073800 0x7fe88814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe88cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8881585c0 0x7fe88813dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe88cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe888074320 con 0x7fe888072720 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe88cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe888072b30 con 0x7fe8881585c0 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe88cc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe88814ce80 con 0x7fe888073800 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe885e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe885e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58388/0 (socket says 172.21.15.114:58388) 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe885e00640 1 -- 172.21.15.114:0/1117419969 learned_addr learned my addr 172.21.15.114:0/1117419969 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe886800640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8881585c0 0x7fe88813dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.869+0000 7fe87d400640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe888073800 0x7fe88814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe885e00640 1 -- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe888073800 msgr2=0x7fe88814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe885e00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe888073800 0x7fe88814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe885e00640 1 -- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8881585c0 msgr2=0x7fe88813dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:28.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe885e00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8881585c0 0x7fe88813dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:28.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe885e00640 1 -- 172.21.15.114:0/1117419969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880c9840 con 0x7fe888072720 2024-05-09T00:09:28.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe885e00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c2c70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe87800cbf0 tx=0x7fe87800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:28.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87800ad40 con 0x7fe888072720 2024-05-09T00:09:28.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878012400 con 0x7fe888072720 2024-05-09T00:09:28.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780127b0 con 0x7fe888072720 2024-05-09T00:09:28.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8880c90a0 con 0x7fe888072720 2024-05-09T00:09:28.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.870+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88814ee90 con 0x7fe888072720 2024-05-09T00:09:28.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.872+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe888077430 con 0x7fe888072720 2024-05-09T00:09:28.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.873+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe878012950 con 0x7fe888072720 2024-05-09T00:09:28.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.874+0000 7fe87ea00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe8640762d0 0x7fe8640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:28.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.874+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fe878097ed0 con 0x7fe888072720 2024-05-09T00:09:28.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.874+0000 7fe87d400640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe8640762d0 0x7fe8640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:28.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.875+0000 7fe87d400640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe8640762d0 0x7fe8640787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe870034000 tx=0x7fe87002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:28.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:28.879+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe878061500 con 0x7fe888072720 2024-05-09T00:09:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.122+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8880c5610 con 0x7fe888072720 2024-05-09T00:09:29.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.123+0000 7fe87ea00640 1 -- 172.21.15.114:0/1117419969 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fe878060e00 con 0x7fe888072720 2024-05-09T00:09:29.120 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:29.120 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:09:29.120 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:09:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe8640762d0 msgr2=0x7fe8640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe8640762d0 0x7fe8640787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe870034000 tx=0x7fe87002e000 comp rx=0 tx=0).stop 2024-05-09T00:09:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 msgr2=0x7fe8880c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c2c70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe87800cbf0 tx=0x7fe87800a430 comp rx=0 tx=0).stop 2024-05-09T00:09:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 shutdown_connections 2024-05-09T00:09:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe8640762d0 0x7fe8640787e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8881585c0 0x7fe88813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe888073800 0x7fe88814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 --2- 172.21.15.114:0/1117419969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe888072720 0x7fe8880c2c70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.126+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 >> 172.21.15.114:0/1117419969 conn(0x7fe88806c680 msgr2=0x7fe88806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.127+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 shutdown_connections 2024-05-09T00:09:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.127+0000 7fe88cc00640 1 -- 172.21.15.114:0/1117419969 wait complete. 2024-05-09T00:09:29.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:09:29.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.423+0000 7fb9e6c00640 1 Processor -- start 2024-05-09T00:09:29.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.424+0000 7fb9e6c00640 1 -- start start 2024-05-09T00:09:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e6c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e0072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e6c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9e00c4a70 0x7fb9e00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e6c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e01585c0 0x7fb9e01589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e6c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e0073df0 con 0x7fb9e01585c0 2024-05-09T00:09:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e6c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e00c5f40 con 0x7fb9e00c4a70 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e6c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e0074040 con 0x7fb9e0073800 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e01585c0 0x7fb9e01589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e01585c0 0x7fb9e01589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58402/0 (socket says 172.21.15.114:58402) 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.426+0000 7fb9e4c00640 1 -- 172.21.15.114:0/1717288514 learned_addr learned my addr 172.21.15.114:0/1717288514 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9d7e00640 1 --2- 172.21.15.114:0/1717288514 >> v2:172.21.15.153:3300/0 conn(0x7fb9e00c4a70 0x7fb9e00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9dfe00640 1 --2- 172.21.15.114:0/1717288514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e0072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9e4c00640 1 -- 172.21.15.114:0/1717288514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 msgr2=0x7fb9e0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9e4c00640 1 --2- 172.21.15.114:0/1717288514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e0072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9e4c00640 1 -- 172.21.15.114:0/1717288514 >> v2:172.21.15.153:3300/0 conn(0x7fb9e00c4a70 msgr2=0x7fb9e00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9e4c00640 1 --2- 172.21.15.114:0/1717288514 >> v2:172.21.15.153:3300/0 conn(0x7fb9e00c4a70 0x7fb9e00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.427+0000 7fb9e4c00640 1 -- 172.21.15.114:0/1717288514 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00c58f0 con 0x7fb9e01585c0 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.428+0000 7fb9e4c00640 1 --2- 172.21.15.114:0/1717288514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e01585c0 0x7fb9e01589d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9e006d4f0 tx=0x7fb9d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c75b05d13464961 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.428+0000 7fb9df400640 1 -- 172.21.15.114:0/1717288514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8036070 con 0x7fb9e01585c0 2024-05-09T00:09:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.428+0000 7fb9df400640 1 -- 172.21.15.114:0/1717288514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8031600 con 0x7fb9e01585c0 2024-05-09T00:09:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.428+0000 7fb9df400640 1 -- 172.21.15.114:0/1717288514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80319d0 con 0x7fb9e01585c0 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.429+0000 7fb9e6c00640 1 -- 172.21.15.114:0/1717288514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e01585c0 msgr2=0x7fb9e01589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.429+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/1717288514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e01585c0 0x7fb9e01589d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9e006d4f0 tx=0x7fb9d802a6a0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.429+0000 7fb9e6c00640 1 -- 172.21.15.114:0/1717288514 shutdown_connections 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.429+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/1717288514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e01585c0 0x7fb9e01589d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.429+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/1717288514 >> v2:172.21.15.153:3300/0 conn(0x7fb9e00c4a70 0x7fb9e00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.430+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/1717288514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e0072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.430+0000 7fb9e6c00640 1 -- 172.21.15.114:0/1717288514 >> 172.21.15.114:0/1717288514 conn(0x7fb9e006c680 msgr2=0x7fb9e006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.430+0000 7fb9e6c00640 1 -- 172.21.15.114:0/1717288514 shutdown_connections 2024-05-09T00:09:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.430+0000 7fb9e6c00640 1 -- 172.21.15.114:0/1717288514 wait complete. 2024-05-09T00:09:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.433+0000 7fb9e6c00640 1 Processor -- start 2024-05-09T00:09:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.433+0000 7fb9e6c00640 1 -- start start 2024-05-09T00:09:29.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e6c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 0x7fb9e01f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e6c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e01585c0 0x7fb9e014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0074320 con 0x7fb9e00c4a70 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e6c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00c4e80 con 0x7fb9e01585c0 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e6c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e01f1bf0 con 0x7fb9e0073800 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9d7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 0x7fb9e01f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9d7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 0x7fb9e01f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58406/0 (socket says 172.21.15.114:58406) 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9d7e00640 1 -- 172.21.15.114:0/248586077 learned_addr learned my addr 172.21.15.114:0/248586077 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9dfe00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.435+0000 7fb9e4c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e01585c0 0x7fb9e014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9d7e00640 1 -- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 msgr2=0x7fb9e00c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9d7e00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e00c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9d7e00640 1 -- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e01585c0 msgr2=0x7fb9e014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9d7e00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e01585c0 0x7fb9e014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9d7e00640 1 -- 172.21.15.114:0/248586077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e014f9d0 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9d7e00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 0x7fb9e01f0f70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800d5f0 tx=0x7fb9c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80125f0 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c8019070 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e014fcb0 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80129d0 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.436+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01f1930 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.438+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e0077430 con 0x7fb9e00c4a70 2024-05-09T00:09:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.439+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb9c8012b70 con 0x7fb9e00c4a70 2024-05-09T00:09:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.440+0000 7fb9dcc00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9bc076300 0x7fb9bc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.441+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb9c8097c80 con 0x7fb9e00c4a70 2024-05-09T00:09:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.441+0000 7fb9dfe00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9bc076300 0x7fb9bc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:29.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.441+0000 7fb9dfe00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9bc076300 0x7fb9bc078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0006fd0 tx=0x7fb9d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.446+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb9c8061210 con 0x7fb9e00c4a70 2024-05-09T00:09:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.655+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9e00c5630 con 0x7fb9e00c4a70 2024-05-09T00:09:29.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.657+0000 7fb9dcc00640 1 -- 172.21.15.114:0/248586077 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20335 (secure 0 0 0) 0x7fb9c8069030 con 0x7fb9e00c4a70 2024-05-09T00:09:29.654 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:09:29.655 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:08:56.183970+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9bc076300 msgr2=0x7fb9bc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9bc076300 0x7fb9bc078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0006fd0 tx=0x7fb9d0008040 comp rx=0 tx=0).stop 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 msgr2=0x7fb9e01f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 0x7fb9e01f0f70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800d5f0 tx=0x7fb9c800dab0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 shutdown_connections 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9bc076300 0x7fb9bc078810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e01585c0 0x7fb9e014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e00c4a70 0x7fb9e01f0f70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 --2- 172.21.15.114:0/248586077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e0073800 0x7fb9e00c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:29.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 >> 172.21.15.114:0/248586077 conn(0x7fb9e006c680 msgr2=0x7fb9e01557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:29.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 shutdown_connections 2024-05-09T00:09:29.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:09:29.660+0000 7fb9e6c00640 1 -- 172.21.15.114:0/248586077 wait complete. 2024-05-09T00:09:29.681 DEBUG:tasks.mds_thrash:Yielding 2024-05-09T00:09:29.681 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T00:09:29.694 INFO:tasks.workunit:Pulling workunits from ref c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:09:29.695 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T00:09:29.695 INFO:tasks.workunit:timeout=3h 2024-05-09T00:09:29.695 INFO:tasks.workunit:cleanup=True 2024-05-09T00:09:29.695 DEBUG:teuthology.orchestra.run.smithi114:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:29.696 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2024-05-09T00:09:29.696 INFO:tasks.mds_thrash.fs.[b]:waiting for 93 secs before thrashing 2024-05-09T00:09:29.737 INFO:teuthology.orchestra.run.smithi114.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:29.737 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T00:09:29.737 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-05-09T00:09:29.737 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:09:29.738 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T00:09:29.738 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T00:09:29.738 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-09 00:08:45.087459858 +0000 2024-05-09T00:09:29.738 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-09 00:09:16.575721769 +0000 2024-05-09T00:09:29.738 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-05-09 00:08:45.087459858 +0000 2024-05-09T00:09:29.738 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T00:09:29.741 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T00:09:29.849 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-09 00:08:55.190107662 +0000 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-09 00:09:21.239588606 +0000 2024-05-09T00:09:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-09 00:08:55.190107662 +0000 2024-05-09T00:09:29.907 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-09T00:09:29.908 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-09T00:09:30.003 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:09:30.004 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:09:30.057 INFO:tasks.workunit.client.0.smithi114.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T00:09:30.061 INFO:tasks.workunit.client.1.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-09T00:09:40.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:09:40.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:10:10.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:10:10.194 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:10:40.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:10:40.342 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:11:02.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:02.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.946+0000 7f6e39600640 1 Processor -- start 2024-05-09T00:11:02.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.946+0000 7f6e39600640 1 -- start start 2024-05-09T00:11:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e39600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6e3415ea00 0x7f6e34160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:02.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e39600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e34156bb0 con 0x7f6e340c43c0 2024-05-09T00:11:02.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e39600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e34156e90 con 0x7f6e34153760 2024-05-09T00:11:02.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e39600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6e340ac710 con 0x7f6e3415ea00 2024-05-09T00:11:02.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e32a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6e340c43c0 0x7f6e34159830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40284/0 (socket says 172.21.15.114:40284) 2024-05-09T00:11:02.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e32a00640 1 -- 172.21.15.114:0/499181283 learned_addr learned my addr 172.21.15.114:0/499181283 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.948+0000 7f6e33400640 1 --2- 172.21.15.114:0/499181283 >> v2:172.21.15.153:3300/0 conn(0x7f6e3415ea00 0x7f6e34160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.949+0000 7f6e31600640 1 -- 172.21.15.114:0/499181283 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370455688 0 0) 0x7f6e34156bb0 con 0x7f6e340c43c0 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.949+0000 7f6e31600640 1 -- 172.21.15.114:0/499181283 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e18003520 con 0x7f6e340c43c0 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.949+0000 7f6e33400640 1 -- 172.21.15.114:0/499181283 >> v1:172.21.15.153:6789/0 conn(0x7f6e34153760 legacy=0x7f6e34159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.949+0000 7f6e31600640 1 -- 172.21.15.114:0/499181283 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655160054 0 0) 0x7f6e34156e90 con 0x7f6e34153760 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.949+0000 7f6e33400640 1 -- 172.21.15.114:0/499181283 >> v1:172.21.15.114:6789/0 conn(0x7f6e340c43c0 legacy=0x7f6e34159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:02.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.949+0000 7f6e33400640 1 -- 172.21.15.114:0/499181283 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e340ac960 con 0x7f6e3415ea00 2024-05-09T00:11:02.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.951+0000 7f6e33400640 1 --2- 172.21.15.114:0/499181283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e3415ea00 0x7f6e34160e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009d90 tx=0x7f6e2c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be45efcac9ef020b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:02.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.951+0000 7f6e31600640 1 -- 172.21.15.114:0/499181283 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c035020 con 0x7f6e3415ea00 2024-05-09T00:11:02.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.951+0000 7f6e31600640 1 -- 172.21.15.114:0/499181283 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c007540 con 0x7f6e3415ea00 2024-05-09T00:11:02.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.951+0000 7f6e31600640 1 -- 172.21.15.114:0/499181283 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e240016f0 con 0x7f6e3415ea00 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.952+0000 7f6e39600640 1 -- 172.21.15.114:0/499181283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e3415ea00 msgr2=0x7f6e34160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.952+0000 7f6e39600640 1 --2- 172.21.15.114:0/499181283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e3415ea00 0x7f6e34160e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009d90 tx=0x7f6e2c02a5d0 comp rx=0 tx=0).stop 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.952+0000 7f6e39600640 1 -- 172.21.15.114:0/499181283 shutdown_connections 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.952+0000 7f6e39600640 1 --2- 172.21.15.114:0/499181283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e3415ea00 0x7f6e34160e20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.952+0000 7f6e39600640 1 -- 172.21.15.114:0/499181283 >> 172.21.15.114:0/499181283 conn(0x7f6e3406c680 msgr2=0x7f6e3406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.953+0000 7f6e39600640 1 -- 172.21.15.114:0/499181283 shutdown_connections 2024-05-09T00:11:02.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.953+0000 7f6e39600640 1 -- 172.21.15.114:0/499181283 wait complete. 2024-05-09T00:11:02.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.955+0000 7f6e39600640 1 Processor -- start 2024-05-09T00:11:02.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.955+0000 7f6e39600640 1 -- start start 2024-05-09T00:11:02.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.956+0000 7f6e39600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 0x7f6e34155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:02.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.956+0000 7f6e39600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e34153760 0x7f6e3414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:02.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.956+0000 7f6e39600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e3415ea00 0x7f6e341540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.956+0000 7f6e39600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e34161360 con 0x7f6e340c43c0 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.956+0000 7f6e39600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e340ad3c0 con 0x7f6e34153760 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.956+0000 7f6e39600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e341614e0 con 0x7f6e3415ea00 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.957+0000 7f6e32a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 0x7f6e34155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.957+0000 7f6e32a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 0x7f6e34155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34592/0 (socket says 172.21.15.114:34592) 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.957+0000 7f6e32a00640 1 -- 172.21.15.114:0/2903560844 learned_addr learned my addr 172.21.15.114:0/2903560844 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:02.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.957+0000 7f6e33400640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e3415ea00 0x7f6e341540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:02.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.957+0000 7f6e32000640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e34153760 0x7f6e3414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:02.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e33400640 1 -- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e34153760 msgr2=0x7f6e3414a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:02.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e33400640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e34153760 0x7f6e3414a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:02.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e33400640 1 -- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 msgr2=0x7f6e34155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:02.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e33400640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 0x7f6e34155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:02.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e33400640 1 -- 172.21.15.114:0/2903560844 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3414a7b0 con 0x7f6e3415ea00 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e32a00640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 0x7f6e34155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e33400640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e3415ea00 0x7f6e341540e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c031000 tx=0x7f6e2c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c009450 con 0x7f6e3415ea00 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c031c60 con 0x7f6e3415ea00 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3414b7e0 con 0x7f6e3415ea00 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.958+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c003bd0 con 0x7f6e3415ea00 2024-05-09T00:11:02.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.959+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3414b500 con 0x7f6e3415ea00 2024-05-09T00:11:02.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.960+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3414a980 con 0x7f6e3415ea00 2024-05-09T00:11:02.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.963+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e2c004030 con 0x7f6e3415ea00 2024-05-09T00:11:02.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.964+0000 7f6e2aa00640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e140762d0 0x7f6e140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:02.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.964+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7f6e2c0b8fe0 con 0x7f6e3415ea00 2024-05-09T00:11:02.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.964+0000 7f6e32a00640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e140762d0 0x7f6e140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:02.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.965+0000 7f6e32a00640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e140762d0 0x7f6e140787e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e24001620 tx=0x7f6e24001590 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:02.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:02.973+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6e2c04a030 con 0x7f6e3415ea00 2024-05-09T00:11:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.211+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e340c4180 con 0x7f6e3415ea00 2024-05-09T00:11:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.212+0000 7f6e2aa00640 1 -- 172.21.15.114:0/2903560844 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f6e2c041030 con 0x7f6e3415ea00 2024-05-09T00:11:03.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:03.210 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:03.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e140762d0 msgr2=0x7f6e140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e140762d0 0x7f6e140787e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e24001620 tx=0x7f6e24001590 comp rx=0 tx=0).stop 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e3415ea00 msgr2=0x7f6e341540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e3415ea00 0x7f6e341540e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c031000 tx=0x7f6e2c004a40 comp rx=0 tx=0).stop 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 shutdown_connections 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6e140762d0 0x7f6e140787e0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e24001620 tx=0x7f6e24001590 comp rx=0 tx=0).stop 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e3415ea00 0x7f6e341540e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e34153760 0x7f6e3414a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 --2- 172.21.15.114:0/2903560844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e340c43c0 0x7f6e34155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.216+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 >> 172.21.15.114:0/2903560844 conn(0x7f6e3406c680 msgr2=0x7f6e3406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.217+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 shutdown_connections 2024-05-09T00:11:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.217+0000 7f6e39600640 1 -- 172.21.15.114:0/2903560844 wait complete. 2024-05-09T00:11:03.244 INFO:tasks.mds_thrash.fs.[b]:kill mds.d (rank=0) 2024-05-09T00:11:03.245 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T00:11:03.245 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:11:03.288 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T00:11:03.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.529+0000 7f9b1d600640 1 Processor -- start 2024-05-09T00:11:03.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.529+0000 7f9b1d600640 1 -- start start 2024-05-09T00:11:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b1d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b1808ed30 0x7f9b180cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b1d600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1806ed40 con 0x7f9b181589f0 2024-05-09T00:11:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b1d600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b180c8a50 con 0x7f9b180c4080 2024-05-09T00:11:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b1d600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9b18158e00 con 0x7f9b1808ed30 2024-05-09T00:11:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b1cc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9b181589f0 0x7f9b1806cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40290/0 (socket says 172.21.15.114:40290) 2024-05-09T00:11:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b1cc00640 1 -- 172.21.15.114:0/877664958 learned_addr learned my addr 172.21.15.114:0/877664958 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.531+0000 7f9b17400640 1 --2- 172.21.15.114:0/877664958 >> v2:172.21.15.153:3300/0 conn(0x7f9b1808ed30 0x7f9b180cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243722498 0 0) 0x7f9b1806ed40 con 0x7f9b181589f0 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9afc003520 con 0x7f9b181589f0 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771530392 0 0) 0x7f9b180c8a50 con 0x7f9b180c4080 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b1806ed40 con 0x7f9b180c4080 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b17400640 1 -- 172.21.15.114:0/877664958 >> v1:172.21.15.153:6789/0 conn(0x7f9b180c4080 legacy=0x7f9b1806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b17400640 1 -- 172.21.15.114:0/877664958 >> v1:172.21.15.114:6789/0 conn(0x7f9b181589f0 legacy=0x7f9b1806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.532+0000 7f9b17400640 1 -- 172.21.15.114:0/877664958 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b180c8050 con 0x7f9b1808ed30 2024-05-09T00:11:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.533+0000 7f9b17400640 1 --2- 172.21.15.114:0/877664958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b1808ed30 0x7f9b180cb790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b040097a0 tx=0x7f9b0402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b46241c26c1114f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.533+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04037070 con 0x7f9b1808ed30 2024-05-09T00:11:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.534+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b04032440 con 0x7f9b1808ed30 2024-05-09T00:11:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.534+0000 7f9b16a00640 1 -- 172.21.15.114:0/877664958 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04032810 con 0x7f9b1808ed30 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.534+0000 7f9b1d600640 1 -- 172.21.15.114:0/877664958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b1808ed30 msgr2=0x7f9b180cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.534+0000 7f9b1d600640 1 --2- 172.21.15.114:0/877664958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b1808ed30 0x7f9b180cb790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b040097a0 tx=0x7f9b0402a230 comp rx=0 tx=0).stop 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.534+0000 7f9b1d600640 1 -- 172.21.15.114:0/877664958 shutdown_connections 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.535+0000 7f9b1d600640 1 --2- 172.21.15.114:0/877664958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b1808ed30 0x7f9b180cb790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.535+0000 7f9b1d600640 1 -- 172.21.15.114:0/877664958 >> 172.21.15.114:0/877664958 conn(0x7f9b180cd8e0 msgr2=0x7f9b180cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.535+0000 7f9b1d600640 1 -- 172.21.15.114:0/877664958 shutdown_connections 2024-05-09T00:11:03.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.535+0000 7f9b1d600640 1 -- 172.21.15.114:0/877664958 wait complete. 2024-05-09T00:11:03.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.537+0000 7f9b1d600640 1 Processor -- start 2024-05-09T00:11:03.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.537+0000 7f9b1d600640 1 -- start start 2024-05-09T00:11:03.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.538+0000 7f9b1d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 0x7f9b180c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b1d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b180c4080 0x7f9b18159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b1d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b181589f0 0x7f9b181e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b1d600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1806e1a0 con 0x7f9b1808ed30 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b1d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1806dec0 con 0x7f9b180c4080 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b1d600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1806d6c0 con 0x7f9b181589f0 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 0x7f9b180c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 0x7f9b180c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34602/0 (socket says 172.21.15.114:34602) 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b17400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b180c4080 0x7f9b18159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b17e00640 1 -- 172.21.15.114:0/1697383521 learned_addr learned my addr 172.21.15.114:0/1697383521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.539+0000 7f9b1cc00640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b181589f0 0x7f9b181e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:03.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b17e00640 1 -- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b181589f0 msgr2=0x7f9b181e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b17e00640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b181589f0 0x7f9b181e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b17e00640 1 -- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b180c4080 msgr2=0x7f9b18159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b17e00640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b180c4080 0x7f9b18159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b17e00640 1 -- 172.21.15.114:0/1697383521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b181ee320 con 0x7f9b1808ed30 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b17e00640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 0x7f9b180c4780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c440 tx=0x7f9b0800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080052d0 con 0x7f9b1808ed30 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b08005490 con 0x7f9b1808ed30 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.540+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b181ee5c0 con 0x7f9b1808ed30 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.541+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b181e2a80 con 0x7f9b1808ed30 2024-05-09T00:11:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.541+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08007260 con 0x7f9b1808ed30 2024-05-09T00:11:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.542+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af0005290 con 0x7f9b1808ed30 2024-05-09T00:11:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.543+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b08007400 con 0x7f9b1808ed30 2024-05-09T00:11:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.545+0000 7f9b0fe00640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9af8076320 0x7f9af8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.545+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7f9b08096e10 con 0x7f9b1808ed30 2024-05-09T00:11:03.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.545+0000 7f9b17400640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9af8076320 0x7f9af8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.547+0000 7f9b17400640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9af8076320 0x7f9af8078830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b04034000 tx=0x7f9b0402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:03.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.550+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9b0809a030 con 0x7f9b1808ed30 2024-05-09T00:11:03.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.790+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9af0005580 con 0x7f9b1808ed30 2024-05-09T00:11:03.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.791+0000 7f9b0fe00640 1 -- 172.21.15.114:0/1697383521 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f9b08068380 con 0x7f9b1808ed30 2024-05-09T00:11:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:03.789 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:03.789 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.793+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9af8076320 msgr2=0x7f9af8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.793+0000 7f9b1d600640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9af8076320 0x7f9af8078830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b04034000 tx=0x7f9b0402e000 comp rx=0 tx=0).stop 2024-05-09T00:11:03.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.793+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 msgr2=0x7f9b180c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.793+0000 7f9b1d600640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 0x7f9b180c4780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c440 tx=0x7f9b0800c900 comp rx=0 tx=0).stop 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 shutdown_connections 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9af8076320 0x7f9af8078830 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b181589f0 0x7f9b181e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b180c4080 0x7f9b18159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 --2- 172.21.15.114:0/1697383521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b1808ed30 0x7f9b180c4780 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 >> 172.21.15.114:0/1697383521 conn(0x7f9b180cd8e0 msgr2=0x7f9b18155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 shutdown_connections 2024-05-09T00:11:03.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:03.794+0000 7f9b1d600640 1 -- 172.21.15.114:0/1697383521 wait complete. 2024-05-09T00:11:03.813 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:11:05.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.049+0000 7fb330a00640 1 Processor -- start 2024-05-09T00:11:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.049+0000 7fb330a00640 1 -- start start 2024-05-09T00:11:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.050+0000 7fb330a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.050+0000 7fb330a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c0ca360 con 0x7fb32c0aa630 2024-05-09T00:11:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.050+0000 7fb330a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c0c8ab0 con 0x7fb32c071c90 2024-05-09T00:11:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.050+0000 7fb330a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb32c072af0 con 0x7fb32c158220 2024-05-09T00:11:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb329e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb32c0aa630 0x7fb32c0c7e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40292/0 (socket says 172.21.15.114:40292) 2024-05-09T00:11:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb329e00640 1 -- 172.21.15.114:0/4084396426 learned_addr learned my addr 172.21.15.114:0/4084396426 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb32b200640 1 --2- 172.21.15.114:0/4084396426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846873829 0 0) 0x7fb32c0c8ab0 con 0x7fb32c071c90 2024-05-09T00:11:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb310003520 con 0x7fb32c071c90 2024-05-09T00:11:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543000568 0 0) 0x7fb32c0ca360 con 0x7fb32c0aa630 2024-05-09T00:11:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.051+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c0c8ab0 con 0x7fb32c0aa630 2024-05-09T00:11:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.052+0000 7fb32b200640 1 -- 172.21.15.114:0/4084396426 >> v1:172.21.15.153:6789/0 conn(0x7fb32c071c90 legacy=0x7fb32c0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.052+0000 7fb32b200640 1 -- 172.21.15.114:0/4084396426 >> v1:172.21.15.114:6789/0 conn(0x7fb32c0aa630 legacy=0x7fb32c0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.052+0000 7fb32b200640 1 -- 172.21.15.114:0/4084396426 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c15c1a0 con 0x7fb32c158220 2024-05-09T00:11:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.053+0000 7fb32b200640 1 --2- 172.21.15.114:0/4084396426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c0c8570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb324009dc0 tx=0x7fb32402a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac67263e9e9ffdd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.053+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324007740 con 0x7fb32c158220 2024-05-09T00:11:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.053+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32402ae50 con 0x7fb32c158220 2024-05-09T00:11:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.053+0000 7fb329400640 1 -- 172.21.15.114:0/4084396426 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324007ae0 con 0x7fb32c158220 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 -- 172.21.15.114:0/4084396426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 msgr2=0x7fb32c0c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 --2- 172.21.15.114:0/4084396426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c0c8570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb324009dc0 tx=0x7fb32402a630 comp rx=0 tx=0).stop 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 -- 172.21.15.114:0/4084396426 shutdown_connections 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 --2- 172.21.15.114:0/4084396426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c0c8570 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 -- 172.21.15.114:0/4084396426 >> 172.21.15.114:0/4084396426 conn(0x7fb32c0cb3f0 msgr2=0x7fb32c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 -- 172.21.15.114:0/4084396426 shutdown_connections 2024-05-09T00:11:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.054+0000 7fb330a00640 1 -- 172.21.15.114:0/4084396426 wait complete. 2024-05-09T00:11:06.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.056+0000 7fb330a00640 1 Processor -- start 2024-05-09T00:11:06.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.056+0000 7fb330a00640 1 -- start start 2024-05-09T00:11:06.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb330a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 0x7fb32c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:06.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb330a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32c0aa630 0x7fb32c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb330a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb330a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c158630 con 0x7fb32c0aa630 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb330a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c072780 con 0x7fb32c071c90 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb330a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb32c071760 con 0x7fb32c158220 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb32a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 0x7fb32c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb32a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 0x7fb32c0aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:51392/0 (socket says 172.21.15.114:51392) 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb32a800640 1 -- 172.21.15.114:0/2374885759 learned_addr learned my addr 172.21.15.114:0/2374885759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb32b200640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.058+0000 7fb329e00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32c0aa630 0x7fb32c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:06.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb32a800640 1 -- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 msgr2=0x7fb32c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb32a800640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb32a800640 1 -- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32c0aa630 msgr2=0x7fb32c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb32a800640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32c0aa630 0x7fb32c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb32a800640 1 -- 172.21.15.114:0/2374885759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c1eeff0 con 0x7fb32c071c90 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb32a800640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 0x7fb32c0aaf90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c390 tx=0x7fb31c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.059+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c017070 con 0x7fb32c071c90 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.060+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c0052f0 con 0x7fb32c071c90 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.060+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c153a50 con 0x7fb32c071c90 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.060+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c003830 con 0x7fb32c071c90 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.060+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c0ab7c0 con 0x7fb32c071c90 2024-05-09T00:11:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.061+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c0c9e60 con 0x7fb32c071c90 2024-05-09T00:11:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.064+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb31c01a070 con 0x7fb32c071c90 2024-05-09T00:11:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.065+0000 7fb322a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb30c076300 0x7fb30c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.066+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7fb31c0970d0 con 0x7fb32c071c90 2024-05-09T00:11:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.066+0000 7fb329e00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb30c076300 0x7fb30c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:06.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.066+0000 7fb329e00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb30c076300 0x7fb30c078810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb318000c00 tx=0x7fb318007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.074+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb32c0c9e60 con 0x7fb32c071c90 2024-05-09T00:11:06.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.317+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb32c078430 con 0x7fb32c071c90 2024-05-09T00:11:06.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.318+0000 7fb322a00640 1 -- 172.21.15.114:0/2374885759 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fb31c021020 con 0x7fb32c071c90 2024-05-09T00:11:06.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:06.315 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:06.315 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb30c076300 msgr2=0x7fb30c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb30c076300 0x7fb30c078810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb318000c00 tx=0x7fb318007de0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 msgr2=0x7fb32c0aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 0x7fb32c0aaf90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c390 tx=0x7fb31c00c850 comp rx=0 tx=0).stop 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 shutdown_connections 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb30c076300 0x7fb30c078810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb32c158220 0x7fb32c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32c0aa630 0x7fb32c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 --2- 172.21.15.114:0/2374885759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb32c071c90 0x7fb32c0aaf90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 >> 172.21.15.114:0/2374885759 conn(0x7fb32c0cb3f0 msgr2=0x7fb32c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.321+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 shutdown_connections 2024-05-09T00:11:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:06.322+0000 7fb330a00640 1 -- 172.21.15.114:0/2374885759 wait complete. 2024-05-09T00:11:06.358 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:11:07.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:07.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.855+0000 7fd87da00640 1 Processor -- start 2024-05-09T00:11:07.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.855+0000 7fd87da00640 1 -- start start 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.857+0000 7fd87da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd8781556f0 0x7fd878158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.857+0000 7fd87da00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd878074200 con 0x7fd8780703a0 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.857+0000 7fd87da00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8780c5620 con 0x7fd8780c4940 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.857+0000 7fd87da00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd878158c60 con 0x7fd8781556f0 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.857+0000 7fd877400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd8780703a0 0x7fd878158010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42354/0 (socket says 172.21.15.114:42354) 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.857+0000 7fd877400640 1 -- 172.21.15.114:0/3851693071 learned_addr learned my addr 172.21.15.114:0/3851693071 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:07.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd87d000640 1 --2- 172.21.15.114:0/3851693071 >> v2:172.21.15.153:3300/0 conn(0x7fd8781556f0 0x7fd878158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:07.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060678208 0 0) 0x7fd878074200 con 0x7fd8780703a0 2024-05-09T00:11:07.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd85c003520 con 0x7fd8780703a0 2024-05-09T00:11:07.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4281354200 0 0) 0x7fd85c003520 con 0x7fd8780703a0 2024-05-09T00:11:07.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 >> v2:172.21.15.153:3300/0 conn(0x7fd8781556f0 msgr2=0x7fd878158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 --2- 172.21.15.114:0/3851693071 >> v2:172.21.15.153:3300/0 conn(0x7fd8781556f0 0x7fd878158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 >> v1:172.21.15.153:6789/0 conn(0x7fd8780c4940 legacy=0x7fd8780c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8780c5900 con 0x7fd8780703a0 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fd8640016f0 con 0x7fd8780703a0 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 >> v1:172.21.15.114:6789/0 conn(0x7fd8780703a0 legacy=0x7fd878158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd85c003aa0 0x7fd85c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c004800 0x7fd85c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd85c0052a0 0x7fd85c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd878158c60 con 0x7fd85c003aa0 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c00c230 con 0x7fd85c0052a0 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.858+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c00c430 con 0x7fd85c004800 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd877e00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd85c003aa0 0x7fd85c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd877e00640 1 -- 172.21.15.114:0/3851693071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c004800 msgr2=0x7fd85c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:07.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd877e00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c004800 0x7fd85c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd877e00640 1 -- 172.21.15.114:0/3851693071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd85c0052a0 msgr2=0x7fd85c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd877e00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd85c0052a0 0x7fd85c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd877e00640 1 -- 172.21.15.114:0/3851693071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c003520 con 0x7fd85c003aa0 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.859+0000 7fd87d000640 1 -- 172.21.15.114:0/3851693071 reap_dead start 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.860+0000 7fd877e00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd85c003aa0 0x7fd85c003f10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd868001760 tx=0x7fd85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eabfd9f2080b231 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.860+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680013b0 con 0x7fd85c003aa0 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.860+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8680052d0 con 0x7fd85c003aa0 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.860+0000 7fd876a00640 1 -- 172.21.15.114:0/3851693071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86802aa90 con 0x7fd85c003aa0 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 -- 172.21.15.114:0/3851693071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd85c003aa0 msgr2=0x7fd85c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd85c003aa0 0x7fd85c003f10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd868001760 tx=0x7fd85c005830 comp rx=0 tx=0).stop 2024-05-09T00:11:07.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 -- 172.21.15.114:0/3851693071 shutdown_connections 2024-05-09T00:11:07.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 --2- 172.21.15.114:0/3851693071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd85c003aa0 0x7fd85c003f10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:07.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 -- 172.21.15.114:0/3851693071 >> 172.21.15.114:0/3851693071 conn(0x7fd8780c9730 msgr2=0x7fd8780c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:07.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 -- 172.21.15.114:0/3851693071 shutdown_connections 2024-05-09T00:11:07.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.861+0000 7fd87da00640 1 -- 172.21.15.114:0/3851693071 wait complete. 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.863+0000 7fd87da00640 1 Processor -- start 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.863+0000 7fd87da00640 1 -- start start 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c003aa0 0x7fd878150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd878149790 0x7fd8780c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 0x7fd87814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd878073900 con 0x7fd87814fbb0 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87da00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd878073e90 con 0x7fd878149790 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd878073a80 con 0x7fd85c003aa0 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 0x7fd87814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 0x7fd87814ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55042/0 (socket says 172.21.15.114:55042) 2024-05-09T00:11:07.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd87d000640 1 -- 172.21.15.114:0/4157151568 learned_addr learned my addr 172.21.15.114:0/4157151568 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.865+0000 7fd877e00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c003aa0 0x7fd878150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd877400640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd878149790 0x7fd8780c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87d000640 1 -- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c003aa0 msgr2=0x7fd878150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87d000640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c003aa0 0x7fd878150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87d000640 1 -- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd878149790 msgr2=0x7fd8780c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87d000640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd878149790 0x7fd8780c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87d000640 1 -- 172.21.15.114:0/4157151568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8780ae460 con 0x7fd87814fbb0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd877400640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd878149790 0x7fd8780c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87d000640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 0x7fd87814ffc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8780c3be0 tx=0x7fd87000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87000bb70 con 0x7fd87814fbb0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87001a070 con 0x7fd87814fbb0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870014400 con 0x7fd87814fbb0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8781eea30 con 0x7fd87814fbb0 2024-05-09T00:11:07.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.866+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8781525e0 con 0x7fd87814fbb0 2024-05-09T00:11:07.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.868+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd878078430 con 0x7fd87814fbb0 2024-05-09T00:11:07.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.869+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd870005d10 con 0x7fd87814fbb0 2024-05-09T00:11:07.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.870+0000 7fd86fe00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd8580762d0 0x7fd8580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:07.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.870+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7fd870097b40 con 0x7fd87814fbb0 2024-05-09T00:11:07.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.870+0000 7fd877e00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd8580762d0 0x7fd8580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:07.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.871+0000 7fd877e00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd8580762d0 0x7fd8580787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd868032000 tx=0x7fd86802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:07.875+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd870061040 con 0x7fd87814fbb0 2024-05-09T00:11:08.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.125+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8781523d0 con 0x7fd87814fbb0 2024-05-09T00:11:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.126+0000 7fd86fe00640 1 -- 172.21.15.114:0/4157151568 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fd870060940 con 0x7fd87814fbb0 2024-05-09T00:11:08.123 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:08.123 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd8580762d0 msgr2=0x7fd8580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd8580762d0 0x7fd8580787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd868032000 tx=0x7fd86802e000 comp rx=0 tx=0).stop 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 msgr2=0x7fd87814ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 0x7fd87814ffc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8780c3be0 tx=0x7fd87000ef50 comp rx=0 tx=0).stop 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 shutdown_connections 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd8580762d0 0x7fd8580787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87814fbb0 0x7fd87814ffc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd878149790 0x7fd8780c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 --2- 172.21.15.114:0/4157151568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd85c003aa0 0x7fd878150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.130+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 >> 172.21.15.114:0/4157151568 conn(0x7fd8780c9730 msgr2=0x7fd878155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.131+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 shutdown_connections 2024-05-09T00:11:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.131+0000 7fd87da00640 1 -- 172.21.15.114:0/4157151568 wait complete. 2024-05-09T00:11:08.154 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2024-05-09T00:11:08.154 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T00:11:08.154 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:11:08.182 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T00:11:08.182 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:08.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:08.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.490+0000 7f0a4f000640 1 Processor -- start 2024-05-09T00:11:08.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.490+0000 7f0a4f000640 1 -- start start 2024-05-09T00:11:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4f000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a480ca170 0x7f0a480c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4f000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a48072cf0 0x7f0a481581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a48158700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4f000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0a480c9440 con 0x7f0a48072cf0 2024-05-09T00:11:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4f000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0a480c9ce0 con 0x7f0a480ca170 2024-05-09T00:11:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0a480cad50 con 0x7f0a480c4eb0 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a47400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a48072cf0 0x7f0a481581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a47400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a48072cf0 0x7f0a481581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55044/0 (socket says 172.21.15.114:55044) 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a47400640 1 -- 172.21.15.114:0/242906950 learned_addr learned my addr 172.21.15.114:0/242906950 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a4d000640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a48158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.492+0000 7f0a47e00640 1 --2- 172.21.15.114:0/242906950 >> v2:172.21.15.153:3300/0 conn(0x7f0a480ca170 0x7f0a480c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.493+0000 7f0a47400640 1 -- 172.21.15.114:0/242906950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 msgr2=0x7f0a48158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.493+0000 7f0a47400640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a48158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.493+0000 7f0a47400640 1 -- 172.21.15.114:0/242906950 >> v2:172.21.15.153:3300/0 conn(0x7f0a480ca170 msgr2=0x7f0a480c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.493+0000 7f0a47400640 1 --2- 172.21.15.114:0/242906950 >> v2:172.21.15.153:3300/0 conn(0x7f0a480ca170 0x7f0a480c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.493+0000 7f0a47400640 1 -- 172.21.15.114:0/242906950 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a480c9690 con 0x7f0a48072cf0 2024-05-09T00:11:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.493+0000 7f0a4d000640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a48158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.494+0000 7f0a47400640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a48072cf0 0x7f0a481581c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a480cc560 tx=0x7f0a3402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc66d0d052b89ba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.494+0000 7f0a46a00640 1 -- 172.21.15.114:0/242906950 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34037070 con 0x7f0a48072cf0 2024-05-09T00:11:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.494+0000 7f0a46a00640 1 -- 172.21.15.114:0/242906950 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3402ae00 con 0x7f0a48072cf0 2024-05-09T00:11:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.494+0000 7f0a46a00640 1 -- 172.21.15.114:0/242906950 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34032660 con 0x7f0a48072cf0 2024-05-09T00:11:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.495+0000 7f0a4f000640 1 -- 172.21.15.114:0/242906950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a48072cf0 msgr2=0x7f0a481581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.495+0000 7f0a4f000640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a48072cf0 0x7f0a481581c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a480cc560 tx=0x7f0a3402a0b0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 -- 172.21.15.114:0/242906950 shutdown_connections 2024-05-09T00:11:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a48158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 --2- 172.21.15.114:0/242906950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a48072cf0 0x7f0a481581c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 --2- 172.21.15.114:0/242906950 >> v2:172.21.15.153:3300/0 conn(0x7f0a480ca170 0x7f0a480c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 -- 172.21.15.114:0/242906950 >> 172.21.15.114:0/242906950 conn(0x7f0a480cbb70 msgr2=0x7f0a480ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 -- 172.21.15.114:0/242906950 shutdown_connections 2024-05-09T00:11:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.496+0000 7f0a4f000640 1 -- 172.21.15.114:0/242906950 wait complete. 2024-05-09T00:11:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.499+0000 7f0a4f000640 1 Processor -- start 2024-05-09T00:11:08.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.499+0000 7f0a4f000640 1 -- start start 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a48072cf0 0x7f0a48157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a480b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 0x7f0a481508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0a480ca7b0 con 0x7f0a480b0610 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4806f470 con 0x7f0a48072cf0 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0a480ca930 con 0x7f0a480c4eb0 2024-05-09T00:11:08.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 0x7f0a481508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 0x7f0a481508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55054/0 (socket says 172.21.15.114:55054) 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a4d000640 1 -- 172.21.15.114:0/3227909512 learned_addr learned my addr 172.21.15.114:0/3227909512 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a47400640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a480b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.502+0000 7f0a47e00640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a48072cf0 0x7f0a48157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4d000640 1 -- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 msgr2=0x7f0a480b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4d000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a480b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4d000640 1 -- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a48072cf0 msgr2=0x7f0a48157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4d000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a48072cf0 0x7f0a48157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4d000640 1 -- 172.21.15.114:0/3227909512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4815a460 con 0x7f0a480b0610 2024-05-09T00:11:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4d000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 0x7f0a481508e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a40007ef0 tx=0x7f0a4000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4001a070 con 0x7f0a480b0610 2024-05-09T00:11:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a40015600 con 0x7f0a480b0610 2024-05-09T00:11:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a480b0e90 con 0x7f0a480b0610 2024-05-09T00:11:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a400159f0 con 0x7f0a480b0610 2024-05-09T00:11:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.503+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a48159e10 con 0x7f0a480b0610 2024-05-09T00:11:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.505+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a48077430 con 0x7f0a480b0610 2024-05-09T00:11:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.507+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a4001d070 con 0x7f0a480b0610 2024-05-09T00:11:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.508+0000 7f0a3fe00640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0a28076300 0x7f0a28078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.508+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7f0a40097ce0 con 0x7f0a480b0610 2024-05-09T00:11:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.508+0000 7f0a47e00640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0a28076300 0x7f0a28078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.509+0000 7f0a47e00640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0a28076300 0x7f0a28078810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a38006fd0 tx=0x7f0a38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:08.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.513+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0a40010070 con 0x7f0a480b0610 2024-05-09T00:11:08.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.615+0000 7f7cb2e00640 1 Processor -- start 2024-05-09T00:11:08.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.616+0000 7f7cb2e00640 1 -- start start 2024-05-09T00:11:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.618+0000 7f7cb2e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cac0cc5c0 0x7f7cac0cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.618+0000 7f7cb2e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cac0c8c40 con 0x7f7cac15c580 2024-05-09T00:11:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.618+0000 7f7cb2e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cac0c8f20 con 0x7f7cac0b3050 2024-05-09T00:11:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.618+0000 7f7cb2e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7cac0cbdc0 con 0x7f7cac0cc5c0 2024-05-09T00:11:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.619+0000 7f7cab400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7cac15c580 0x7f7cac158cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42362/0 (socket says 172.21.15.114:42362) 2024-05-09T00:11:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.619+0000 7f7cab400640 1 -- 172.21.15.114:0/21768120 learned_addr learned my addr 172.21.15.114:0/21768120 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.619+0000 7f7cb0e00640 1 --2- 172.21.15.114:0/21768120 >> v2:172.21.15.114:3300/0 conn(0x7f7cac0cc5c0 0x7f7cac0cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.619+0000 7f7caaa00640 1 -- 172.21.15.114:0/21768120 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031190411 0 0) 0x7f7cac0c8c40 con 0x7f7cac15c580 2024-05-09T00:11:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.619+0000 7f7caaa00640 1 -- 172.21.15.114:0/21768120 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c90003520 con 0x7f7cac15c580 2024-05-09T00:11:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.620+0000 7f7cb0e00640 1 -- 172.21.15.114:0/21768120 >> v1:172.21.15.153:6789/0 conn(0x7f7cac0b3050 legacy=0x7f7cac0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.620+0000 7f7cb0e00640 1 -- 172.21.15.114:0/21768120 >> v1:172.21.15.114:6789/0 conn(0x7f7cac15c580 legacy=0x7f7cac158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.620+0000 7f7cb0e00640 1 -- 172.21.15.114:0/21768120 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac0cc0a0 con 0x7f7cac0cc5c0 2024-05-09T00:11:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.621+0000 7f7cb0e00640 1 --2- 172.21.15.114:0/21768120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac0cc9d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2436cd688457ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.621+0000 7f7caaa00640 1 -- 172.21.15.114:0/21768120 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4007740 con 0x7f7cac0cc5c0 2024-05-09T00:11:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.621+0000 7f7caaa00640 1 -- 172.21.15.114:0/21768120 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca40078e0 con 0x7f7cac0cc5c0 2024-05-09T00:11:08.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.621+0000 7f7caaa00640 1 -- 172.21.15.114:0/21768120 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4007cb0 con 0x7f7cac0cc5c0 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 -- 172.21.15.114:0/21768120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0cc5c0 msgr2=0x7f7cac0cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/21768120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac0cc9d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402a6f0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 -- 172.21.15.114:0/21768120 shutdown_connections 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/21768120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac0cc9d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 -- 172.21.15.114:0/21768120 >> 172.21.15.114:0/21768120 conn(0x7f7cac0cdc50 msgr2=0x7f7cac0ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 -- 172.21.15.114:0/21768120 shutdown_connections 2024-05-09T00:11:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.622+0000 7f7cb2e00640 1 -- 172.21.15.114:0/21768120 wait complete. 2024-05-09T00:11:08.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.626+0000 7f7cb2e00640 1 Processor -- start 2024-05-09T00:11:08.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.626+0000 7f7cb2e00640 1 -- start start 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cb2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 0x7f7cac0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cb2e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac1f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cb2e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cac15c580 0x7f7cac1eb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cb2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac159540 con 0x7f7cac0b3050 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cb2e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac1593c0 con 0x7f7cac0cc5c0 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cb2e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac0ccf10 con 0x7f7cac15c580 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 0x7f7cac0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 0x7f7cac0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55080/0 (socket says 172.21.15.114:55080) 2024-05-09T00:11:08.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.628+0000 7f7cabe00640 1 -- 172.21.15.114:0/1750133688 learned_addr learned my addr 172.21.15.114:0/1750133688 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:08.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cab400640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac1f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cb0e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cac15c580 0x7f7cac1eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cabe00640 1 -- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cac15c580 msgr2=0x7f7cac1eb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cabe00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cac15c580 0x7f7cac1eb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cabe00640 1 -- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cac0cc5c0 msgr2=0x7f7cac1f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cabe00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac1f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cabe00640 1 -- 172.21.15.114:0/1750133688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac0c5930 con 0x7f7cac0b3050 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.629+0000 7f7cabe00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 0x7f7cac0af7f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c400 tx=0x7f7c9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.630+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c017070 con 0x7f7cac0b3050 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.630+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c0052d0 con 0x7f7cac0b3050 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.630+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac0c1230 con 0x7f7cac0b3050 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.630+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c003830 con 0x7f7cac0b3050 2024-05-09T00:11:08.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.630+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac1f20b0 con 0x7f7cac0b3050 2024-05-09T00:11:08.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.631+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac0c5b00 con 0x7f7cac0b3050 2024-05-09T00:11:08.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.634+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c9c01a070 con 0x7f7cac0b3050 2024-05-09T00:11:08.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.636+0000 7f7ca3e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7c8c0762d0 0x7f7c8c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:08.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.636+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7f7c9c097120 con 0x7f7cac0b3050 2024-05-09T00:11:08.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.636+0000 7f7cab400640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7c8c0762d0 0x7f7c8c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:08.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.637+0000 7f7cab400640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7c8c0762d0 0x7f7c8c0787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0c0970 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:08.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.638+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7c9c021020 con 0x7f7cac0b3050 2024-05-09T00:11:08.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.755+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a480ca590 con 0x7f0a480b0610 2024-05-09T00:11:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.756+0000 7f0a3fe00640 1 -- 172.21.15.114:0/3227909512 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f0a40060b00 con 0x7f0a480b0610 2024-05-09T00:11:08.752 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:08.752 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0a28076300 msgr2=0x7f0a28078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0a28076300 0x7f0a28078810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a38006fd0 tx=0x7f0a38008040 comp rx=0 tx=0).stop 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 msgr2=0x7f0a481508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 0x7f0a481508e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a40007ef0 tx=0x7f0a4000d4a0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 shutdown_connections 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0a28076300 0x7f0a28078810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a480b0610 0x7f0a481508e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a480c4eb0 0x7f0a480b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 --2- 172.21.15.114:0/3227909512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a48072cf0 0x7f0a48157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 >> 172.21.15.114:0/3227909512 conn(0x7f0a480cbb70 msgr2=0x7f0a48075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 shutdown_connections 2024-05-09T00:11:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.758+0000 7f0a4f000640 1 -- 172.21.15.114:0/3227909512 wait complete. 2024-05-09T00:11:08.777 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:08.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.882+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cac077430 con 0x7f7cac0b3050 2024-05-09T00:11:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.883+0000 7f7ca3e00640 1 -- 172.21.15.114:0/1750133688 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f7c9c060730 con 0x7f7cac0b3050 2024-05-09T00:11:08.880 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:08.880 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:08.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.886+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7c8c0762d0 msgr2=0x7f7c8c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.886+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7c8c0762d0 0x7f7c8c0787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0c0970 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2024-05-09T00:11:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.886+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 msgr2=0x7f7cac0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.886+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 0x7f7cac0af7f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c400 tx=0x7f7c9c00c8c0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 shutdown_connections 2024-05-09T00:11:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7c8c0762d0 0x7f7c8c0787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cac15c580 0x7f7cac1eb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cac0cc5c0 0x7f7cac1f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 --2- 172.21.15.114:0/1750133688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cac0b3050 0x7f7cac0af7f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 >> 172.21.15.114:0/1750133688 conn(0x7f7cac0cdc50 msgr2=0x7f7cac075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 shutdown_connections 2024-05-09T00:11:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:08.887+0000 7f7cb2e00640 1 -- 172.21.15.114:0/1750133688 wait complete. 2024-05-09T00:11:08.905 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:11:10.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:11:10.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:11:10.563 INFO:tasks.workunit.client.1.smithi153.stderr:Updating files: 62% (7633/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T00:11:10.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:10.788 INFO:tasks.workunit.client.0.smithi114.stderr:Updating files: 63% (7790/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T00:11:10.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.037+0000 7ff6b8800640 1 Processor -- start 2024-05-09T00:11:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.038+0000 7ff6b8800640 1 -- start start 2024-05-09T00:11:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.039+0000 7ff6b8800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6b00c43c0 0x7ff6b0153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.039+0000 7ff6b8800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6b0156bb0 con 0x7ff6b0159830 2024-05-09T00:11:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.039+0000 7ff6b8800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6b0156e90 con 0x7ff6b00ae940 2024-05-09T00:11:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.039+0000 7ff6b8800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff6b00ac710 con 0x7ff6b00c43c0 2024-05-09T00:11:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.040+0000 7ff6b5400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff6b0159830 0x7ff6b0159c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42378/0 (socket says 172.21.15.114:42378) 2024-05-09T00:11:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.040+0000 7ff6b5400640 1 -- 172.21.15.114:0/2266598124 learned_addr learned my addr 172.21.15.114:0/2266598124 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.040+0000 7ff6b5e00640 1 --2- 172.21.15.114:0/2266598124 >> v2:172.21.15.153:3300/0 conn(0x7ff6b00c43c0 0x7ff6b0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.040+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335251585 0 0) 0x7ff6b0156bb0 con 0x7ff6b0159830 2024-05-09T00:11:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.040+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff698003520 con 0x7ff6b0159830 2024-05-09T00:11:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3898218539 0 0) 0x7ff698003520 con 0x7ff6b0159830 2024-05-09T00:11:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 >> v2:172.21.15.153:3300/0 conn(0x7ff6b00c43c0 msgr2=0x7ff6b0153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 --2- 172.21.15.114:0/2266598124 >> v2:172.21.15.153:3300/0 conn(0x7ff6b00c43c0 0x7ff6b0153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 >> v1:172.21.15.153:6789/0 conn(0x7ff6b00ae940 legacy=0x7ff6b00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b00ac960 con 0x7ff6b0159830 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7ff6a00016f0 con 0x7ff6b0159830 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 >> v1:172.21.15.114:6789/0 conn(0x7ff6b0159830 legacy=0x7ff6b0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698003aa0 0x7ff698003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff698004800 0x7ff698004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6980053a0 0x7ff69800ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b00ac710 con 0x7ff698004800 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff69800c300 con 0x7ff698003aa0 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff69800c500 con 0x7ff6980053a0 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b5400640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff698004800 0x7ff698004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b5400640 1 -- 172.21.15.114:0/2266598124 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6980053a0 msgr2=0x7ff69800ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b5400640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6980053a0 0x7ff69800ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.041+0000 7ff6b5400640 1 -- 172.21.15.114:0/2266598124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698003aa0 msgr2=0x7ff698003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.042+0000 7ff6b5400640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698003aa0 0x7ff698003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.042+0000 7ff6b5400640 1 -- 172.21.15.114:0/2266598124 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff698003520 con 0x7ff698004800 2024-05-09T00:11:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.042+0000 7ff6b6800640 1 -- 172.21.15.114:0/2266598124 reap_dead start 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.042+0000 7ff6b5400640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff698004800 0x7ff698004c10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000c210 tx=0x7ff698005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33bad9bb91a7cab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.043+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0007ce0 con 0x7ff698004800 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.043+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a0005ad0 con 0x7ff698004800 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.043+0000 7ff6b4a00640 1 -- 172.21.15.114:0/2266598124 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0007070 con 0x7ff698004800 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 -- 172.21.15.114:0/2266598124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff698004800 msgr2=0x7ff698004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff698004800 0x7ff698004c10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000c210 tx=0x7ff698005830 comp rx=0 tx=0).stop 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 -- 172.21.15.114:0/2266598124 shutdown_connections 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 --2- 172.21.15.114:0/2266598124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff698004800 0x7ff698004c10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 -- 172.21.15.114:0/2266598124 >> 172.21.15.114:0/2266598124 conn(0x7ff6b006c680 msgr2=0x7ff6b006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 -- 172.21.15.114:0/2266598124 shutdown_connections 2024-05-09T00:11:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.044+0000 7ff6b8800640 1 -- 172.21.15.114:0/2266598124 wait complete. 2024-05-09T00:11:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.046+0000 7ff6b8800640 1 Processor -- start 2024-05-09T00:11:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.046+0000 7ff6b8800640 1 -- start start 2024-05-09T00:11:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698004800 0x7ff6b00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6b0143480 0x7ff6b01ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b8800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 0x7ff6b0141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b8800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b0153760 con 0x7ff6b01ee740 2024-05-09T00:11:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b00ad3c0 con 0x7ff698004800 2024-05-09T00:11:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff6b01538e0 con 0x7ff6b0143480 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 0x7ff6b0141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 0x7ff6b0141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55108/0 (socket says 172.21.15.114:55108) 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b6800640 1 -- 172.21.15.114:0/559349121 learned_addr learned my addr 172.21.15.114:0/559349121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.048+0000 7ff6b5e00640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698004800 0x7ff6b00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b5400640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6b0143480 0x7ff6b01ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b6800640 1 -- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6b0143480 msgr2=0x7ff6b01ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b6800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6b0143480 0x7ff6b01ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b6800640 1 -- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698004800 msgr2=0x7ff6b00c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b6800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698004800 0x7ff6b00c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b6800640 1 -- 172.21.15.114:0/559349121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b01f21f0 con 0x7ff6b01ee740 2024-05-09T00:11:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b6800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 0x7ff6b0141260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6980057e0 tx=0x7ff6ac00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:11.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac007070 con 0x7ff6b01ee740 2024-05-09T00:11:11.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac007230 con 0x7ff6b01ee740 2024-05-09T00:11:11.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b0148850 con 0x7ff6b01ee740 2024-05-09T00:11:11.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac007620 con 0x7ff6b01ee740 2024-05-09T00:11:11.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.049+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b01eec60 con 0x7ff6b01ee740 2024-05-09T00:11:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.051+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b0077430 con 0x7ff6b01ee740 2024-05-09T00:11:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.052+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6ac011070 con 0x7ff6b01ee740 2024-05-09T00:11:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.053+0000 7ff6aa000640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff6940762d0 0x7ff6940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.053+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7ff6ac096ef0 con 0x7ff6b01ee740 2024-05-09T00:11:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.053+0000 7ff6b5e00640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff6940762d0 0x7ff6940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.054+0000 7ff6b5e00640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff6940762d0 0x7ff6940787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6b006a230 tx=0x7ff6a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:11.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.057+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff6ac019060 con 0x7ff6b01ee740 2024-05-09T00:11:11.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.153+0000 7faeb4c00640 1 Processor -- start 2024-05-09T00:11:11.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.153+0000 7faeb4c00640 1 -- start start 2024-05-09T00:11:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.155+0000 7faeb4c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faeb00c43c0 0x7faeb0153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.155+0000 7faeb4c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb0156bb0 con 0x7faeb00ae940 2024-05-09T00:11:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.155+0000 7faeb4c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb0156e90 con 0x7faeb0159830 2024-05-09T00:11:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.155+0000 7faeb4c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faeb00ac710 con 0x7faeb00c43c0 2024-05-09T00:11:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.155+0000 7faeae800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faeb00ae940 0x7faeb00aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42384/0 (socket says 172.21.15.114:42384) 2024-05-09T00:11:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.155+0000 7faeae800640 1 -- 172.21.15.114:0/613864360 learned_addr learned my addr 172.21.15.114:0/613864360 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:11.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeade00640 1 --2- 172.21.15.114:0/613864360 >> v2:172.21.15.153:3300/0 conn(0x7faeb00c43c0 0x7faeb0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729581638 0 0) 0x7faeb0156bb0 con 0x7faeb00ae940 2024-05-09T00:11:11.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae94003520 con 0x7faeb00ae940 2024-05-09T00:11:11.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2947273896 0 0) 0x7fae94003520 con 0x7faeb00ae940 2024-05-09T00:11:11.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 >> v2:172.21.15.153:3300/0 conn(0x7faeb00c43c0 msgr2=0x7faeb0153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 --2- 172.21.15.114:0/613864360 >> v2:172.21.15.153:3300/0 conn(0x7faeb00c43c0 0x7faeb0153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 >> v1:172.21.15.153:6789/0 conn(0x7faeb0159830 legacy=0x7faeb0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb00ac960 con 0x7faeb00ae940 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7faea8001a70 con 0x7faeb00ae940 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 >> v1:172.21.15.114:6789/0 conn(0x7faeb00ae940 legacy=0x7faeb00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94003a50 0x7fae94003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.156+0000 7faeaca00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae94004800 0x7fae94004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeaca00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94005350 0x7fae9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00ac710 con 0x7fae94004800 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae9400c2a0 con 0x7fae94005350 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fae9400c4a0 con 0x7fae94003a50 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faead400640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae94004800 0x7fae94004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeade00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94003a50 0x7fae94003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeae800640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94005350 0x7fae9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faead400640 1 -- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94003a50 msgr2=0x7fae94003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faead400640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94003a50 0x7fae94003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faead400640 1 -- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94005350 msgr2=0x7fae9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faead400640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94005350 0x7fae9400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeae800640 1 -- 172.21.15.114:0/613864360 reap_dead start 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faead400640 1 -- 172.21.15.114:0/613864360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae94003520 con 0x7fae94004800 2024-05-09T00:11:11.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.157+0000 7faeade00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94003a50 0x7fae94003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.159+0000 7faead400640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae94004800 0x7fae94004c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae9c001790 tx=0x7fae94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635b130b5313d056 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.159+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0013b0 con 0x7fae94004800 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.159+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9c0052d0 con 0x7fae94004800 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.159+0000 7faeaca00640 1 -- 172.21.15.114:0/613864360 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c02aac0 con 0x7fae94004800 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 -- 172.21.15.114:0/613864360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae94004800 msgr2=0x7fae94004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae94004800 0x7fae94004c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae9c001790 tx=0x7fae94005830 comp rx=0 tx=0).stop 2024-05-09T00:11:11.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 -- 172.21.15.114:0/613864360 shutdown_connections 2024-05-09T00:11:11.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 --2- 172.21.15.114:0/613864360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae94004800 0x7fae94004c10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 -- 172.21.15.114:0/613864360 >> 172.21.15.114:0/613864360 conn(0x7faeb006c680 msgr2=0x7faeb006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:11.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 -- 172.21.15.114:0/613864360 shutdown_connections 2024-05-09T00:11:11.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.160+0000 7faeb4c00640 1 -- 172.21.15.114:0/613864360 wait complete. 2024-05-09T00:11:11.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.164+0000 7faeb4c00640 1 Processor -- start 2024-05-09T00:11:11.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.164+0000 7faeb4c00640 1 -- start start 2024-05-09T00:11:11.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94004800 0x7faeb014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 0x7faeb0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb01592e0 0x7faeb0147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faeb4c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faeb0153760 con 0x7faeb0151080 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faeb4c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00ad3c0 con 0x7faeb01592e0 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faeb4c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faeb01538e0 con 0x7fae94004800 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faead400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 0x7faeb0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faead400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 0x7faeb0158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55120/0 (socket says 172.21.15.114:55120) 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.166+0000 7faead400640 1 -- 172.21.15.114:0/3744827635 learned_addr learned my addr 172.21.15.114:0/3744827635 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faeae800640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb01592e0 0x7faeb0147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faeade00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94004800 0x7faeb014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faead400640 1 -- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94004800 msgr2=0x7faeb014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faead400640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94004800 0x7faeb014ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faead400640 1 -- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb01592e0 msgr2=0x7faeb0147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faead400640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb01592e0 0x7faeb0147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faead400640 1 -- 172.21.15.114:0/3744827635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb0148b20 con 0x7faeb0151080 2024-05-09T00:11:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.167+0000 7faead400640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 0x7faeb0158da0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae9c001790 tx=0x7fae9c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.168+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c042070 con 0x7faeb0151080 2024-05-09T00:11:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.168+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9c005480 con 0x7faeb0151080 2024-05-09T00:11:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.168+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c037040 con 0x7faeb0151080 2024-05-09T00:11:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.168+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb01ece30 con 0x7faeb0151080 2024-05-09T00:11:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.168+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb0147460 con 0x7faeb0151080 2024-05-09T00:11:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.169+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb006a4c0 con 0x7faeb0151080 2024-05-09T00:11:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.170+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae9c007040 con 0x7faeb0151080 2024-05-09T00:11:11.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.171+0000 7faea6000640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae90076300 0x7fae90078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:11.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.171+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7fae9c0b7220 con 0x7faeb0151080 2024-05-09T00:11:11.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.172+0000 7faeade00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae90076300 0x7fae90078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:11.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.173+0000 7faeade00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae90076300 0x7fae90078810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faeb006a230 tx=0x7faea0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:11.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.176+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faeb006a4c0 con 0x7faeb0151080 2024-05-09T00:11:11.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.333+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6b01591e0 con 0x7ff6b01ee740 2024-05-09T00:11:11.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.334+0000 7ff6aa000640 1 -- 172.21.15.114:0/559349121 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7ff6ac0603f0 con 0x7ff6b01ee740 2024-05-09T00:11:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:11.331 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:11.331 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:11.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff6940762d0 msgr2=0x7ff6940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff6940762d0 0x7ff6940787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6b006a230 tx=0x7ff6a4008040 comp rx=0 tx=0).stop 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 msgr2=0x7ff6b0141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 0x7ff6b0141260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6980057e0 tx=0x7ff6ac00cae0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 shutdown_connections 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff6940762d0 0x7ff6940787e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6b01ee740 0x7ff6b0141260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6b0143480 0x7ff6b01ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 --2- 172.21.15.114:0/559349121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff698004800 0x7ff6b00c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 >> 172.21.15.114:0/559349121 conn(0x7ff6b006c680 msgr2=0x7ff6b014be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 shutdown_connections 2024-05-09T00:11:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.337+0000 7ff6b8800640 1 -- 172.21.15.114:0/559349121 wait complete. 2024-05-09T00:11:11.357 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.427+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faeb0077430 con 0x7faeb0151080 2024-05-09T00:11:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.428+0000 7faea6000640 1 -- 172.21.15.114:0/3744827635 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fae9c080850 con 0x7faeb0151080 2024-05-09T00:11:11.424 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:11.425 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:11.426 INFO:tasks.workunit.client.1.smithi153.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T00:11:11.426 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.426 INFO:tasks.workunit.client.1.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: git switch -c 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr:Or undo this operation with: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: git switch - 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T00:11:11.427 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-05-09T00:11:11.428 INFO:tasks.workunit.client.1.smithi153.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T00:11:11.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae90076300 msgr2=0x7fae90078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae90076300 0x7fae90078810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faeb006a230 tx=0x7faea0008040 comp rx=0 tx=0).stop 2024-05-09T00:11:11.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 msgr2=0x7faeb0158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 0x7faeb0158da0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae9c001790 tx=0x7fae9c001120 comp rx=0 tx=0).stop 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 shutdown_connections 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fae90076300 0x7fae90078810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb01592e0 0x7faeb0147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeb0151080 0x7faeb0158da0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 --2- 172.21.15.114:0/3744827635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae94004800 0x7faeb014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 >> 172.21.15.114:0/3744827635 conn(0x7faeb006c680 msgr2=0x7faeb00c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.430+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 shutdown_connections 2024-05-09T00:11:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:11.431+0000 7faeb4c00640 1 -- 172.21.15.114:0/3744827635 wait complete. 2024-05-09T00:11:11.441 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-09T00:11:11.452 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:11:11.503 INFO:tasks.workunit.client.1.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T00:11:11.510 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T00:11:11.510 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T00:11:11.875 INFO:tasks.workunit.client.0.smithi114.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T00:11:11.875 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.875 INFO:tasks.workunit.client.0.smithi114.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: git switch -c 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr:Or undo this operation with: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: git switch - 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.876 INFO:tasks.workunit.client.0.smithi114.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T00:11:11.877 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-05-09T00:11:11.877 INFO:tasks.workunit.client.0.smithi114.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T00:11:11.890 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T00:11:11.949 INFO:tasks.workunit.client.0.smithi114.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T00:11:11.955 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T00:11:11.956 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T00:11:12.229 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T00:11:12.335 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T00:11:12.412 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T00:11:12.417 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T00:11:12.417 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T00:11:12.497 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T00:11:12.507 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:11:12.507 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-09T00:11:12.560 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-05-09T00:11:12.563 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-05-09T00:11:12.563 DEBUG:teuthology.orchestra.run.smithi153:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-05-09T00:11:12.682 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T00:11:12.790 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T00:11:12.877 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T00:11:12.882 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T00:11:12.882 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T00:11:12.961 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T00:11:12.971 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:11:12.971 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T00:11:13.019 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-05-09T00:11:13.021 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-05-09T00:11:13.021 DEBUG:teuthology.orchestra.run.smithi114:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-05-09T00:11:13.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:13.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:13.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.647+0000 7fcc15c00640 1 Processor -- start 2024-05-09T00:11:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.647+0000 7fcc15c00640 1 -- start start 2024-05-09T00:11:13.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc15c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc10155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc15c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc1006c680 0x7fcc1006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc15c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc101585d0 con 0x7fcc1015b830 2024-05-09T00:11:13.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc15c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcc101588b0 con 0x7fcc1006c680 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc15c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcc10158b90 con 0x7fcc100c0560 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc07e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc1006c680 0x7fcc1006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc07e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc1006c680 0x7fcc1006ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55136/0 (socket says 172.21.15.114:55136) 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc07e00640 1 -- 172.21.15.114:0/586661969 learned_addr learned my addr 172.21.15.114:0/586661969 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.649+0000 7fcc0f400640 1 --1- 172.21.15.114:0/586661969 >> v1:172.21.15.114:6789/0 conn(0x7fcc1015b830 0x7fcc1015bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42400/0 (socket says 172.21.15.114:42400) 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.650+0000 7fcc0ea00640 1 --2- 172.21.15.114:0/586661969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc10155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.650+0000 7fcc07e00640 1 -- 172.21.15.114:0/586661969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 msgr2=0x7fcc10155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.650+0000 7fcc07e00640 1 --2- 172.21.15.114:0/586661969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc10155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.650+0000 7fcc07e00640 1 -- 172.21.15.114:0/586661969 >> v1:172.21.15.114:6789/0 conn(0x7fcc1015b830 legacy=0x7fcc1015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.650+0000 7fcc07e00640 1 -- 172.21.15.114:0/586661969 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1006d530 con 0x7fcc1006c680 2024-05-09T00:11:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.650+0000 7fcc0e000640 1 -- 172.21.15.114:0/586661969 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009716349 0 0) 0x7fcc101585d0 con 0x7fcc1015b830 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.651+0000 7fcc07e00640 1 --2- 172.21.15.114:0/586661969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1006c680 0x7fcc1006ca90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80098a0 tx=0x7fcbf802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c7d73178e54113 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.651+0000 7fcc0e000640 1 -- 172.21.15.114:0/586661969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8037070 con 0x7fcc1006c680 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.651+0000 7fcc0e000640 1 -- 172.21.15.114:0/586661969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf8032440 con 0x7fcc1006c680 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.651+0000 7fcc0e000640 1 -- 172.21.15.114:0/586661969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8032810 con 0x7fcc1006c680 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 -- 172.21.15.114:0/586661969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1006c680 msgr2=0x7fcc1006ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 --2- 172.21.15.114:0/586661969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1006c680 0x7fcc1006ca90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80098a0 tx=0x7fcbf802a290 comp rx=0 tx=0).stop 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 -- 172.21.15.114:0/586661969 shutdown_connections 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 --2- 172.21.15.114:0/586661969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1006c680 0x7fcc1006ca90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 --2- 172.21.15.114:0/586661969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc10155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 -- 172.21.15.114:0/586661969 >> 172.21.15.114:0/586661969 conn(0x7fcc100c7170 msgr2=0x7fcc100c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 -- 172.21.15.114:0/586661969 shutdown_connections 2024-05-09T00:11:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.652+0000 7fcc15c00640 1 -- 172.21.15.114:0/586661969 wait complete. 2024-05-09T00:11:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.655+0000 7fcc15c00640 1 Processor -- start 2024-05-09T00:11:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.655+0000 7fcc15c00640 1 -- start start 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.656+0000 7fcc15c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1006c680 0x7fcc1014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.656+0000 7fcc15c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc101f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.656+0000 7fcc15c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 0x7fcc1014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.656+0000 7fcc15c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1015c350 con 0x7fcc1015b830 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.656+0000 7fcc15c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc100acc30 con 0x7fcc1006c680 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.656+0000 7fcc15c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1015c4d0 con 0x7fcc100c0560 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 0x7fcc1014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 0x7fcc1014d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55146/0 (socket says 172.21.15.114:55146) 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 -- 172.21.15.114:0/655776429 learned_addr learned my addr 172.21.15.114:0/655776429 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc07e00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc101f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 -- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 msgr2=0x7fcc101f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc101f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 -- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1006c680 msgr2=0x7fcc1014b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0ea00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1006c680 0x7fcc1014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1006c680 0x7fcc1014b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 -- 172.21.15.114:0/655776429 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100ca3c0 con 0x7fcc1015b830 2024-05-09T00:11:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.657+0000 7fcc0f400640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 0x7fcc1014d340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c6b0 tx=0x7fcc0800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.658+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08018070 con 0x7fcc1015b830 2024-05-09T00:11:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.658+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc08004da0 con 0x7fcc1015b830 2024-05-09T00:11:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.658+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800a880 con 0x7fcc1015b830 2024-05-09T00:11:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.658+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1014c120 con 0x7fcc1015b830 2024-05-09T00:11:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.658+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc10070dd0 con 0x7fcc1015b830 2024-05-09T00:11:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.659+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc10069b80 con 0x7fcc1015b830 2024-05-09T00:11:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.661+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc0800aa20 con 0x7fcc1015b830 2024-05-09T00:11:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.662+0000 7fcc06a00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcbec076300 0x7fcbec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.662+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7fcc08096ec0 con 0x7fcc1015b830 2024-05-09T00:11:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.662+0000 7fcc0ea00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcbec076300 0x7fcbec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.663+0000 7fcc0ea00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcbec076300 0x7fcbec078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcc00006fd0 tx=0x7fcc00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.667+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc10069b80 con 0x7fcc1015b830 2024-05-09T00:11:13.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.712+0000 7f7286600640 1 Processor -- start 2024-05-09T00:11:13.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.712+0000 7f7286600640 1 -- start start 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f7286600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 0x7f7280072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f7286600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7280074040 con 0x7f72800c4a70 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f7286600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72800c58f0 con 0x7f72801585c0 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f7286600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7280073df0 con 0x7f7280073800 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f7276a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f72800c4a70 0x7f72800c63d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42416/0 (socket says 172.21.15.114:42416) 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f7276a00640 1 -- 172.21.15.114:0/1405075979 learned_addr learned my addr 172.21.15.114:0/1405075979 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.714+0000 7f727f400640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 0x7f7280072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453425133 0 0) 0x7f7280074040 con 0x7f72800c4a70 2024-05-09T00:11:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7264003520 con 0x7f72800c4a70 2024-05-09T00:11:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2398676092 0 0) 0x7f7264003520 con 0x7f72800c4a70 2024-05-09T00:11:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 msgr2=0x7f7280072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 0x7f7280072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 >> v1:172.21.15.153:6789/0 conn(0x7f72801585c0 legacy=0x7f728015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72800c5bd0 con 0x7f72800c4a70 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f72680016f0 con 0x7f72800c4a70 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 >> v1:172.21.15.114:6789/0 conn(0x7f72800c4a70 legacy=0x7f72800c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 0x7f7264003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7264004050 0x7f7264004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7264004d90 0x7f7264005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7280073df0 con 0x7f7264004d90 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.715+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f726400bc50 con 0x7f7264004050 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f726400be50 con 0x7f7280073800 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727fe00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7264004d90 0x7f7264005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727f400640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 0x7f7264003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f7276a00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7264004050 0x7f7264004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727fe00640 1 -- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 msgr2=0x7f7264003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727fe00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7280073800 0x7f7264003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727fe00640 1 -- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7264004050 msgr2=0x7f7264004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727fe00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7264004050 0x7f7264004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.716+0000 7f727fe00640 1 -- 172.21.15.114:0/1405075979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7264003520 con 0x7f7264004d90 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.717+0000 7f727fe00640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7264004d90 0x7f7264005240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7278001a10 tx=0x7f7264005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07eaba496763167 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.718+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278001a50 con 0x7f7264004d90 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.718+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7278003b70 con 0x7f7264004d90 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.718+0000 7f727ea00640 1 -- 172.21.15.114:0/1405075979 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72780050d0 con 0x7f7264004d90 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.718+0000 7f7286600640 1 -- 172.21.15.114:0/1405075979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7264004d90 msgr2=0x7f7264005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.718+0000 7f7286600640 1 --2- 172.21.15.114:0/1405075979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7264004d90 0x7f7264005240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7278001a10 tx=0x7f7264005830 comp rx=0 tx=0).stop 2024-05-09T00:11:13.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.718+0000 7f727fe00640 1 -- 172.21.15.114:0/1405075979 reap_dead start 2024-05-09T00:11:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.719+0000 7f7286600640 1 -- 172.21.15.114:0/1405075979 shutdown_connections 2024-05-09T00:11:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.719+0000 7f7286600640 1 -- 172.21.15.114:0/1405075979 >> 172.21.15.114:0/1405075979 conn(0x7f728006c680 msgr2=0x7f728006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.719+0000 7f7286600640 1 -- 172.21.15.114:0/1405075979 shutdown_connections 2024-05-09T00:11:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.719+0000 7f7286600640 1 -- 172.21.15.114:0/1405075979 wait complete. 2024-05-09T00:11:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.721+0000 7f7286600640 1 Processor -- start 2024-05-09T00:11:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.721+0000 7f7286600640 1 -- start start 2024-05-09T00:11:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.722+0000 7f7286600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7264004d90 0x7f7280155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.722+0000 7f7286600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728014f6a0 0x7f72800bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.722+0000 7f7286600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 0x7f72800c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f7286600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72800c4e80 con 0x7f72800c01d0 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f7286600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72800c5f40 con 0x7f728014f6a0 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f7286600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72800c2670 con 0x7f7264004d90 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f727fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 0x7f72800c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f727f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7264004d90 0x7f7280155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f727fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 0x7f72800c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55164/0 (socket says 172.21.15.114:55164) 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f727fe00640 1 -- 172.21.15.114:0/2716016039 learned_addr learned my addr 172.21.15.114:0/2716016039 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.723+0000 7f7276a00640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728014f6a0 0x7f72800bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f727fe00640 1 -- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7264004d90 msgr2=0x7f7280155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f727fe00640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7264004d90 0x7f7280155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f727fe00640 1 -- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728014f6a0 msgr2=0x7f72800bfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f727fe00640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728014f6a0 0x7f72800bfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f727fe00640 1 -- 172.21.15.114:0/2716016039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72800bef00 con 0x7f72800c01d0 2024-05-09T00:11:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f727fe00640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 0x7f72800c2ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7278035040 tx=0x7f72780014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278007df0 con 0x7f72800c01d0 2024-05-09T00:11:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7278045070 con 0x7f72800c01d0 2024-05-09T00:11:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7280155850 con 0x7f72800c01d0 2024-05-09T00:11:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.724+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278005610 con 0x7f72800c01d0 2024-05-09T00:11:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.725+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72800bf1a0 con 0x7f72800c01d0 2024-05-09T00:11:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.725+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7280077430 con 0x7f72800c01d0 2024-05-09T00:11:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.727+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f727803c040 con 0x7f72800c01d0 2024-05-09T00:11:13.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.728+0000 7f7277e00640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f725c0762d0 0x7f725c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.728+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6666+0+0 (secure 0 0 0) 0x7f72780baab0 con 0x7f72800c01d0 2024-05-09T00:11:13.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.728+0000 7f727f400640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f725c0762d0 0x7f725c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.729+0000 7f727f400640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f725c0762d0 0x7f725c0787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7270009ac0 tx=0x7f7270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.736+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7278083fa0 con 0x7f72800c01d0 2024-05-09T00:11:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.919+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc10077430 con 0x7fcc1015b830 2024-05-09T00:11:13.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.920+0000 7fcc06a00640 1 -- 172.21.15.114:0/655776429 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7fcc100ca3c0 con 0x7fcc1015b830 2024-05-09T00:11:13.917 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:13.917 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:13.917 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcbec076300 msgr2=0x7fcbec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcbec076300 0x7fcbec078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcc00006fd0 tx=0x7fcc00008040 comp rx=0 tx=0).stop 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 msgr2=0x7fcc1014d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 0x7fcc1014d340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c6b0 tx=0x7fcc0800cb70 comp rx=0 tx=0).stop 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 shutdown_connections 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcbec076300 0x7fcbec078810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1015b830 0x7fcc1014d340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc100c0560 0x7fcc101f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 --2- 172.21.15.114:0/655776429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1006c680 0x7fcc1014b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 >> 172.21.15.114:0/655776429 conn(0x7fcc100c7170 msgr2=0x7fcc100c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 shutdown_connections 2024-05-09T00:11:13.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.923+0000 7fcc15c00640 1 -- 172.21.15.114:0/655776429 wait complete. 2024-05-09T00:11:13.943 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.983+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72800af7e0 con 0x7f72800c01d0 2024-05-09T00:11:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.984+0000 7f7277e00640 1 -- 172.21.15.114:0/2716016039 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6492 (secure 0 0 0) 0x7f72780838a0 con 0x7f72800c01d0 2024-05-09T00:11:13.981 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:13.981 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:08:58.825219+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/3829412957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3829412957},{"type":"v1","addr":"172.21.15.153:6835","nonce":3829412957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4238,"qdb_cluster":[4238]},"id":2}]} 2024-05-09T00:11:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 15 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f725c0762d0 msgr2=0x7f725c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f725c0762d0 0x7f725c0787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7270009ac0 tx=0x7f7270008040 comp rx=0 tx=0).stop 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 msgr2=0x7f72800c2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 0x7f72800c2ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7278035040 tx=0x7f72780014a0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 shutdown_connections 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f725c0762d0 0x7f725c0787e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72800c01d0 0x7f72800c2ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728014f6a0 0x7f72800bfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 --2- 172.21.15.114:0/2716016039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7264004d90 0x7f7280155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 >> 172.21.15.114:0/2716016039 conn(0x7f728006c680 msgr2=0x7f7280157060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.987+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 shutdown_connections 2024-05-09T00:11:13.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:13.988+0000 7f7286600640 1 -- 172.21.15.114:0/2716016039 wait complete. 2024-05-09T00:11:14.010 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:11:15.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:16.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:16.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.226+0000 7f553c800640 1 Processor -- start 2024-05-09T00:11:16.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.226+0000 7f553c800640 1 -- start start 2024-05-09T00:11:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.228+0000 7f553c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 0x7f55340c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.228+0000 7f553c800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5534141270 con 0x7f5534140e60 2024-05-09T00:11:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.228+0000 7f553c800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553415c740 con 0x7f5534073550 2024-05-09T00:11:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.228+0000 7f553c800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5534074070 con 0x7f553415c260 2024-05-09T00:11:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.229+0000 7f5539400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5534140e60 0x7f55340c60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42424/0 (socket says 172.21.15.114:42424) 2024-05-09T00:11:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.229+0000 7f5539400640 1 -- 172.21.15.114:0/328878189 learned_addr learned my addr 172.21.15.114:0/328878189 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.229+0000 7f5539e00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 0x7f55340c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.229+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336497013 0 0) 0x7f5534141270 con 0x7f5534140e60 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.229+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f551c003520 con 0x7f5534140e60 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2440872538 0 0) 0x7f551c003520 con 0x7f5534140e60 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 msgr2=0x7f55340c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 0x7f55340c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 >> v1:172.21.15.153:6789/0 conn(0x7f5534073550 legacy=0x7f5534073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55341583c0 con 0x7f5534140e60 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f55240016f0 con 0x7f5534140e60 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 >> v1:172.21.15.114:6789/0 conn(0x7f5534140e60 legacy=0x7f55340c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f551c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004800 0x7f551c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 0x7f551c0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5534074070 con 0x7f551c003a30 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00bb50 con 0x7f551c004800 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f551c00bd50 con 0x7f553415c260 2024-05-09T00:11:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.230+0000 7f5539e00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f551c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539400640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004800 0x7f551c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f553a800640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 0x7f551c0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539e00640 1 -- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 msgr2=0x7f551c0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539e00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f553415c260 0x7f551c0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539e00640 1 -- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004800 msgr2=0x7f551c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539e00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004800 0x7f551c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539e00640 1 -- 172.21.15.114:0/328878189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c003520 con 0x7f551c003a30 2024-05-09T00:11:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.231+0000 7f5539400640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004800 0x7f551c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.232+0000 7f5539e00640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f551c003e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5528009ac0 tx=0x7f551c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d363e582b955ca31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.232+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528036070 con 0x7f551c003a30 2024-05-09T00:11:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.232+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5528031400 con 0x7f551c003a30 2024-05-09T00:11:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.232+0000 7f5538a00640 1 -- 172.21.15.114:0/328878189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528009690 con 0x7f551c003a30 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.233+0000 7f553c800640 1 -- 172.21.15.114:0/328878189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 msgr2=0x7f551c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.233+0000 7f553c800640 1 --2- 172.21.15.114:0/328878189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f551c003e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5528009ac0 tx=0x7f551c005830 comp rx=0 tx=0).stop 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.233+0000 7f553a800640 1 -- 172.21.15.114:0/328878189 reap_dead start 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.234+0000 7f553c800640 1 -- 172.21.15.114:0/328878189 shutdown_connections 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.234+0000 7f553c800640 1 -- 172.21.15.114:0/328878189 >> 172.21.15.114:0/328878189 conn(0x7f553406c680 msgr2=0x7f553406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.234+0000 7f553c800640 1 -- 172.21.15.114:0/328878189 shutdown_connections 2024-05-09T00:11:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.234+0000 7f553c800640 1 -- 172.21.15.114:0/328878189 wait complete. 2024-05-09T00:11:16.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.236+0000 7f553c800640 1 Processor -- start 2024-05-09T00:11:16.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.236+0000 7f553c800640 1 -- start start 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.237+0000 7f553c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f55341ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.237+0000 7f553c800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55340c4920 0x7f55341f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.237+0000 7f553c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55340c4d30 0x7f553413dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.237+0000 7f553c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5534158980 con 0x7f551c003a30 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.237+0000 7f553c800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5534158cf0 con 0x7f55340c4920 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.237+0000 7f553c800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5534159180 con 0x7f55340c4d30 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f55341ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f55341ee4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55184/0 (socket says 172.21.15.114:55184) 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 -- 172.21.15.114:0/285857535 learned_addr learned my addr 172.21.15.114:0/285857535 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f553a800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55340c4d30 0x7f553413dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539400640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55340c4920 0x7f55341f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 -- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55340c4d30 msgr2=0x7f553413dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55340c4d30 0x7f553413dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 -- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55340c4920 msgr2=0x7f55341f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55340c4920 0x7f55341f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f5539e00640 1 -- 172.21.15.114:0/285857535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534144160 con 0x7f551c003a30 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.238+0000 7f553a800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55340c4d30 0x7f553413dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.239+0000 7f5539e00640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f55341ee4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5528009be0 tx=0x7f5528004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.239+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528040020 con 0x7f551c003a30 2024-05-09T00:11:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.239+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5528003b40 con 0x7f551c003a30 2024-05-09T00:11:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.239+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528036040 con 0x7f551c003a30 2024-05-09T00:11:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.239+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55340af210 con 0x7f551c003a30 2024-05-09T00:11:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.239+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55340ae220 con 0x7f551c003a30 2024-05-09T00:11:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.240+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5534141b70 con 0x7f551c003a30 2024-05-09T00:11:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.243+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5528043020 con 0x7f551c003a30 2024-05-09T00:11:16.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.244+0000 7f552e000640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5518076300 0x7f5518078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.244+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f55280b79d0 con 0x7f551c003a30 2024-05-09T00:11:16.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.244+0000 7f5539400640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5518076300 0x7f5518078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.245+0000 7f5539400640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5518076300 0x7f5518078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5524001eb0 tx=0x7f5524001bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.249+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f552804a020 con 0x7f551c003a30 2024-05-09T00:11:16.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.272+0000 7f8abe600640 1 Processor -- start 2024-05-09T00:11:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.272+0000 7f8abe600640 1 -- start start 2024-05-09T00:11:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8abe600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ab80c43c0 0x7f8ab8153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8abe600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab8156bb0 con 0x7f8ab8159830 2024-05-09T00:11:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8abe600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab8156e90 con 0x7f8ab80ae940 2024-05-09T00:11:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8abe600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab80ac710 con 0x7f8ab80c43c0 2024-05-09T00:11:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8ab6a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ab8159830 0x7f8ab8159c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42426/0 (socket says 172.21.15.114:42426) 2024-05-09T00:11:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8ab6a00640 1 -- 172.21.15.114:0/1499375796 learned_addr learned my addr 172.21.15.114:0/1499375796 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:16.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.274+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250428979 0 0) 0x7f8ab8156bb0 con 0x7f8ab8159830 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab7400640 1 --2- 172.21.15.114:0/1499375796 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80c43c0 0x7f8ab8153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a9c003520 con 0x7f8ab8159830 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2884191894 0 0) 0x7f8a9c003520 con 0x7f8ab8159830 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80c43c0 msgr2=0x7f8ab8153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 --2- 172.21.15.114:0/1499375796 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80c43c0 0x7f8ab8153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 >> v1:172.21.15.153:6789/0 conn(0x7f8ab80ae940 legacy=0x7f8ab80aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab80ac960 con 0x7f8ab8159830 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f8aa40016f0 con 0x7f8ab8159830 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 >> v1:172.21.15.114:6789/0 conn(0x7f8ab8159830 legacy=0x7f8ab8159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a9c003aa0 0x7f8a9c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c004800 0x7f8a9c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a9c0099b0 0x7f8a9c00bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80ac710 con 0x7f8a9c003aa0 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c00c3c0 con 0x7f8a9c004800 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c00c5c0 con 0x7f8a9c0099b0 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.275+0000 7f8ab7400640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a9c003aa0 0x7f8a9c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab6a00640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c004800 0x7f8a9c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab7400640 1 -- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a9c0099b0 msgr2=0x7f8a9c00bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab7400640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a9c0099b0 0x7f8a9c00bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab7400640 1 -- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c004800 msgr2=0x7f8a9c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab7400640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c004800 0x7f8a9c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab7400640 1 -- 172.21.15.114:0/1499375796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c003520 con 0x7f8a9c003aa0 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab7e00640 1 -- 172.21.15.114:0/1499375796 reap_dead start 2024-05-09T00:11:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.276+0000 7f8ab6a00640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c004800 0x7f8a9c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.277+0000 7f8ab7400640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a9c003aa0 0x7f8a9c003f30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800ba10 tx=0x7f8a9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ad55b90efc3c83 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.278+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8030070 con 0x7f8a9c003aa0 2024-05-09T00:11:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.278+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa802adb0 con 0x7f8a9c003aa0 2024-05-09T00:11:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.278+0000 7f8ab6000640 1 -- 172.21.15.114:0/1499375796 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800b610 con 0x7f8a9c003aa0 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.278+0000 7f8abe600640 1 -- 172.21.15.114:0/1499375796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a9c003aa0 msgr2=0x7f8a9c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.278+0000 7f8abe600640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a9c003aa0 0x7f8a9c003f30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800ba10 tx=0x7f8a9c005830 comp rx=0 tx=0).stop 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.279+0000 7f8abe600640 1 -- 172.21.15.114:0/1499375796 shutdown_connections 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.279+0000 7f8abe600640 1 --2- 172.21.15.114:0/1499375796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a9c003aa0 0x7f8a9c003f30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.279+0000 7f8abe600640 1 -- 172.21.15.114:0/1499375796 >> 172.21.15.114:0/1499375796 conn(0x7f8ab806c680 msgr2=0x7f8ab806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.279+0000 7f8abe600640 1 -- 172.21.15.114:0/1499375796 shutdown_connections 2024-05-09T00:11:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.279+0000 7f8abe600640 1 -- 172.21.15.114:0/1499375796 wait complete. 2024-05-09T00:11:16.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.281+0000 7f8abe600640 1 Processor -- start 2024-05-09T00:11:16.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.281+0000 7f8abe600640 1 -- start start 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.282+0000 7f8abe600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003aa0 0x7f8ab80c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.282+0000 7f8abe600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab8151010 0x7f8ab81ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.282+0000 7f8abe600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 0x7f8ab8148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8abe600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8153760 con 0x7f8ab81ee920 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8abe600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80ad3c0 con 0x7f8a9c003aa0 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8abe600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab81538e0 con 0x7f8ab8151010 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 0x7f8ab8148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 0x7f8ab8148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55204/0 (socket says 172.21.15.114:55204) 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2349206627 learned_addr learned my addr 172.21.15.114:0/2349206627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7400640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003aa0 0x7f8ab80c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab6a00640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab8151010 0x7f8ab81ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab8151010 msgr2=0x7f8ab81ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab8151010 0x7f8ab81ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003aa0 msgr2=0x7f8ab80c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003aa0 0x7f8ab80c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2349206627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab81f20b0 con 0x7f8ab81ee920 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab7400640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003aa0 0x7f8ab80c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.283+0000 7f8ab6a00640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab8151010 0x7f8ab81ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.284+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 0x7f8ab8148590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ae410 tx=0x7f8ab000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.284+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0007070 con 0x7f8ab81ee920 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.284+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab0007230 con 0x7f8ab81ee920 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.284+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0007620 con 0x7f8ab81ee920 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.284+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab81f2390 con 0x7f8ab81ee920 2024-05-09T00:11:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.284+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab81eee40 con 0x7f8ab81ee920 2024-05-09T00:11:16.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.286+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab8077430 con 0x7f8ab81ee920 2024-05-09T00:11:16.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.287+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ab0011070 con 0x7f8ab81ee920 2024-05-09T00:11:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.288+0000 7f8aaf400640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a980762d0 0x7f8a980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.288+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f8ab0096be0 con 0x7f8ab81ee920 2024-05-09T00:11:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.289+0000 7f8ab7400640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a980762d0 0x7f8a980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.290+0000 7f8ab7400640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a980762d0 0x7f8a980787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ab806d5f0 tx=0x7f8aa8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.294+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ab0060020 con 0x7f8ab81ee920 2024-05-09T00:11:16.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.499+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5534077430 con 0x7f551c003a30 2024-05-09T00:11:16.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.501+0000 7f552e000640 1 -- 172.21.15.114:0/285857535 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5663 (secure 0 0 0) 0x7f55280044e0 con 0x7f551c003a30 2024-05-09T00:11:16.498 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:16.498 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:14.918823+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":41,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:11:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5518076300 msgr2=0x7f5518078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5518076300 0x7f5518078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5524001eb0 tx=0x7f5524001bb0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 msgr2=0x7f55341ee4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f55341ee4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5528009be0 tx=0x7f5528004730 comp rx=0 tx=0).stop 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 shutdown_connections 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5518076300 0x7f5518078810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55340c4d30 0x7f553413dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55340c4920 0x7f55341f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 --2- 172.21.15.114:0/285857535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c003a30 0x7f55341ee4c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 >> 172.21.15.114:0/285857535 conn(0x7f553406c680 msgr2=0x7f553406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 shutdown_connections 2024-05-09T00:11:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.504+0000 7f553c800640 1 -- 172.21.15.114:0/285857535 wait complete. 2024-05-09T00:11:16.528 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:16.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.535+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ab80c6ca0 con 0x7f8ab81ee920 2024-05-09T00:11:16.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.536+0000 7f8aaf400640 1 -- 172.21.15.114:0/2349206627 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5663 (secure 0 0 0) 0x7f8ab00680a0 con 0x7f8ab81ee920 2024-05-09T00:11:16.532 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:16.532 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:14.918823+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":41,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:11:16.533 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-05-09T00:11:16.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a980762d0 msgr2=0x7f8a980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a980762d0 0x7f8a980787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ab806d5f0 tx=0x7f8aa8030000 comp rx=0 tx=0).stop 2024-05-09T00:11:16.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 msgr2=0x7f8ab8148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 0x7f8ab8148590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ae410 tx=0x7f8ab000cae0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 shutdown_connections 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a980762d0 0x7f8a980787e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab81ee920 0x7f8ab8148590 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab8151010 0x7f8ab81ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 --2- 172.21.15.114:0/2349206627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003aa0 0x7f8ab80c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 >> 172.21.15.114:0/2349206627 conn(0x7f8ab806c680 msgr2=0x7f8ab80c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 shutdown_connections 2024-05-09T00:11:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.538+0000 7f8abe600640 1 -- 172.21.15.114:0/2349206627 wait complete. 2024-05-09T00:11:16.559 INFO:tasks.mds_thrash.fs.[b]:mds.d down, removed from mdsmap 2024-05-09T00:11:16.559 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T00:11:16.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:16.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.861+0000 7f13c6200640 1 Processor -- start 2024-05-09T00:11:16.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.861+0000 7f13c6200640 1 -- start start 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c6200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13c00c4940 0x7f13c01556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c6200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13c00703a0 0x7f13c00c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c6200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c0074200 con 0x7f13c00c2d10 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c6200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f13c00c5620 con 0x7f13c00c4940 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c6200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f13c00c5900 con 0x7f13c00703a0 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c4e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13c00c4940 0x7f13c01556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c4e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13c00c4940 0x7f13c01556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55218/0 (socket says 172.21.15.114:55218) 2024-05-09T00:11:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.864+0000 7f13c4e00640 1 -- 172.21.15.114:0/2448234957 learned_addr learned my addr 172.21.15.114:0/2448234957 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.865+0000 7f13c4e00640 1 -- 172.21.15.114:0/2448234957 >> v2:172.21.15.153:3300/0 conn(0x7f13c00703a0 msgr2=0x7f13c00c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.865+0000 7f13c4e00640 1 --2- 172.21.15.114:0/2448234957 >> v2:172.21.15.153:3300/0 conn(0x7f13c00703a0 0x7f13c00c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.865+0000 7f13c4e00640 1 -- 172.21.15.114:0/2448234957 >> v1:172.21.15.153:6789/0 conn(0x7f13c00c2d10 legacy=0x7f13c0158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.865+0000 7f13c4e00640 1 -- 172.21.15.114:0/2448234957 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c00c4e10 con 0x7f13c00c4940 2024-05-09T00:11:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.866+0000 7f13c4e00640 1 --2- 172.21.15.114:0/2448234957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c01556f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13c006d600 tx=0x7f13b002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9faa9cc275bd8a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.866+0000 7f13bfe00640 1 -- 172.21.15.114:0/2448234957 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0037070 con 0x7f13c00c4940 2024-05-09T00:11:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.866+0000 7f13bfe00640 1 -- 172.21.15.114:0/2448234957 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b0032440 con 0x7f13c00c4940 2024-05-09T00:11:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.866+0000 7f13bfe00640 1 -- 172.21.15.114:0/2448234957 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0032810 con 0x7f13c00c4940 2024-05-09T00:11:16.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 -- 172.21.15.114:0/2448234957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 msgr2=0x7f13c01556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 --2- 172.21.15.114:0/2448234957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c01556f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13c006d600 tx=0x7f13b002a200 comp rx=0 tx=0).stop 2024-05-09T00:11:16.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 -- 172.21.15.114:0/2448234957 shutdown_connections 2024-05-09T00:11:16.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 --2- 172.21.15.114:0/2448234957 >> v2:172.21.15.153:3300/0 conn(0x7f13c00703a0 0x7f13c00c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 --2- 172.21.15.114:0/2448234957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c01556f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 -- 172.21.15.114:0/2448234957 >> 172.21.15.114:0/2448234957 conn(0x7f13c00c9730 msgr2=0x7f13c00c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:16.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 -- 172.21.15.114:0/2448234957 shutdown_connections 2024-05-09T00:11:16.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.867+0000 7f13c6200640 1 -- 172.21.15.114:0/2448234957 wait complete. 2024-05-09T00:11:16.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.870+0000 7f13c6200640 1 Processor -- start 2024-05-09T00:11:16.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.870+0000 7f13c6200640 1 -- start start 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c6200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13c00703a0 0x7f13c0155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c6200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c00c2d10 0x7f13c014e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c0149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c6200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0073a80 con 0x7f13c00c4940 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c6200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0073900 con 0x7f13c00c2d10 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c6200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f13c0158720 con 0x7f13c00703a0 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c0149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c0149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55232/0 (socket says 172.21.15.114:55232) 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.872+0000 7f13c5800640 1 -- 172.21.15.114:0/2633485729 learned_addr learned my addr 172.21.15.114:0/2633485729 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13b7e00640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c00c2d10 0x7f13c014e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c4e00640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13c00703a0 0x7f13c0155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c5800640 1 -- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13c00703a0 msgr2=0x7f13c0155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c5800640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13c00703a0 0x7f13c0155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c5800640 1 -- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c00c2d10 msgr2=0x7f13c014e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c5800640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c00c2d10 0x7f13c014e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c5800640 1 -- 172.21.15.114:0/2633485729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c00aba00 con 0x7f13c00c4940 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13c5800640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c0149bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b990 tx=0x7f13b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.873+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8019070 con 0x7f13c00c4940 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.874+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b800cb40 con 0x7f13c00c4940 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.874+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c00ae2e0 con 0x7f13c00c4940 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.874+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8014440 con 0x7f13c00c4940 2024-05-09T00:11:16.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.874+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c00abcc0 con 0x7f13c00c4940 2024-05-09T00:11:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.875+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c00725b0 con 0x7f13c00c4940 2024-05-09T00:11:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.876+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13b801c070 con 0x7f13c00c4940 2024-05-09T00:11:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.877+0000 7f13bd600640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f139c076300 0x7f139c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.877+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f13b8097720 con 0x7f13c00c4940 2024-05-09T00:11:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.878+0000 7f13c4e00640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f139c076300 0x7f139c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.878+0000 7f13c4e00640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f139c076300 0x7f139c078810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13b0034000 tx=0x7f13b002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:16.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:16.882+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f13b8060c80 con 0x7f13c00c4940 2024-05-09T00:11:17.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.131+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13c00c3d10 con 0x7f13c00c4940 2024-05-09T00:11:17.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.133+0000 7f13bd600640 1 -- 172.21.15.114:0/2633485729 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5660 (secure 0 0 0) 0x7f13b8060580 con 0x7f13c00c4940 2024-05-09T00:11:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:17.130 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:15.914746+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":42,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:11:17.130 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-05-09T00:11:17.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f139c076300 msgr2=0x7f139c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:17.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f139c076300 0x7f139c078810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13b0034000 tx=0x7f13b002e000 comp rx=0 tx=0).stop 2024-05-09T00:11:17.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 msgr2=0x7f13c0149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c0149bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b990 tx=0x7f13b800be50 comp rx=0 tx=0).stop 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 shutdown_connections 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f139c076300 0x7f139c078810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c00c4940 0x7f13c0149bc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c00c2d10 0x7f13c014e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 --2- 172.21.15.114:0/2633485729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13c00703a0 0x7f13c0155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.135+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 >> 172.21.15.114:0/2633485729 conn(0x7f13c00c9730 msgr2=0x7f13c0154dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.136+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 shutdown_connections 2024-05-09T00:11:17.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:17.136+0000 7f13c6200640 1 -- 172.21.15.114:0/2633485729 wait complete. 2024-05-09T00:11:17.158 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 18, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 9, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4267": { "addr": "172.21.15.114:6836/1498992114", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 1498992114, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 1498992114, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4267, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:08:48.668491+0000", "qdb_cluster": [ 4267 ], "qdb_leader": 4267, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4267 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4235": { "addr": "172.21.15.153:6833/690310809", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 690310809, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 690310809, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 16, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:rejoin", "state_seq": 42 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:11:15.914746+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4235 } } } ], "standbys": [ { "addr": "172.21.15.114:6837/2960717153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2960717153, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2960717153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4226, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:11:17.959 INFO:tasks.workunit.client.1.smithi153.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-05-09T00:11:17.962 INFO:tasks.workunit.client.1.smithi153.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.1/qa/workunits/suites 2024-05-09T00:11:17.962 INFO:tasks.workunit.client.1.smithi153.stderr:+ trap -- retry EXIT 2024-05-09T00:11:17.962 INFO:tasks.workunit.client.1.smithi153.stderr:+ rm -rf ffsb 2024-05-09T00:11:17.965 INFO:tasks.workunit.client.1.smithi153.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-05-09T00:11:18.288 INFO:tasks.workunit.client.1.smithi153.stderr:Cloning into 'ffsb'... 2024-05-09T00:11:18.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:18.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.814+0000 7f92f8400640 1 Processor -- start 2024-05-09T00:11:18.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.815+0000 7f92f8400640 1 -- start start 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.816+0000 7f92f8400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92f00c43c0 0x7f92f0153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.816+0000 7f92f8400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 0x7f92f0159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.816+0000 7f92f8400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f0156bb0 con 0x7f92f015a180 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.816+0000 7f92f8400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f92f00ac710 con 0x7f92f00c43c0 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.816+0000 7f92f8400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92f0156e90 con 0x7f92f0159830 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.817+0000 7f92f6400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f92f015a180 0x7f92f006f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59278/0 (socket says 172.21.15.114:59278) 2024-05-09T00:11:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.817+0000 7f92f6400640 1 -- 172.21.15.114:0/1591217200 learned_addr learned my addr 172.21.15.114:0/1591217200 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.817+0000 7f92f5a00640 1 --2- 172.21.15.114:0/1591217200 >> v2:172.21.15.153:3300/0 conn(0x7f92f00c43c0 0x7f92f0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.817+0000 7f92f5000640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 0x7f92f0159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.817+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110239548 0 0) 0x7f92f0156bb0 con 0x7f92f015a180 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.817+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92d4003520 con 0x7f92f015a180 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3603604851 0 0) 0x7f92d4003520 con 0x7f92f015a180 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 msgr2=0x7f92f0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 0x7f92f0159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 >> v2:172.21.15.153:3300/0 conn(0x7f92f00c43c0 msgr2=0x7f92f0153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 --2- 172.21.15.114:0/1591217200 >> v2:172.21.15.153:3300/0 conn(0x7f92f00c43c0 0x7f92f0153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f00ac960 con 0x7f92f015a180 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f92e80016f0 con 0x7f92f015a180 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 >> v1:172.21.15.114:6789/0 conn(0x7f92f015a180 legacy=0x7f92f006f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92d4003a50 0x7f92d4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92d4004800 0x7f92d4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 0x7f92d4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00ac710 con 0x7f92d4004800 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0156e90 con 0x7f92d4003a50 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92d400bba0 con 0x7f92f0159830 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92f5000640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92d4004800 0x7f92d4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.818+0000 7f92f5a00640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92d4003a50 0x7f92d4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.819+0000 7f92f5000640 1 -- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 msgr2=0x7f92d4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.819+0000 7f92f5000640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92f0159830 0x7f92d4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.819+0000 7f92f5000640 1 -- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92d4003a50 msgr2=0x7f92d4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.819+0000 7f92f5000640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92d4003a50 0x7f92d4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.819+0000 7f92f5000640 1 -- 172.21.15.114:0/1591217200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d4003520 con 0x7f92d4004800 2024-05-09T00:11:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.820+0000 7f92f5000640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92d4004800 0x7f92d4004c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009fc0 tx=0x7f92d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506145a982c5388b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.820+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc009c10 con 0x7f92d4004800 2024-05-09T00:11:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.820+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc036070 con 0x7f92d4004800 2024-05-09T00:11:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.820+0000 7f92efe00640 1 -- 172.21.15.114:0/1591217200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc02d070 con 0x7f92d4004800 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f8400640 1 -- 172.21.15.114:0/1591217200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92d4004800 msgr2=0x7f92d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f8400640 1 --2- 172.21.15.114:0/1591217200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92d4004800 0x7f92d4004c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009fc0 tx=0x7f92d4005830 comp rx=0 tx=0).stop 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f6400640 1 -- 172.21.15.114:0/1591217200 reap_dead start 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f8400640 1 -- 172.21.15.114:0/1591217200 shutdown_connections 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f8400640 1 -- 172.21.15.114:0/1591217200 >> 172.21.15.114:0/1591217200 conn(0x7f92f006c680 msgr2=0x7f92f006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f8400640 1 -- 172.21.15.114:0/1591217200 shutdown_connections 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.821+0000 7f92f8400640 1 -- 172.21.15.114:0/1591217200 wait complete. 2024-05-09T00:11:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.823+0000 7f92f8400640 1 Processor -- start 2024-05-09T00:11:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.823+0000 7f92f8400640 1 -- start start 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f8400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92d4004800 0x7f92f01ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f8400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92f00c9ca0 0x7f92f00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 0x7f92f01e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0159c40 con 0x7f92f00ca0b0 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f8400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00ad3c0 con 0x7f92f00c9ca0 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f8400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92f0159dc0 con 0x7f92d4004800 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 0x7f92f01e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 0x7f92f01e0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59868/0 (socket says 172.21.15.114:59868) 2024-05-09T00:11:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f6400640 1 -- 172.21.15.114:0/3386727707 learned_addr learned my addr 172.21.15.114:0/3386727707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.825+0000 7f92f5a00640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92d4004800 0x7f92f01ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f5000640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92f00c9ca0 0x7f92f00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f6400640 1 -- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92d4004800 msgr2=0x7f92f01ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f6400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92d4004800 0x7f92f01ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f6400640 1 -- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92f00c9ca0 msgr2=0x7f92f00c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f6400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92f00c9ca0 0x7f92f00c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f6400640 1 -- 172.21.15.114:0/3386727707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f01e3050 con 0x7f92f00ca0b0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f5a00640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92d4004800 0x7f92f01ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f5000640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92f00c9ca0 0x7f92f00c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f6400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 0x7f92f01e0ef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92f0072310 tx=0x7f92e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8004bf0 con 0x7f92f00ca0b0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e8004d90 con 0x7f92f00ca0b0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8007270 con 0x7f92f00ca0b0 2024-05-09T00:11:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f01e3330 con 0x7f92f00ca0b0 2024-05-09T00:11:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.826+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f00c8f10 con 0x7f92f00ca0b0 2024-05-09T00:11:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.827+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f0077430 con 0x7f92f00ca0b0 2024-05-09T00:11:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.829+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92e8007410 con 0x7f92f00ca0b0 2024-05-09T00:11:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.830+0000 7f92ed600640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f92d00762d0 0x7f92d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.830+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f92e8097070 con 0x7f92f00ca0b0 2024-05-09T00:11:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.830+0000 7f92f5a00640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f92d00762d0 0x7f92d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.831+0000 7f92f5a00640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f92d00762d0 0x7f92d00787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f92f006d5f0 tx=0x7f92e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:18.834+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f92e801b030 con 0x7f92f00ca0b0 2024-05-09T00:11:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.084+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f006cf50 con 0x7f92f00ca0b0 2024-05-09T00:11:19.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.085+0000 7f92ed600640 1 -- 172.21.15.114:0/3386727707 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5667 (secure 0 0 0) 0x7f92e80605d0 con 0x7f92f00ca0b0 2024-05-09T00:11:19.081 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:19.082 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:19.082 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 19 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f92d00762d0 msgr2=0x7f92d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f92d00762d0 0x7f92d00787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f92f006d5f0 tx=0x7f92e0008040 comp rx=0 tx=0).stop 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 msgr2=0x7f92f01e0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 0x7f92f01e0ef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92f0072310 tx=0x7f92e800c960 comp rx=0 tx=0).stop 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 shutdown_connections 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f92d00762d0 0x7f92d00787e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92f00ca0b0 0x7f92f01e0ef0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92f00c9ca0 0x7f92f00c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 --2- 172.21.15.114:0/3386727707 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92d4004800 0x7f92f01ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 >> 172.21.15.114:0/3386727707 conn(0x7f92f006c680 msgr2=0x7f92f00c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:19.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 shutdown_connections 2024-05-09T00:11:19.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.088+0000 7f92f8400640 1 -- 172.21.15.114:0/3386727707 wait complete. 2024-05-09T00:11:19.115 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:19.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:19.344 INFO:tasks.ceph.mds.b.smithi153.stderr:2024-05-09T00:11:19.347+0000 7fb533400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:11:19.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.450+0000 7f9a42800640 1 Processor -- start 2024-05-09T00:11:19.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.451+0000 7f9a42800640 1 -- start start 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a42800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a3c15c260 0x7f9a3c0c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a42800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9a3c140e60 0x7f9a3c0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a42800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c141270 con 0x7f9a3c0c6630 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a42800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3c158cf0 con 0x7f9a3c15c260 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a42800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3c15c740 con 0x7f9a3c140e60 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a3b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a3c15c260 0x7f9a3c0c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a3be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9a3c0c6630 0x7f9a3c073550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59280/0 (socket says 172.21.15.114:59280) 2024-05-09T00:11:19.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.453+0000 7f9a3be00640 1 -- 172.21.15.114:0/1438826687 learned_addr learned my addr 172.21.15.114:0/1438826687 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:19.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.454+0000 7f9a3aa00640 1 --2- 172.21.15.114:0/1438826687 >> v2:172.21.15.153:3300/0 conn(0x7f9a3c140e60 0x7f9a3c0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:19.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.454+0000 7f9a3b400640 1 -- 172.21.15.114:0/1438826687 >> v2:172.21.15.153:3300/0 conn(0x7f9a3c140e60 msgr2=0x7f9a3c0c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:19.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.454+0000 7f9a3b400640 1 --2- 172.21.15.114:0/1438826687 >> v2:172.21.15.153:3300/0 conn(0x7f9a3c140e60 0x7f9a3c0c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.454+0000 7f9a3b400640 1 -- 172.21.15.114:0/1438826687 >> v1:172.21.15.114:6789/0 conn(0x7f9a3c0c6630 legacy=0x7f9a3c073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.454+0000 7f9a3b400640 1 -- 172.21.15.114:0/1438826687 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c1583c0 con 0x7f9a3c15c260 2024-05-09T00:11:19.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.454+0000 7f9a3a000640 1 -- 172.21.15.114:0/1438826687 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206537165 0 0) 0x7f9a3c141270 con 0x7f9a3c0c6630 2024-05-09T00:11:19.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.455+0000 7f9a3b400640 1 --2- 172.21.15.114:0/1438826687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0c3190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c3940 tx=0x7f9a2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ec129c91c5c686 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:19.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.455+0000 7f9a3a000640 1 -- 172.21.15.114:0/1438826687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c037070 con 0x7f9a3c15c260 2024-05-09T00:11:19.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.455+0000 7f9a3a000640 1 -- 172.21.15.114:0/1438826687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c032440 con 0x7f9a3c15c260 2024-05-09T00:11:19.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.455+0000 7f9a3a000640 1 -- 172.21.15.114:0/1438826687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c032810 con 0x7f9a3c15c260 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 -- 172.21.15.114:0/1438826687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c15c260 msgr2=0x7f9a3c0c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 --2- 172.21.15.114:0/1438826687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0c3190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c3940 tx=0x7f9a2c02a1a0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 -- 172.21.15.114:0/1438826687 shutdown_connections 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 --2- 172.21.15.114:0/1438826687 >> v2:172.21.15.153:3300/0 conn(0x7f9a3c140e60 0x7f9a3c0c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 --2- 172.21.15.114:0/1438826687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0c3190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 -- 172.21.15.114:0/1438826687 >> 172.21.15.114:0/1438826687 conn(0x7f9a3c06c680 msgr2=0x7f9a3c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:19.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 -- 172.21.15.114:0/1438826687 shutdown_connections 2024-05-09T00:11:19.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.456+0000 7f9a42800640 1 -- 172.21.15.114:0/1438826687 wait complete. 2024-05-09T00:11:19.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.459+0000 7f9a42800640 1 Processor -- start 2024-05-09T00:11:19.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.459+0000 7f9a42800640 1 -- start start 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a42800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 0x7f9a3c0acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a42800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a3c140e60 0x7f9a3c0aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a42800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a42800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c159180 con 0x7f9a3c0c6630 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a42800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c158980 con 0x7f9a3c15c260 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a42800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c1415f0 con 0x7f9a3c140e60 2024-05-09T00:11:19.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a3b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 0x7f9a3c0acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a3b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 0x7f9a3c0acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59890/0 (socket says 172.21.15.114:59890) 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.460+0000 7f9a3b400640 1 -- 172.21.15.114:0/4036872613 learned_addr learned my addr 172.21.15.114:0/4036872613 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3aa00640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a3c140e60 0x7f9a3c0aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3be00640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3b400640 1 -- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a3c140e60 msgr2=0x7f9a3c0aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3b400640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a3c140e60 0x7f9a3c0aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3b400640 1 -- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a3c15c260 msgr2=0x7f9a3c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3b400640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3b400640 1 -- 172.21.15.114:0/4036872613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c0ac7b0 con 0x7f9a3c0c6630 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.461+0000 7f9a3b400640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 0x7f9a3c0acf70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009890 tx=0x7f9a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.462+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c037040 con 0x7f9a3c0c6630 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.462+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c042070 con 0x7f9a3c0c6630 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.462+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c030bd0 con 0x7f9a3c0c6630 2024-05-09T00:11:19.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.462+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c1ee900 con 0x7f9a3c0c6630 2024-05-09T00:11:19.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.462+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c1eebe0 con 0x7f9a3c0c6630 2024-05-09T00:11:19.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.463+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3c077430 con 0x7f9a3c0c6630 2024-05-09T00:11:19.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.464+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a2c047460 con 0x7f9a3c0c6630 2024-05-09T00:11:19.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.465+0000 7f9a33400640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9a1c0762d0 0x7f9a1c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:19.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.465+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f9a2c0b8460 con 0x7f9a3c0c6630 2024-05-09T00:11:19.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.465+0000 7f9a3aa00640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9a1c0762d0 0x7f9a1c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:19.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.466+0000 7f9a3aa00640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9a1c0762d0 0x7f9a1c0787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a28006fd0 tx=0x7f9a28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:19.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.470+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9a2c04c020 con 0x7f9a3c0c6630 2024-05-09T00:11:19.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.698+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a3c0c2f70 con 0x7f9a3c0c6630 2024-05-09T00:11:19.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.700+0000 7f9a33400640 1 -- 172.21.15.114:0/4036872613 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5667 (secure 0 0 0) 0x7f9a2c032e20 con 0x7f9a3c0c6630 2024-05-09T00:11:19.697 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:19.697 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 19 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9a1c0762d0 msgr2=0x7f9a1c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9a1c0762d0 0x7f9a1c0787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a28006fd0 tx=0x7f9a28008040 comp rx=0 tx=0).stop 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 msgr2=0x7f9a3c0acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 0x7f9a3c0acf70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009890 tx=0x7f9a2c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 shutdown_connections 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9a1c0762d0 0x7f9a1c0787e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a3c15c260 0x7f9a3c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a3c140e60 0x7f9a3c0aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 --2- 172.21.15.114:0/4036872613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a3c0c6630 0x7f9a3c0acf70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 >> 172.21.15.114:0/4036872613 conn(0x7f9a3c06c680 msgr2=0x7f9a3c140560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:19.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 shutdown_connections 2024-05-09T00:11:19.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:19.703+0000 7f9a42800640 1 -- 172.21.15.114:0/4036872613 wait complete. 2024-05-09T00:11:19.724 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=4238 2024-05-09T00:11:19.724 INFO:tasks.mds_thrash.fs.[b]:waiting for 4 secs before reviving mds.d 2024-05-09T00:11:21.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.394+0000 7f75c6c00640 1 Processor -- start 2024-05-09T00:11:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.395+0000 7f75c6c00640 1 -- start start 2024-05-09T00:11:21.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75c6c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75c0072890 0x7f75c0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:21.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75c6c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c015a190 con 0x7f75c0072d50 2024-05-09T00:11:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75c6c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c015fe20 con 0x7f75c0160600 2024-05-09T00:11:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75c6c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f75c0160170 con 0x7f75c0072890 2024-05-09T00:11:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75bfe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f75c0072d50 0x7f75c00c4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59290/0 (socket says 172.21.15.114:59290) 2024-05-09T00:11:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75bfe00640 1 -- 172.21.15.114:0/3159152141 learned_addr learned my addr 172.21.15.114:0/3159152141 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75bf400640 1 --2- 172.21.15.114:0/3159152141 >> v2:172.21.15.114:3300/0 conn(0x7f75c0072890 0x7f75c0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.397+0000 7f75bea00640 1 -- 172.21.15.114:0/3159152141 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021512771 0 0) 0x7f75c015a190 con 0x7f75c0072d50 2024-05-09T00:11:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.398+0000 7f75bea00640 1 -- 172.21.15.114:0/3159152141 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a0003520 con 0x7f75c0072d50 2024-05-09T00:11:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.398+0000 7f75bf400640 1 -- 172.21.15.114:0/3159152141 >> v1:172.21.15.153:6789/0 conn(0x7f75c0160600 legacy=0x7f75c00c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.398+0000 7f75bf400640 1 -- 172.21.15.114:0/3159152141 >> v1:172.21.15.114:6789/0 conn(0x7f75c0072d50 legacy=0x7f75c00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.398+0000 7f75bf400640 1 -- 172.21.15.114:0/3159152141 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c015d1b0 con 0x7f75c0072890 2024-05-09T00:11:21.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.399+0000 7f75bf400640 1 --2- 172.21.15.114:0/3159152141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0072890 0x7f75c0159c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009d90 tx=0x7f75a802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded3c70a48155d97 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:21.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.399+0000 7f75bea00640 1 -- 172.21.15.114:0/3159152141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8031600 con 0x7f75c0072890 2024-05-09T00:11:21.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.399+0000 7f75bea00640 1 -- 172.21.15.114:0/3159152141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a80317a0 con 0x7f75c0072890 2024-05-09T00:11:21.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.399+0000 7f75bea00640 1 -- 172.21.15.114:0/3159152141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8031b70 con 0x7f75c0072890 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 -- 172.21.15.114:0/3159152141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0072890 msgr2=0x7f75c0159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 --2- 172.21.15.114:0/3159152141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0072890 0x7f75c0159c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009d90 tx=0x7f75a802a5d0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 -- 172.21.15.114:0/3159152141 shutdown_connections 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 --2- 172.21.15.114:0/3159152141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0072890 0x7f75c0159c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 -- 172.21.15.114:0/3159152141 >> 172.21.15.114:0/3159152141 conn(0x7f75c006c680 msgr2=0x7f75c006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 -- 172.21.15.114:0/3159152141 shutdown_connections 2024-05-09T00:11:21.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.400+0000 7f75c6c00640 1 -- 172.21.15.114:0/3159152141 wait complete. 2024-05-09T00:11:21.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.402+0000 7f75c6c00640 1 Processor -- start 2024-05-09T00:11:21.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.403+0000 7f75c6c00640 1 -- start start 2024-05-09T00:11:21.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c6c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c0072890 0x7f75c00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:21.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c6c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c0072d50 0x7f75c01f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:21.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 0x7f75c01f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:21.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00c6760 con 0x7f75c0160600 2024-05-09T00:11:21.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c6c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00c42e0 con 0x7f75c0072890 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c6c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00c68e0 con 0x7f75c0072d50 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 0x7f75c01f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 0x7f75c01f2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59910/0 (socket says 172.21.15.114:59910) 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.404+0000 7f75c4c00640 1 -- 172.21.15.114:0/2210521336 learned_addr learned my addr 172.21.15.114:0/2210521336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75bfe00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c0072890 0x7f75c00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75bf400640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c0072d50 0x7f75c01f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c4c00640 1 -- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c0072d50 msgr2=0x7f75c01f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c4c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c0072d50 0x7f75c01f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c4c00640 1 -- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c0072890 msgr2=0x7f75c00c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c4c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c0072890 0x7f75c00c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c4c00640 1 -- 172.21.15.114:0/2210521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c00ad4b0 con 0x7f75c0160600 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c4c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 0x7f75c01f2b80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f75b800b440 tx=0x7f75b800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8015020 con 0x7f75c0160600 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b8011830 con 0x7f75c0160600 2024-05-09T00:11:21.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8011c20 con 0x7f75c0160600 2024-05-09T00:11:21.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.405+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c015f9c0 con 0x7f75c0160600 2024-05-09T00:11:21.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.406+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c01e9b30 con 0x7f75c0160600 2024-05-09T00:11:21.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.407+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c0077430 con 0x7f75c0160600 2024-05-09T00:11:21.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.408+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75b8018020 con 0x7f75c0160600 2024-05-09T00:11:21.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.409+0000 7f75b7e00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f759c076300 0x7f759c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:21.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.409+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f75b80974e0 con 0x7f75c0160600 2024-05-09T00:11:21.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.409+0000 7f75bfe00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f759c076300 0x7f759c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:21.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.410+0000 7f75bfe00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f759c076300 0x7f759c078810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f75b0007a60 tx=0x7f75b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:21.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.415+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75b801f030 con 0x7f75c0160600 2024-05-09T00:11:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.661+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75c00c4d00 con 0x7f75c0160600 2024-05-09T00:11:21.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.662+0000 7f75b7e00640 1 -- 172.21.15.114:0/2210521336 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5667 (secure 0 0 0) 0x7f75b8060ac0 con 0x7f75c0160600 2024-05-09T00:11:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:21.659 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:21.659 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 19 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f759c076300 msgr2=0x7f759c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f759c076300 0x7f759c078810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f75b0007a60 tx=0x7f75b0009040 comp rx=0 tx=0).stop 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 msgr2=0x7f75c01f2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 0x7f75c01f2b80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f75b800b440 tx=0x7f75b800b900 comp rx=0 tx=0).stop 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 shutdown_connections 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f759c076300 0x7f759c078810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c0160600 0x7f75c01f2b80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c0072d50 0x7f75c01f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 --2- 172.21.15.114:0/2210521336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c0072890 0x7f75c00c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 >> 172.21.15.114:0/2210521336 conn(0x7f75c006c680 msgr2=0x7f75c015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:21.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 shutdown_connections 2024-05-09T00:11:21.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:21.665+0000 7f75c6c00640 1 -- 172.21.15.114:0/2210521336 wait complete. 2024-05-09T00:11:21.688 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:23.689 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:23.724 INFO:tasks.mds_thrash.fs.[b]:reviving mds.d 2024-05-09T00:11:23.724 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T00:11:23.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T00:11:23.732 INFO:tasks.ceph.mds.d:Started 2024-05-09T00:11:23.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:23.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.969+0000 7f7199600640 1 Processor -- start 2024-05-09T00:11:23.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.969+0000 7f7199600640 1 -- start start 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f7199600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940ca170 0x7f71940c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f7199600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f71940c4eb0 0x7f7194162b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f7199600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71940cad50 con 0x7f7194072cf0 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f7199600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f71940c9440 con 0x7f71940c4eb0 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f7199600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71940c9ce0 con 0x7f71940ca170 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f718be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7194072cf0 0x7f71941581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59294/0 (socket says 172.21.15.114:59294) 2024-05-09T00:11:23.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.971+0000 7f718be00640 1 -- 172.21.15.114:0/923356131 learned_addr learned my addr 172.21.15.114:0/923356131 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:23.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192a00640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940ca170 0x7f71940c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7193400640 1 --2- 172.21.15.114:0/923356131 >> v2:172.21.15.153:3300/0 conn(0x7f71940c4eb0 0x7f7194162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487323384 0 0) 0x7f71940cad50 con 0x7f7194072cf0 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7178003520 con 0x7f7194072cf0 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 266801872 0 0) 0x7f7178003520 con 0x7f7194072cf0 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940ca170 msgr2=0x7f71940c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940ca170 0x7f71940c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 >> v2:172.21.15.153:3300/0 conn(0x7f71940c4eb0 msgr2=0x7f7194162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 --2- 172.21.15.114:0/923356131 >> v2:172.21.15.153:3300/0 conn(0x7f71940c4eb0 0x7f7194162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.972+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71940c9690 con 0x7f7194072cf0 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f717c0016f0 con 0x7f7194072cf0 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 >> v1:172.21.15.114:6789/0 conn(0x7f7194072cf0 legacy=0x7f71941581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7178003a50 0x7f7178003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7178004800 0x7f7178004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71780051c0 0x7f717800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71940c9440 con 0x7f7178004800 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71940c9ce0 con 0x7f71780051c0 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f717800c1c0 con 0x7f7178003a50 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f718be00640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7178004800 0x7f7178004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7192a00640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7178003a50 0x7f7178003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.973+0000 7f7193400640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71780051c0 0x7f717800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.974+0000 7f718be00640 1 -- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7178003a50 msgr2=0x7f7178003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.974+0000 7f718be00640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7178003a50 0x7f7178003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.974+0000 7f718be00640 1 -- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71780051c0 msgr2=0x7f717800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.974+0000 7f718be00640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71780051c0 0x7f717800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.974+0000 7f718be00640 1 -- 172.21.15.114:0/923356131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7178003520 con 0x7f7178004800 2024-05-09T00:11:23.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.974+0000 7f7193400640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71780051c0 0x7f717800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.975+0000 7f718be00640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7178004800 0x7f7178004c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f71940740a0 tx=0x7f7178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66f4c1b50212cd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.975+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c007ce0 con 0x7f7178004800 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.975+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717c005af0 con 0x7f7178004800 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.975+0000 7f7192000640 1 -- 172.21.15.114:0/923356131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c007070 con 0x7f7178004800 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.976+0000 7f7199600640 1 -- 172.21.15.114:0/923356131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7178004800 msgr2=0x7f7178004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.976+0000 7f7199600640 1 --2- 172.21.15.114:0/923356131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7178004800 0x7f7178004c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f71940740a0 tx=0x7f7178005830 comp rx=0 tx=0).stop 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.976+0000 7f7193400640 1 -- 172.21.15.114:0/923356131 reap_dead start 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.976+0000 7f7199600640 1 -- 172.21.15.114:0/923356131 shutdown_connections 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.976+0000 7f7199600640 1 -- 172.21.15.114:0/923356131 >> 172.21.15.114:0/923356131 conn(0x7f71940cbb70 msgr2=0x7f71940ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.977+0000 7f7199600640 1 -- 172.21.15.114:0/923356131 shutdown_connections 2024-05-09T00:11:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.977+0000 7f7199600640 1 -- 172.21.15.114:0/923356131 wait complete. 2024-05-09T00:11:23.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.980+0000 7f7199600640 1 Processor -- start 2024-05-09T00:11:23.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.980+0000 7f7199600640 1 -- start start 2024-05-09T00:11:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7199600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7178004800 0x7f71940af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7199600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940af7a0 0x7f719415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7199600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 0x7f7194150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7199600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71941588d0 con 0x7f719415c0b0 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7199600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f719406f470 con 0x7f7178004800 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7199600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7194158a50 con 0x7f71940af7a0 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7193400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 0x7f7194150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7193400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 0x7f7194150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59920/0 (socket says 172.21.15.114:59920) 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7193400640 1 -- 172.21.15.114:0/1441077349 learned_addr learned my addr 172.21.15.114:0/1441077349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f718be00640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940af7a0 0x7f719415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.983+0000 7f7192a00640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7178004800 0x7f71940af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7193400640 1 -- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940af7a0 msgr2=0x7f719415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7193400640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940af7a0 0x7f719415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7193400640 1 -- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7178004800 msgr2=0x7f71940af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7193400640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7178004800 0x7f71940af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:23.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7193400640 1 -- 172.21.15.114:0/1441077349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719415b4e0 con 0x7f719415c0b0 2024-05-09T00:11:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7193400640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 0x7f7194150720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f71940c5500 tx=0x7f718c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c016620 con 0x7f719415c0b0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c01b070 con 0x7f719415c0b0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719415c4c0 con 0x7f719415c0b0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0169e0 con 0x7f719415c0b0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.984+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941ee4b0 con 0x7f719415c0b0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.986+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7194077430 con 0x7f719415c0b0 2024-05-09T00:11:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.987+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f718c016b80 con 0x7f719415c0b0 2024-05-09T00:11:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.988+0000 7f718aa00640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71700762d0 0x7f71700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.989+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f718c098970 con 0x7f719415c0b0 2024-05-09T00:11:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.989+0000 7f7192a00640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71700762d0 0x7f71700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:23.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.990+0000 7f7192a00640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71700762d0 0x7f71700787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71840090e0 tx=0x7f7184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:23.993+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f718c061db0 con 0x7f719415c0b0 2024-05-09T00:11:24.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.005+0000 7f4f27400640 1 Processor -- start 2024-05-09T00:11:24.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.005+0000 7f4f27400640 1 -- start start 2024-05-09T00:11:24.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f27400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f200ae680 0x7f4f200b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:24.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f27400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f20159d60 0x7f4f200c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:24.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f27400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f200aee90 con 0x7f4f200c74a0 2024-05-09T00:11:24.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f27400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4f200c6100 con 0x7f4f200ae680 2024-05-09T00:11:24.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f27400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f200aebb0 con 0x7f4f20159d60 2024-05-09T00:11:24.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f24a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f200ae680 0x7f4f200b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f24a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f200ae680 0x7f4f200b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59936/0 (socket says 172.21.15.114:59936) 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.007+0000 7f4f24a00640 1 -- 172.21.15.114:0/3788551593 learned_addr learned my addr 172.21.15.114:0/3788551593 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.008+0000 7f4f25400640 1 --2- 172.21.15.114:0/3788551593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f20159d60 0x7f4f200c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.008+0000 7f4f24a00640 1 -- 172.21.15.114:0/3788551593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f20159d60 msgr2=0x7f4f200c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.008+0000 7f4f24a00640 1 --2- 172.21.15.114:0/3788551593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f20159d60 0x7f4f200c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.008+0000 7f4f24a00640 1 -- 172.21.15.114:0/3788551593 >> v1:172.21.15.114:6789/0 conn(0x7f4f200c74a0 legacy=0x7f4f20159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.008+0000 7f4f24a00640 1 -- 172.21.15.114:0/3788551593 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f200c63a0 con 0x7f4f200ae680 2024-05-09T00:11:24.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.009+0000 7f4f24a00640 1 --2- 172.21.15.114:0/3788551593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200ae680 0x7f4f200b0560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009870 tx=0x7f4f1002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e734f6c16f9817bb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:24.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.009+0000 7f4f1fe00640 1 -- 172.21.15.114:0/3788551593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10037070 con 0x7f4f200ae680 2024-05-09T00:11:24.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.009+0000 7f4f1fe00640 1 -- 172.21.15.114:0/3788551593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10032440 con 0x7f4f200ae680 2024-05-09T00:11:24.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.009+0000 7f4f1fe00640 1 -- 172.21.15.114:0/3788551593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10032810 con 0x7f4f200ae680 2024-05-09T00:11:24.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.010+0000 7f4f27400640 1 -- 172.21.15.114:0/3788551593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200ae680 msgr2=0x7f4f200b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.010+0000 7f4f27400640 1 --2- 172.21.15.114:0/3788551593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200ae680 0x7f4f200b0560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009870 tx=0x7f4f1002a1c0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.010+0000 7f4f27400640 1 -- 172.21.15.114:0/3788551593 shutdown_connections 2024-05-09T00:11:24.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.010+0000 7f4f27400640 1 --2- 172.21.15.114:0/3788551593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f20159d60 0x7f4f200c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.011+0000 7f4f27400640 1 --2- 172.21.15.114:0/3788551593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200ae680 0x7f4f200b0560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.011+0000 7f4f27400640 1 -- 172.21.15.114:0/3788551593 >> 172.21.15.114:0/3788551593 conn(0x7f4f200cb7b0 msgr2=0x7f4f200cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:24.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.011+0000 7f4f27400640 1 -- 172.21.15.114:0/3788551593 shutdown_connections 2024-05-09T00:11:24.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.011+0000 7f4f27400640 1 -- 172.21.15.114:0/3788551593 wait complete. 2024-05-09T00:11:24.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.014+0000 7f4f27400640 1 Processor -- start 2024-05-09T00:11:24.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.014+0000 7f4f27400640 1 -- start start 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f27400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f200ae680 0x7f4f201f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f27400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 0x7f4f20071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f27400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f20159d60 0x7f4f2014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f27400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200c6ba0 con 0x7f4f200c74a0 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f27400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20150560 con 0x7f4f20159d60 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f27400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f200b0aa0 con 0x7f4f200ae680 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 0x7f4f20071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 0x7f4f20071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59952/0 (socket says 172.21.15.114:59952) 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.017+0000 7f4f17e00640 1 -- 172.21.15.114:0/3848364013 learned_addr learned my addr 172.21.15.114:0/3848364013 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f25400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f20159d60 0x7f4f2014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f24a00640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f200ae680 0x7f4f201f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f17e00640 1 -- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f200ae680 msgr2=0x7f4f201f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f17e00640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f200ae680 0x7f4f201f0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f17e00640 1 -- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f20159d60 msgr2=0x7f4f2014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f17e00640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f20159d60 0x7f4f2014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f17e00640 1 -- 172.21.15.114:0/3848364013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2014dba0 con 0x7f4f200c74a0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f17e00640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 0x7f4f20071020 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c3a0 tx=0x7f4f0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08017070 con 0x7f4f200c74a0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f080052d0 con 0x7f4f200c74a0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08003830 con 0x7f4f200c74a0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2014d6f0 con 0x7f4f200c74a0 2024-05-09T00:11:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.018+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f201ef960 con 0x7f4f200c74a0 2024-05-09T00:11:24.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.020+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f20077430 con 0x7f4f200c74a0 2024-05-09T00:11:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.021+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f0801a070 con 0x7f4f200c74a0 2024-05-09T00:11:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.022+0000 7f4f1d600640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4efc0762d0 0x7f4efc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.022+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6752+0+0 (secure 0 0 0) 0x7f4f08096cb0 con 0x7f4f200c74a0 2024-05-09T00:11:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.022+0000 7f4f24a00640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4efc0762d0 0x7f4efc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.023+0000 7f4f24a00640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4efc0762d0 0x7f4efc0787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f10034000 tx=0x7f4f1002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:24.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.027+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f08060210 con 0x7f4f200c74a0 2024-05-09T00:11:24.033 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-09T00:11:24.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.265+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71940ca590 con 0x7f719415c0b0 2024-05-09T00:11:24.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.266+0000 7f718aa00640 1 -- 172.21.15.114:0/1441077349 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5667 (secure 0 0 0) 0x7f718c0616b0 con 0x7f719415c0b0 2024-05-09T00:11:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:24.263 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:24.264 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 19 2024-05-09T00:11:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.269+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71700762d0 msgr2=0x7f71700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.269+0000 7f7199600640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71700762d0 0x7f71700787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71840090e0 tx=0x7f7184008040 comp rx=0 tx=0).stop 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.269+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 msgr2=0x7f7194150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.269+0000 7f7199600640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 0x7f7194150720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f71940c5500 tx=0x7f718c00f520 comp rx=0 tx=0).stop 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 shutdown_connections 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f71700762d0 0x7f71700787e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719415c0b0 0x7f7194150720 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940af7a0 0x7f719415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 --2- 172.21.15.114:0/1441077349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7178004800 0x7f71940af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 >> 172.21.15.114:0/1441077349 conn(0x7f71940cbb70 msgr2=0x7f7194154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 shutdown_connections 2024-05-09T00:11:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.270+0000 7f7199600640 1 -- 172.21.15.114:0/1441077349 wait complete. 2024-05-09T00:11:24.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.287+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f200cb280 con 0x7f4f200c74a0 2024-05-09T00:11:24.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.288+0000 7f4f1d600640 1 -- 172.21.15.114:0/3848364013 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5667 (secure 0 0 0) 0x7f4f08068020 con 0x7f4f200c74a0 2024-05-09T00:11:24.285 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:24.285 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:08:48.668491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/1498992114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1498992114},{"type":"v1","addr":"172.21.15.114:6836","nonce":1498992114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:24.285 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 19 2024-05-09T00:11:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4efc0762d0 msgr2=0x7f4efc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4efc0762d0 0x7f4efc0787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f10034000 tx=0x7f4f1002e000 comp rx=0 tx=0).stop 2024-05-09T00:11:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 msgr2=0x7f4f20071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 0x7f4f20071020 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c3a0 tx=0x7f4f0800c860 comp rx=0 tx=0).stop 2024-05-09T00:11:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 shutdown_connections 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4efc0762d0 0x7f4efc0787e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f20159d60 0x7f4f2014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f200c74a0 0x7f4f20071020 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 --2- 172.21.15.114:0/3848364013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f200ae680 0x7f4f201f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 >> 172.21.15.114:0/3848364013 conn(0x7f4f200cb7b0 msgr2=0x7f4f20157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 shutdown_connections 2024-05-09T00:11:24.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:24.291+0000 7f4f27400640 1 -- 172.21.15.114:0/3848364013 wait complete. 2024-05-09T00:11:24.294 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:11:24.310 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-09T00:11:24.490 INFO:tasks.workunit.client.1.smithi153.stderr:Updating files: 37% (22/59) Updating files: 38% (23/59) Updating files: 40% (24/59) Updating files: 42% (25/59) Updating files: 44% (26/59) Updating files: 45% (27/59) Updating files: 47% (28/59) Updating files: 49% (29/59) Updating files: 50% (30/59) Updating files: 52% (31/59) Updating files: 54% (32/59) Updating files: 55% (33/59) Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-05-09T00:11:24.499 INFO:tasks.workunit.client.1.smithi153.stderr:+ trap - EXIT 2024-05-09T00:11:24.500 INFO:tasks.workunit.client.1.smithi153.stderr:+ cd ffsb 2024-05-09T00:11:24.500 INFO:tasks.workunit.client.1.smithi153.stderr:+ ./configure 2024-05-09T00:11:25.100 INFO:tasks.workunit.client.1.smithi153.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-09T00:11:26.122 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether build environment is sane... yes 2024-05-09T00:11:26.182 INFO:tasks.workunit.client.1.smithi153.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-09T00:11:26.183 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gawk... gawk 2024-05-09T00:11:26.214 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether make sets $(MAKE)... yes 2024-05-09T00:11:26.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:26.306 INFO:tasks.workunit.client.1.smithi153.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:26.306 INFO:tasks.workunit.client.1.smithi153.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:26.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:26.328 INFO:tasks.workunit.client.1.smithi153.stdout:checking for style of include used by make... GNU 2024-05-09T00:11:26.334 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc... gcc 2024-05-09T00:11:26.482 INFO:tasks.workunit.client.1.smithi153.stdout:checking for C compiler default output file name... a.out 2024-05-09T00:11:26.489 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether the C compiler works... yes 2024-05-09T00:11:26.494 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether we are cross compiling... no 2024-05-09T00:11:26.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.575+0000 7f1290a00640 1 Processor -- start 2024-05-09T00:11:26.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.575+0000 7f1290a00640 1 -- start start 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1290a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f128c0c8a40 0x7f128c155990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1290a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f128c158e20 0x7f128c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1290a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128c15bad0 con 0x7f128c0af780 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1290a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f128c15bdb0 con 0x7f128c0c8a40 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1290a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f128c15c090 con 0x7f128c158e20 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1289e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f128c0c8a40 0x7f128c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1289e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f128c0c8a40 0x7f128c155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59966/0 (socket says 172.21.15.114:59966) 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.577+0000 7f1289e00640 1 -- 172.21.15.114:0/519964559 learned_addr learned my addr 172.21.15.114:0/519964559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:26.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.578+0000 7f1289400640 1 --2- 172.21.15.114:0/519964559 >> v2:172.21.15.153:3300/0 conn(0x7f128c158e20 0x7f128c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.578+0000 7f1289e00640 1 -- 172.21.15.114:0/519964559 >> v2:172.21.15.153:3300/0 conn(0x7f128c158e20 msgr2=0x7f128c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:26.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.578+0000 7f1289e00640 1 --2- 172.21.15.114:0/519964559 >> v2:172.21.15.153:3300/0 conn(0x7f128c158e20 0x7f128c0af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.578+0000 7f1289e00640 1 -- 172.21.15.114:0/519964559 >> v1:172.21.15.153:6789/0 conn(0x7f128c0af780 legacy=0x7f128c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:26.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.578+0000 7f1289e00640 1 -- 172.21.15.114:0/519964559 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c15c370 con 0x7f128c0c8a40 2024-05-09T00:11:26.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.578+0000 7f1289400640 1 --2- 172.21.15.114:0/519964559 >> v2:172.21.15.153:3300/0 conn(0x7f128c158e20 0x7f128c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:26.577 INFO:tasks.workunit.client.1.smithi153.stdout:checking for suffix of executables... 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.579+0000 7f1289e00640 1 --2- 172.21.15.114:0/519964559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c0c8a40 0x7f128c155990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f128c06ce20 tx=0x7f127402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4af1c931640e624 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.579+0000 7f1288a00640 1 -- 172.21.15.114:0/519964559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274037070 con 0x7f128c0c8a40 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.579+0000 7f1288a00640 1 -- 172.21.15.114:0/519964559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1274032440 con 0x7f128c0c8a40 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.579+0000 7f1288a00640 1 -- 172.21.15.114:0/519964559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274032810 con 0x7f128c0c8a40 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 -- 172.21.15.114:0/519964559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c0c8a40 msgr2=0x7f128c155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 --2- 172.21.15.114:0/519964559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c0c8a40 0x7f128c155990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f128c06ce20 tx=0x7f127402a1e0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 -- 172.21.15.114:0/519964559 shutdown_connections 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 --2- 172.21.15.114:0/519964559 >> v2:172.21.15.153:3300/0 conn(0x7f128c158e20 0x7f128c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 --2- 172.21.15.114:0/519964559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c0c8a40 0x7f128c155990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 -- 172.21.15.114:0/519964559 >> 172.21.15.114:0/519964559 conn(0x7f128c068fd0 msgr2=0x7f128c0cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:26.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 -- 172.21.15.114:0/519964559 shutdown_connections 2024-05-09T00:11:26.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.580+0000 7f1290a00640 1 -- 172.21.15.114:0/519964559 wait complete. 2024-05-09T00:11:26.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.582+0000 7f1290a00640 1 Processor -- start 2024-05-09T00:11:26.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.583+0000 7f1290a00640 1 -- start start 2024-05-09T00:11:26.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1290a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f128c0af780 0x7f128c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1290a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f128c0c8a40 0x7f128c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1290a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 0x7f128c14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1290a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f128c0cc310 con 0x7f128c158e20 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1290a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f128c159230 con 0x7f128c0c8a40 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1290a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f128c0cc490 con 0x7f128c0af780 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f128a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 0x7f128c14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f128a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 0x7f128c14ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59968/0 (socket says 172.21.15.114:59968) 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f128a800640 1 -- 172.21.15.114:0/1239399027 learned_addr learned my addr 172.21.15.114:0/1239399027 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.584+0000 7f1289e00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f128c0af780 0x7f128c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f1289400640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f128c0c8a40 0x7f128c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f128a800640 1 -- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f128c0af780 msgr2=0x7f128c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f128a800640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f128c0af780 0x7f128c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f128a800640 1 -- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f128c0c8a40 msgr2=0x7f128c157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f128a800640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f128c0c8a40 0x7f128c157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f128a800640 1 -- 172.21.15.114:0/1239399027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c0c42e0 con 0x7f128c158e20 2024-05-09T00:11:26.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f128a800640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 0x7f128c14ca40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f128400c3f0 tx=0x7f128400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:26.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284017070 con 0x7f128c158e20 2024-05-09T00:11:26.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12840052d0 con 0x7f128c158e20 2024-05-09T00:11:26.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284003810 con 0x7f128c158e20 2024-05-09T00:11:26.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.585+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128c0c7050 con 0x7f128c158e20 2024-05-09T00:11:26.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.586+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128c15b320 con 0x7f128c158e20 2024-05-09T00:11:26.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.587+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128c0ccb20 con 0x7f128c158e20 2024-05-09T00:11:26.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.588+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f128401a070 con 0x7f128c158e20 2024-05-09T00:11:26.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.589+0000 7f1282000640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1268076300 0x7f1268078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.589+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f1284096d00 con 0x7f128c158e20 2024-05-09T00:11:26.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.589+0000 7f1289e00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1268076300 0x7f1268078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.590+0000 7f1289e00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1268076300 0x7f1268078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1274034000 tx=0x7f127402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:26.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.594+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f128405fbc0 con 0x7f128c158e20 2024-05-09T00:11:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.604+0000 7f6c2d200640 1 Processor -- start 2024-05-09T00:11:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.604+0000 7f6c2d200640 1 -- start start 2024-05-09T00:11:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c2d200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 0x7f6c28159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c2d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c28156bb0 con 0x7f6c280c43c0 2024-05-09T00:11:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c2d200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c28156e90 con 0x7f6c280ae940 2024-05-09T00:11:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c2d200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280ac710 con 0x7f6c28153760 2024-05-09T00:11:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c25e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6c280c43c0 0x7f6c28159830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59316/0 (socket says 172.21.15.114:59316) 2024-05-09T00:11:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c25e00640 1 -- 172.21.15.114:0/4277666222 learned_addr learned my addr 172.21.15.114:0/4277666222 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.606+0000 7f6c25400640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 0x7f6c28159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527166601 0 0) 0x7f6c28156bb0 con 0x7f6c280c43c0 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c0c003520 con 0x7f6c280c43c0 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236376059 0 0) 0x7f6c28156e90 con 0x7f6c280ae940 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c28156bb0 con 0x7f6c280ae940 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2946393019 0 0) 0x7f6c0c003520 con 0x7f6c280c43c0 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 msgr2=0x7f6c28159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 0x7f6c28159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 >> v1:172.21.15.153:6789/0 conn(0x7f6c280ae940 legacy=0x7f6c280aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c280ac960 con 0x7f6c280c43c0 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f6c180016f0 con 0x7f6c280c43c0 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 >> v1:172.21.15.114:6789/0 conn(0x7f6c280c43c0 legacy=0x7f6c28159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 0x7f6c0c003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0c0041c0 0x7f6c0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c0c004d90 0x7f6c0c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280ac710 con 0x7f6c0c0041c0 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c00bcc0 con 0x7f6c0c004d90 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.607+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0c00bec0 con 0x7f6c28153760 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25400640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0c0041c0 0x7f6c0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25e00640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 0x7f6c0c003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c26800640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c0c004d90 0x7f6c0c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25400640 1 -- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 msgr2=0x7f6c0c003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25400640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28153760 0x7f6c0c003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25400640 1 -- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c0c004d90 msgr2=0x7f6c0c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25400640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c0c004d90 0x7f6c0c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c25400640 1 -- 172.21.15.114:0/4277666222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c003520 con 0x7f6c0c0041c0 2024-05-09T00:11:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.608+0000 7f6c26800640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c0c004d90 0x7f6c0c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.610+0000 7f6c25400640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0c0041c0 0x7f6c0c004800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009ac0 tx=0x7f6c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8848eb343571f05e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.610+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14036070 con 0x7f6c0c0041c0 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.610+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14031400 con 0x7f6c0c0041c0 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.610+0000 7f6c24a00640 1 -- 172.21.15.114:0/4277666222 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14009690 con 0x7f6c0c0041c0 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c2d200640 1 -- 172.21.15.114:0/4277666222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0c0041c0 msgr2=0x7f6c0c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4277666222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0c0041c0 0x7f6c0c004800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009ac0 tx=0x7f6c0c005830 comp rx=0 tx=0).stop 2024-05-09T00:11:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c26800640 1 -- 172.21.15.114:0/4277666222 reap_dead start 2024-05-09T00:11:26.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c2d200640 1 -- 172.21.15.114:0/4277666222 shutdown_connections 2024-05-09T00:11:26.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c2d200640 1 -- 172.21.15.114:0/4277666222 >> 172.21.15.114:0/4277666222 conn(0x7f6c2806c680 msgr2=0x7f6c2806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:26.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c2d200640 1 -- 172.21.15.114:0/4277666222 shutdown_connections 2024-05-09T00:11:26.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.611+0000 7f6c2d200640 1 -- 172.21.15.114:0/4277666222 wait complete. 2024-05-09T00:11:26.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.615+0000 7f6c2d200640 1 Processor -- start 2024-05-09T00:11:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.615+0000 7f6c2d200640 1 -- start start 2024-05-09T00:11:26.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c2d200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c2814b360 0x7f6c281ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c2d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c28073590 0x7f6c281e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c2d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 0x7f6c281e2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c2d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280af460 con 0x7f6c280739a0 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c2d200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280ad3c0 con 0x7f6c28073590 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c2d200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280af5e0 con 0x7f6c2814b360 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c26800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 0x7f6c281e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c26800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 0x7f6c281e2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59986/0 (socket says 172.21.15.114:59986) 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c26800640 1 -- 172.21.15.114:0/4020686301 learned_addr learned my addr 172.21.15.114:0/4020686301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c25e00640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c2814b360 0x7f6c281ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.618+0000 7f6c25400640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c28073590 0x7f6c281e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c26800640 1 -- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c2814b360 msgr2=0x7f6c281ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c26800640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c2814b360 0x7f6c281ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c26800640 1 -- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c28073590 msgr2=0x7f6c281e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c26800640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c28073590 0x7f6c281e1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c26800640 1 -- 172.21.15.114:0/4020686301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28157750 con 0x7f6c280739a0 2024-05-09T00:11:26.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c26800640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 0x7f6c281e2040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c20007cc0 tx=0x7f6c2000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:26.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20006b50 con 0x7f6c280739a0 2024-05-09T00:11:26.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20006cf0 con 0x7f6c280739a0 2024-05-09T00:11:26.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20003970 con 0x7f6c280739a0 2024-05-09T00:11:26.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c281eea60 con 0x7f6c280739a0 2024-05-09T00:11:26.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.619+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c281ef020 con 0x7f6c280739a0 2024-05-09T00:11:26.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.620+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c28077430 con 0x7f6c280739a0 2024-05-09T00:11:26.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.622+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c2001a020 con 0x7f6c280739a0 2024-05-09T00:11:26.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.623+0000 7f6c1e000640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c080762d0 0x7f6c080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:26.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.624+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f6c20097150 con 0x7f6c280739a0 2024-05-09T00:11:26.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.624+0000 7f6c25e00640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c080762d0 0x7f6c080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:26.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.624+0000 7f6c25e00640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c080762d0 0x7f6c080787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.628+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c20060630 con 0x7f6c280739a0 2024-05-09T00:11:26.654 INFO:tasks.workunit.client.1.smithi153.stdout:checking for suffix of object files... o 2024-05-09T00:11:26.723 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether we are using the GNU C compiler... yes 2024-05-09T00:11:26.794 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether gcc accepts -g... yes 2024-05-09T00:11:26.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.847+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f128c077430 con 0x7f128c158e20 2024-05-09T00:11:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.848+0000 7f1282000640 1 -- 172.21.15.114:0/1239399027 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5666 (secure 0 0 0) 0x7f1284068020 con 0x7f128c158e20 2024-05-09T00:11:26.846 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:26.846 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:25.013821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 21 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1268076300 msgr2=0x7f1268078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1268076300 0x7f1268078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1274034000 tx=0x7f127402e000 comp rx=0 tx=0).stop 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 msgr2=0x7f128c14ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 0x7f128c14ca40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f128400c3f0 tx=0x7f128400c8b0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 shutdown_connections 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1268076300 0x7f1268078810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128c158e20 0x7f128c14ca40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f128c0c8a40 0x7f128c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 --2- 172.21.15.114:0/1239399027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f128c0af780 0x7f128c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 >> 172.21.15.114:0/1239399027 conn(0x7f128c068fd0 msgr2=0x7f128c075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 shutdown_connections 2024-05-09T00:11:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.851+0000 7f1290a00640 1 -- 172.21.15.114:0/1239399027 wait complete. 2024-05-09T00:11:26.872 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2024-05-09T00:11:26.872 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T00:11:26.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.876+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c280c41a0 con 0x7f6c280739a0 2024-05-09T00:11:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.877+0000 7f6c1e000640 1 -- 172.21.15.114:0/4020686301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5666 (secure 0 0 0) 0x7f6c2005ff30 con 0x7f6c280739a0 2024-05-09T00:11:26.878 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:26.878 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:25.013821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 21 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.879+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c080762d0 msgr2=0x7f6c080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.879+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c080762d0 0x7f6c080787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18009040 comp rx=0 tx=0).stop 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 msgr2=0x7f6c281e2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 0x7f6c281e2040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c20007cc0 tx=0x7f6c2000eb90 comp rx=0 tx=0).stop 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 shutdown_connections 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c080762d0 0x7f6c080787e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c280739a0 0x7f6c281e2040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c28073590 0x7f6c281e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 --2- 172.21.15.114:0/4020686301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c2814b360 0x7f6c281ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 >> 172.21.15.114:0/4020686301 conn(0x7f6c2806c680 msgr2=0x7f6c280c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 shutdown_connections 2024-05-09T00:11:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:26.880+0000 7f6c2d200640 1 -- 172.21.15.114:0/4020686301 wait complete. 2024-05-09T00:11:26.903 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-09T00:11:26.937 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-09T00:11:27.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.129+0000 7f3565600640 1 Processor -- start 2024-05-09T00:11:27.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.129+0000 7f3565600640 1 -- start start 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.131+0000 7f3565600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3560073510 0x7f356014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.131+0000 7f3565600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600ae880 0x7f35600aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.131+0000 7f3565600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35600ac210 con 0x7f35600af1d0 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.131+0000 7f3565600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3560073e20 con 0x7f3560073510 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.131+0000 7f3565600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35600abf30 con 0x7f35600ae880 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.131+0000 7f355fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3560073510 0x7f356014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3560073510 0x7f356014ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59998/0 (socket says 172.21.15.114:59998) 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355fe00640 1 -- 172.21.15.114:0/582174630 learned_addr learned my addr 172.21.15.114:0/582174630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f3564c00640 1 --1- 172.21.15.114:0/582174630 >> v1:172.21.15.114:6789/0 conn(0x7f35600af1d0 0x7f35600c3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59332/0 (socket says 172.21.15.114:59332) 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355f400640 1 --2- 172.21.15.114:0/582174630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600ae880 0x7f35600aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355fe00640 1 -- 172.21.15.114:0/582174630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600ae880 msgr2=0x7f35600aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355fe00640 1 --2- 172.21.15.114:0/582174630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600ae880 0x7f35600aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355fe00640 1 -- 172.21.15.114:0/582174630 >> v1:172.21.15.114:6789/0 conn(0x7f35600af1d0 legacy=0x7f35600c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:27.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355fe00640 1 -- 172.21.15.114:0/582174630 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3560155830 con 0x7f3560073510 2024-05-09T00:11:27.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.132+0000 7f355ea00640 1 -- 172.21.15.114:0/582174630 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477868562 0 0) 0x7f35600ac210 con 0x7f35600af1d0 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.133+0000 7f355fe00640 1 --2- 172.21.15.114:0/582174630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f356014ed80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3550009870 tx=0x7f355002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6f8e4fa214e3a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.133+0000 7f355ea00640 1 -- 172.21.15.114:0/582174630 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550037070 con 0x7f3560073510 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.133+0000 7f355ea00640 1 -- 172.21.15.114:0/582174630 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550032440 con 0x7f3560073510 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.133+0000 7f355ea00640 1 -- 172.21.15.114:0/582174630 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550032810 con 0x7f3560073510 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 -- 172.21.15.114:0/582174630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 msgr2=0x7f356014ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 --2- 172.21.15.114:0/582174630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f356014ed80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3550009870 tx=0x7f355002a130 comp rx=0 tx=0).stop 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 -- 172.21.15.114:0/582174630 shutdown_connections 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 --2- 172.21.15.114:0/582174630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600ae880 0x7f35600aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 --2- 172.21.15.114:0/582174630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f356014ed80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 -- 172.21.15.114:0/582174630 >> 172.21.15.114:0/582174630 conn(0x7f35600c9730 msgr2=0x7f35600c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 -- 172.21.15.114:0/582174630 shutdown_connections 2024-05-09T00:11:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.134+0000 7f3565600640 1 -- 172.21.15.114:0/582174630 wait complete. 2024-05-09T00:11:27.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.136+0000 7f3565600640 1 Processor -- start 2024-05-09T00:11:27.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.137+0000 7f3565600640 1 -- start start 2024-05-09T00:11:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f3565600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f35600c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f3565600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35600ae880 0x7f35601566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f3565600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600af1d0 0x7f356014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f3565600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f35600c4420 con 0x7f3560073510 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f3565600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3560074070 con 0x7f35600ae880 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f3565600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35600c45a0 con 0x7f35600af1d0 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f355fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f35600c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f355fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f35600c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60012/0 (socket says 172.21.15.114:60012) 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f355fe00640 1 -- 172.21.15.114:0/111787417 learned_addr learned my addr 172.21.15.114:0/111787417 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.138+0000 7f355f400640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35600ae880 0x7f35601566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f3564c00640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600af1d0 0x7f356014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f355fe00640 1 -- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600af1d0 msgr2=0x7f356014dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f355fe00640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600af1d0 0x7f356014dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f355fe00640 1 -- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35600ae880 msgr2=0x7f35601566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f355fe00640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35600ae880 0x7f35601566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f355fe00640 1 -- 172.21.15.114:0/111787417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3560157960 con 0x7f3560073510 2024-05-09T00:11:27.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f355fe00640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f35600c8260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3550009870 tx=0x7f35500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:27.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550041020 con 0x7f3560073510 2024-05-09T00:11:27.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35500306c0 con 0x7f3560073510 2024-05-09T00:11:27.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3560159170 con 0x7f3560073510 2024-05-09T00:11:27.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550037040 con 0x7f3560073510 2024-05-09T00:11:27.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.139+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3560158e90 con 0x7f3560073510 2024-05-09T00:11:27.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.140+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3560078430 con 0x7f3560073510 2024-05-09T00:11:27.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.142+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3550044020 con 0x7f3560073510 2024-05-09T00:11:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.142+0000 7f3557e00640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f35400762d0 0x7f35400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.143+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f35500b8390 con 0x7f3560073510 2024-05-09T00:11:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.143+0000 7f355f400640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f35400762d0 0x7f35400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.143+0000 7f355f400640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f35400762d0 0x7f35400787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35600aeed0 tx=0x7f354c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:27.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.147+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f355004b030 con 0x7f3560073510 2024-05-09T00:11:27.222 INFO:tasks.workunit.client.1.smithi153.stdout:checking dependency style of gcc... gcc3 2024-05-09T00:11:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.384+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35600c4ce0 con 0x7f3560073510 2024-05-09T00:11:27.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.386+0000 7f3557e00640 1 -- 172.21.15.114:0/111787417 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5663 (secure 0 0 0) 0x7f3550081750 con 0x7f3560073510 2024-05-09T00:11:27.384 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:27.384 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:25.997852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:27.384 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2024-05-09T00:11:27.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.388+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f35400762d0 msgr2=0x7f35400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:27.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.388+0000 7f3565600640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f35400762d0 0x7f35400787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35600aeed0 tx=0x7f354c008040 comp rx=0 tx=0).stop 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 msgr2=0x7f35600c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f35600c8260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3550009870 tx=0x7f35500046c0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 shutdown_connections 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f35400762d0 0x7f35400787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35600af1d0 0x7f356014dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35600ae880 0x7f35601566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 --2- 172.21.15.114:0/111787417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3560073510 0x7f35600c8260 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 >> 172.21.15.114:0/111787417 conn(0x7f35600c9730 msgr2=0x7f356006f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 shutdown_connections 2024-05-09T00:11:27.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:27.389+0000 7f3565600640 1 -- 172.21.15.114:0/111787417 wait complete. 2024-05-09T00:11:27.389 INFO:tasks.workunit.client.1.smithi153.stdout:checking how to run the C preprocessor... gcc -E 2024-05-09T00:11:27.410 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4523": { "addr": "172.21.15.153:6835/1585617173", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6834", "nonce": 1585617173, "type": "v2" }, { "addr": "172.21.15.153:6835", "nonce": 1585617173, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4523, "incarnation": 20, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:11:25.997852+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4523 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4235": { "addr": "172.21.15.153:6833/690310809", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 690310809, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 690310809, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 16, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 43 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:11:17.910761+0000", "qdb_cluster": [ 4235 ], "qdb_leader": 4235, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4235 } } } ], "standbys": [ { "addr": "172.21.15.114:6837/2960717153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2960717153, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2960717153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4226, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:11:27.524 INFO:tasks.workunit.client.1.smithi153.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-09T00:11:27.530 INFO:tasks.workunit.client.1.smithi153.stdout:checking for egrep... /usr/bin/grep -E 2024-05-09T00:11:27.562 INFO:tasks.workunit.client.1.smithi153.stdout:checking for AIX... no 2024-05-09T00:11:27.595 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc... (cached) gcc 2024-05-09T00:11:27.629 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-09T00:11:27.632 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-09T00:11:27.633 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-09T00:11:27.634 INFO:tasks.workunit.client.1.smithi153.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-09T00:11:27.760 INFO:tasks.workunit.client.1.smithi153.stdout:checking for main in -lm... yes 2024-05-09T00:11:27.878 INFO:tasks.workunit.client.1.smithi153.stdout:checking for main in -lpthread... yes 2024-05-09T00:11:28.165 INFO:tasks.workunit.client.0.smithi114.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-05-09T00:11:28.168 INFO:tasks.workunit.client.0.smithi114.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-05-09T00:11:28.168 INFO:tasks.workunit.client.0.smithi114.stderr:+ trap -- retry EXIT 2024-05-09T00:11:28.168 INFO:tasks.workunit.client.0.smithi114.stderr:+ rm -rf ffsb 2024-05-09T00:11:28.172 INFO:tasks.workunit.client.0.smithi114.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-05-09T00:11:28.181 INFO:tasks.workunit.client.0.smithi114.stderr:Cloning into 'ffsb'... 2024-05-09T00:11:28.244 INFO:tasks.workunit.client.1.smithi153.stdout:checking for ANSI C header files... yes 2024-05-09T00:11:28.380 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-09T00:11:28.493 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/types.h... yes 2024-05-09T00:11:28.633 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/stat.h... yes 2024-05-09T00:11:28.773 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stdlib.h... yes 2024-05-09T00:11:28.882 INFO:tasks.workunit.client.1.smithi153.stdout:checking for string.h... yes 2024-05-09T00:11:28.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:29.000 INFO:tasks.workunit.client.1.smithi153.stdout:checking for memory.h... yes 2024-05-09T00:11:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.170+0000 7fa821600640 1 Processor -- start 2024-05-09T00:11:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.170+0000 7fa821600640 1 -- start start 2024-05-09T00:11:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.172+0000 7fa821600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa81c0ca3b0 0x7fa81c1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.172+0000 7fa821600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa81c072290 con 0x7fa81c072830 2024-05-09T00:11:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.172+0000 7fa821600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa81c0b1210 con 0x7fa81c0c92f0 2024-05-09T00:11:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.172+0000 7fa821600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa81c153b20 con 0x7fa81c0ca3b0 2024-05-09T00:11:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa81c072830 0x7fa81c0c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33354/0 (socket says 172.21.15.114:33354) 2024-05-09T00:11:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81b400640 1 -- 172.21.15.114:0/1498284282 learned_addr learned my addr 172.21.15.114:0/1498284282 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622829718 0 0) 0x7fa81c072290 con 0x7fa81c072830 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa800003520 con 0x7fa81c072830 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1320781659 0 0) 0x7fa800003520 con 0x7fa81c072830 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 >> v2:172.21.15.153:3300/0 conn(0x7fa81c0ca3b0 msgr2=0x7fa81c1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 --2- 172.21.15.114:0/1498284282 >> v2:172.21.15.153:3300/0 conn(0x7fa81c0ca3b0 0x7fa81c1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 >> v1:172.21.15.153:6789/0 conn(0x7fa81c0c92f0 legacy=0x7fa81c159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c0b14f0 con 0x7fa81c072830 2024-05-09T00:11:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.173+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fa808001710 con 0x7fa81c072830 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 >> v1:172.21.15.114:6789/0 conn(0x7fa81c072830 legacy=0x7fa81c0c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa800003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa800004800 0x7fa800004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8000099b0 0x7fa80000bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c153b20 con 0x7fa800003a00 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa80000c440 con 0x7fa8000099b0 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa80000c640 con 0x7fa800004800 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81be00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa800003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81be00640 1 -- 172.21.15.114:0/1498284282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa800004800 msgr2=0x7fa800004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81be00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa800004800 0x7fa800004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81be00640 1 -- 172.21.15.114:0/1498284282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8000099b0 msgr2=0x7fa80000bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81be00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8000099b0 0x7fa80000bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa81be00640 1 -- 172.21.15.114:0/1498284282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa800003520 con 0x7fa800003a00 2024-05-09T00:11:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.174+0000 7fa820c00640 1 -- 172.21.15.114:0/1498284282 reap_dead start 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.175+0000 7fa81be00640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa800003e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa80c001640 tx=0x7fa800005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473c554bf717dba3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.176+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c001240 con 0x7fa800003a00 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.176+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c02e070 con 0x7fa800003a00 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.176+0000 7fa81aa00640 1 -- 172.21.15.114:0/1498284282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c02a7c0 con 0x7fa800003a00 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.176+0000 7fa821600640 1 -- 172.21.15.114:0/1498284282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 msgr2=0x7fa800003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.176+0000 7fa821600640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa800003e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa80c001640 tx=0x7fa800005830 comp rx=0 tx=0).stop 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.177+0000 7fa821600640 1 -- 172.21.15.114:0/1498284282 shutdown_connections 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.177+0000 7fa821600640 1 --2- 172.21.15.114:0/1498284282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa800003e50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.177+0000 7fa821600640 1 -- 172.21.15.114:0/1498284282 >> 172.21.15.114:0/1498284282 conn(0x7fa81c0cb3f0 msgr2=0x7fa81c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.177+0000 7fa821600640 1 -- 172.21.15.114:0/1498284282 shutdown_connections 2024-05-09T00:11:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.177+0000 7fa821600640 1 -- 172.21.15.114:0/1498284282 wait complete. 2024-05-09T00:11:29.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.179+0000 7fa821600640 1 Processor -- start 2024-05-09T00:11:29.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.179+0000 7fa821600640 1 -- start start 2024-05-09T00:11:29.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.180+0000 7fa821600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa81c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.180+0000 7fa821600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa81c14b9e0 0x7fa81c1ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.180+0000 7fa821600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa81c155830 0x7fa81c0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa821600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c15a3e0 con 0x7fa800003a00 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa821600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c071e00 con 0x7fa81c14b9e0 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa821600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa81c0c5ed0 con 0x7fa81c155830 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa81c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa81c154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35706/0 (socket says 172.21.15.114:35706) 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 -- 172.21.15.114:0/688213064 learned_addr learned my addr 172.21.15.114:0/688213064 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81b400640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa81c14b9e0 0x7fa81c1ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 -- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa81c155830 msgr2=0x7fa81c0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa820c00640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa81c155830 0x7fa81c0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa81c155830 0x7fa81c0ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 -- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa81c14b9e0 msgr2=0x7fa81c1ef3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa81c14b9e0 0x7fa81c1ef3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.181+0000 7fa81be00640 1 -- 172.21.15.114:0/688213064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c1eff00 con 0x7fa800003a00 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.182+0000 7fa81be00640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa81c154360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa80c001730 tx=0x7fa80c000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.182+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c043070 con 0x7fa800003a00 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.182+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c003610 con 0x7fa800003a00 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.182+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c156570 con 0x7fa800003a00 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.182+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c007a50 con 0x7fa800003a00 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.182+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c155d50 con 0x7fa800003a00 2024-05-09T00:11:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.183+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81c155fb0 con 0x7fa800003a00 2024-05-09T00:11:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.185+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa80c033470 con 0x7fa800003a00 2024-05-09T00:11:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.185+0000 7fa813e00640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7fc0762d0 0x7fa7fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.186+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7fa80c0b6e50 con 0x7fa800003a00 2024-05-09T00:11:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.186+0000 7fa81b400640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7fc0762d0 0x7fa7fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.186+0000 7fa81b400640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7fc0762d0 0x7fa7fc0787e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa808000f60 tx=0x7fa808009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.190+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa80c0802a0 con 0x7fa800003a00 2024-05-09T00:11:29.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.437+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa81c078430 con 0x7fa800003a00 2024-05-09T00:11:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.439+0000 7fa813e00640 1 -- 172.21.15.114:0/688213064 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5670 (secure 0 0 0) 0x7fa80c088290 con 0x7fa800003a00 2024-05-09T00:11:29.436 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:29.437 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7fc0762d0 msgr2=0x7fa7fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7fc0762d0 0x7fa7fc0787e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa808000f60 tx=0x7fa808009040 comp rx=0 tx=0).stop 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 msgr2=0x7fa81c154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa81c154360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa80c001730 tx=0x7fa80c000fb0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 shutdown_connections 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7fc0762d0 0x7fa7fc0787e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa81c155830 0x7fa81c0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa81c14b9e0 0x7fa81c1ef3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 --2- 172.21.15.114:0/688213064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa800003a00 0x7fa81c154360 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 >> 172.21.15.114:0/688213064 conn(0x7fa81c0cb3f0 msgr2=0x7fa81c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 shutdown_connections 2024-05-09T00:11:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.441+0000 7fa821600640 1 -- 172.21.15.114:0/688213064 wait complete. 2024-05-09T00:11:29.465 INFO:tasks.mds_thrash.fs.[b]:mds.d reported in up:active state 2024-05-09T00:11:29.465 INFO:tasks.mds_thrash.fs.[b]:waiting for 108 secs before thrashing 2024-05-09T00:11:29.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.666+0000 7f4a8bc00640 1 Processor -- start 2024-05-09T00:11:29.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.666+0000 7f4a8bc00640 1 -- start start 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a8bc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4a840c62a0 0x7f4a8406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a8bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a840c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a8bc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8406d910 con 0x7f4a8415fc50 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a8bc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8406dc60 con 0x7f4a840c62a0 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a8bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8415d420 con 0x7f4a840723b0 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a89200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4a840c62a0 0x7f4a8406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a89200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4a840c62a0 0x7f4a8406f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35720/0 (socket says 172.21.15.114:35720) 2024-05-09T00:11:29.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.668+0000 7f4a89200640 1 -- 172.21.15.114:0/4157722375 learned_addr learned my addr 172.21.15.114:0/4157722375 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:29.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.669+0000 7f4a83e00640 1 --2- 172.21.15.114:0/4157722375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a840c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.669+0000 7f4a89200640 1 -- 172.21.15.114:0/4157722375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 msgr2=0x7f4a840c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:29.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.669+0000 7f4a89200640 1 --2- 172.21.15.114:0/4157722375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a840c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.669+0000 7f4a89200640 1 -- 172.21.15.114:0/4157722375 >> v1:172.21.15.153:6789/0 conn(0x7f4a8415fc50 legacy=0x7f4a840aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:29.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.669+0000 7f4a89200640 1 -- 172.21.15.114:0/4157722375 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a840cb400 con 0x7f4a840c62a0 2024-05-09T00:11:29.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.670+0000 7f4a89200640 1 --2- 172.21.15.114:0/4157722375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a8406f290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009870 tx=0x7f4a7402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dff6126da9f788 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.670+0000 7f4a83400640 1 -- 172.21.15.114:0/4157722375 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74037070 con 0x7f4a840c62a0 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.670+0000 7f4a83400640 1 -- 172.21.15.114:0/4157722375 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a74032440 con 0x7f4a840c62a0 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.670+0000 7f4a83400640 1 -- 172.21.15.114:0/4157722375 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74032810 con 0x7f4a840c62a0 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 -- 172.21.15.114:0/4157722375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 msgr2=0x7f4a8406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/4157722375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a8406f290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009870 tx=0x7f4a7402a130 comp rx=0 tx=0).stop 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 -- 172.21.15.114:0/4157722375 shutdown_connections 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/4157722375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a840c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/4157722375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a8406f290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 -- 172.21.15.114:0/4157722375 >> 172.21.15.114:0/4157722375 conn(0x7f4a840cb6e0 msgr2=0x7f4a840cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 -- 172.21.15.114:0/4157722375 shutdown_connections 2024-05-09T00:11:29.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.671+0000 7f4a8bc00640 1 -- 172.21.15.114:0/4157722375 wait complete. 2024-05-09T00:11:29.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.673+0000 7f4a8bc00640 1 Processor -- start 2024-05-09T00:11:29.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.673+0000 7f4a8bc00640 1 -- start start 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a8bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a84159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a8bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a841576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a8bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a8415fc50 0x7f4a841e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a8bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8415d1e0 con 0x7f4a840c62a0 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a8bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8415d060 con 0x7f4a8415fc50 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a8bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4a840aaf10 con 0x7f4a840723b0 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a841576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a841576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35734/0 (socket says 172.21.15.114:35734) 2024-05-09T00:11:29.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a83e00640 1 -- 172.21.15.114:0/1534444046 learned_addr learned my addr 172.21.15.114:0/1534444046 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a89200640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a84159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a83e00640 1 -- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 msgr2=0x7f4a84159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a83e00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a84159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a83e00640 1 -- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a8415fc50 msgr2=0x7f4a841e9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.675+0000 7f4a89c00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a8415fc50 0x7f4a841e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a83e00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a8415fc50 0x7f4a841e9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a83e00640 1 -- 172.21.15.114:0/1534444046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a841f3170 con 0x7f4a840c62a0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a89200640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a84159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a83e00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a841576a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d620 tx=0x7f4a6c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00b620 con 0x7f4a840c62a0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c019070 con 0x7f4a840c62a0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a841f33f0 con 0x7f4a840c62a0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00ba00 con 0x7f4a840c62a0 2024-05-09T00:11:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.676+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a84159f60 con 0x7f4a840c62a0 2024-05-09T00:11:29.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.677+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8415a7d0 con 0x7f4a840c62a0 2024-05-09T00:11:29.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.679+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a6c00bba0 con 0x7f4a840c62a0 2024-05-09T00:11:29.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.681+0000 7f4a80c00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4a600762d0 0x7f4a600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:29.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.681+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f4a6c097f60 con 0x7f4a840c62a0 2024-05-09T00:11:29.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.681+0000 7f4a89200640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4a600762d0 0x7f4a600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.682+0000 7f4a89200640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4a600762d0 0x7f4a600787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4a74034000 tx=0x7f4a7402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.688+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a8415a7d0 con 0x7f4a840c62a0 2024-05-09T00:11:29.890 INFO:tasks.ceph.mds.d.smithi153.stderr:2024-05-09T00:11:29.893+0000 7f2d75c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:11:29.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.924+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a84077430 con 0x7f4a840c62a0 2024-05-09T00:11:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.924+0000 7f4a80c00640 1 -- 172.21.15.114:0/1534444046 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5670 (secure 0 0 0) 0x7f4a841f3170 con 0x7f4a840c62a0 2024-05-09T00:11:29.922 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:29.922 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:29.923 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4a600762d0 msgr2=0x7f4a600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4a600762d0 0x7f4a600787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4a74034000 tx=0x7f4a7402e000 comp rx=0 tx=0).stop 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 msgr2=0x7f4a841576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a841576a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d620 tx=0x7f4a6c00dae0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 shutdown_connections 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4a600762d0 0x7f4a600787e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a8415fc50 0x7f4a841e9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a840c62a0 0x7f4a841576a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 --2- 172.21.15.114:0/1534444046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4a840723b0 0x7f4a84159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 >> 172.21.15.114:0/1534444046 conn(0x7f4a840cb6e0 msgr2=0x7f4a841e5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 shutdown_connections 2024-05-09T00:11:29.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:29.927+0000 7f4a8bc00640 1 -- 172.21.15.114:0/1534444046 wait complete. 2024-05-09T00:11:29.951 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=4267 2024-05-09T00:11:29.951 INFO:tasks.mds_thrash.fs.[a]:waiting for 6 secs before reviving mds.c 2024-05-09T00:11:30.045 INFO:tasks.workunit.client.1.smithi153.stdout:checking for strings.h... yes 2024-05-09T00:11:30.144 INFO:tasks.workunit.client.1.smithi153.stdout:checking for inttypes.h... yes 2024-05-09T00:11:30.244 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stdint.h... yes 2024-05-09T00:11:30.365 INFO:tasks.workunit.client.1.smithi153.stdout:checking for unistd.h... yes 2024-05-09T00:11:30.498 INFO:tasks.workunit.client.1.smithi153.stdout:checking pthread.h usability... yes 2024-05-09T00:11:30.569 INFO:tasks.workunit.client.1.smithi153.stdout:checking pthread.h presence... yes 2024-05-09T00:11:30.571 INFO:tasks.workunit.client.1.smithi153.stdout:checking for pthread.h... yes 2024-05-09T00:11:30.690 INFO:tasks.workunit.client.1.smithi153.stdout:checking fcntl.h usability... yes 2024-05-09T00:11:30.749 INFO:tasks.workunit.client.1.smithi153.stdout:checking fcntl.h presence... yes 2024-05-09T00:11:30.751 INFO:tasks.workunit.client.1.smithi153.stdout:checking for fcntl.h... yes 2024-05-09T00:11:30.865 INFO:tasks.workunit.client.1.smithi153.stdout:checking limits.h usability... yes 2024-05-09T00:11:30.921 INFO:tasks.workunit.client.1.smithi153.stdout:checking limits.h presence... yes 2024-05-09T00:11:30.923 INFO:tasks.workunit.client.1.smithi153.stdout:checking for limits.h... yes 2024-05-09T00:11:30.960 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stdint.h... (cached) yes 2024-05-09T00:11:31.069 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/time.h usability... yes 2024-05-09T00:11:31.131 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/time.h presence... yes 2024-05-09T00:11:31.132 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/time.h... yes 2024-05-09T00:11:31.169 INFO:tasks.workunit.client.1.smithi153.stdout:checking for unistd.h... (cached) yes 2024-05-09T00:11:31.271 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/vfs.h usability... yes 2024-05-09T00:11:31.332 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/vfs.h presence... yes 2024-05-09T00:11:31.334 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/vfs.h... yes 2024-05-09T00:11:31.444 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/limits.h usability... no 2024-05-09T00:11:31.494 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/limits.h presence... no 2024-05-09T00:11:31.495 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/limits.h... no 2024-05-09T00:11:31.565 INFO:tasks.workunit.client.1.smithi153.stdout:checking for an ANSI C-conforming const... yes 2024-05-09T00:11:31.646 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-09T00:11:31.648 INFO:tasks.workunit.client.1.smithi153.stdout:checking for function prototypes... yes 2024-05-09T00:11:31.703 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether setvbuf arguments are reversed... no 2024-05-09T00:11:31.824 INFO:tasks.workunit.client.1.smithi153.stdout:checking for system... yes 2024-05-09T00:11:31.960 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gettimeofday... yes 2024-05-09T00:11:32.099 INFO:tasks.workunit.client.1.smithi153.stdout:checking for mkdir... yes 2024-05-09T00:11:32.244 INFO:tasks.workunit.client.1.smithi153.stdout:checking for strerror... yes 2024-05-09T00:11:32.556 INFO:tasks.workunit.client.0.smithi114.stderr:+ trap - EXIT 2024-05-09T00:11:32.556 INFO:tasks.workunit.client.0.smithi114.stderr:+ cd ffsb 2024-05-09T00:11:32.556 INFO:tasks.workunit.client.0.smithi114.stderr:+ ./configure 2024-05-09T00:11:32.650 INFO:tasks.workunit.client.1.smithi153.stdout:checking for open64... yes 2024-05-09T00:11:32.797 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stat64... yes 2024-05-09T00:11:32.942 INFO:tasks.workunit.client.1.smithi153.stdout:checking for fseeko64... yes 2024-05-09T00:11:32.991 INFO:tasks.workunit.client.0.smithi114.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-09T00:11:33.089 INFO:tasks.workunit.client.1.smithi153.stdout:checking for lrand48_r... yes 2024-05-09T00:11:34.004 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether build environment is sane... yes 2024-05-09T00:11:34.023 INFO:tasks.workunit.client.0.smithi114.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-09T00:11:34.023 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gawk... gawk 2024-05-09T00:11:34.047 INFO:tasks.workunit.client.1.smithi153.stdout:checking for srand48_r... yes 2024-05-09T00:11:34.100 INFO:tasks.workunit.client.1.smithi153.stdout:configure: creating ./config.status 2024-05-09T00:11:34.202 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether make sets $(MAKE)... yes 2024-05-09T00:11:34.299 INFO:tasks.workunit.client.0.smithi114.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:34.300 INFO:tasks.workunit.client.0.smithi114.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:34.329 INFO:tasks.workunit.client.0.smithi114.stdout:checking for style of include used by make... GNU 2024-05-09T00:11:34.339 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc... gcc 2024-05-09T00:11:34.351 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: creating Makefile 2024-05-09T00:11:34.388 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: creating config.h 2024-05-09T00:11:34.432 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: executing depfiles commands 2024-05-09T00:11:34.477 INFO:tasks.workunit.client.0.smithi114.stdout:checking for C compiler default output file name... a.out 2024-05-09T00:11:34.484 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether the C compiler works... yes 2024-05-09T00:11:34.491 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are cross compiling... no 2024-05-09T00:11:34.564 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: executing default commands 2024-05-09T00:11:34.571 INFO:tasks.workunit.client.0.smithi114.stdout:checking for suffix of executables... 2024-05-09T00:11:34.663 INFO:tasks.workunit.client.0.smithi114.stdout:checking for suffix of object files... o 2024-05-09T00:11:34.758 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are using the GNU C compiler... yes 2024-05-09T00:11:34.848 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc accepts -g... yes 2024-05-09T00:11:34.923 INFO:tasks.workunit.client.1.smithi153.stderr:+ make 2024-05-09T00:11:34.934 INFO:tasks.workunit.client.1.smithi153.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-05-09T00:11:34.944 INFO:tasks.workunit.client.1.smithi153.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-05-09T00:11:34.948 INFO:tasks.workunit.client.1.smithi153.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-05-09T00:11:34.948 INFO:tasks.workunit.client.1.smithi153.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-05-09T00:11:34.948 INFO:tasks.workunit.client.1.smithi153.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-05-09T00:11:34.948 INFO:tasks.workunit.client.1.smithi153.stderr: any GNU archive site. 2024-05-09T00:11:34.957 INFO:tasks.workunit.client.1.smithi153.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-05-09T00:11:34.961 INFO:tasks.workunit.client.1.smithi153.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-05-09T00:11:34.962 INFO:tasks.workunit.client.1.smithi153.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-05-09T00:11:34.962 INFO:tasks.workunit.client.1.smithi153.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-05-09T00:11:34.962 INFO:tasks.workunit.client.1.smithi153.stderr: You might want to install the `Automake' and `Perl' packages. 2024-05-09T00:11:34.963 INFO:tasks.workunit.client.1.smithi153.stderr: Grab them from any GNU archive site. 2024-05-09T00:11:35.007 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-09T00:11:35.336 INFO:tasks.workunit.client.0.smithi114.stdout:checking dependency style of gcc... gcc3 2024-05-09T00:11:35.379 INFO:tasks.workunit.client.1.smithi153.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-05-09T00:11:35.526 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to run the C preprocessor... gcc -E 2024-05-09T00:11:35.695 INFO:tasks.workunit.client.0.smithi114.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-09T00:11:35.701 INFO:tasks.workunit.client.0.smithi114.stdout:checking for egrep... /usr/bin/grep -E 2024-05-09T00:11:35.736 INFO:tasks.workunit.client.0.smithi114.stdout:checking for AIX... no 2024-05-09T00:11:35.792 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc... (cached) gcc 2024-05-09T00:11:35.827 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-09T00:11:35.830 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-09T00:11:35.831 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-09T00:11:35.832 INFO:tasks.workunit.client.0.smithi114.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-09T00:11:35.852 INFO:tasks.workunit.client.1.smithi153.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-09T00:11:35.853 INFO:tasks.workunit.client.1.smithi153.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-09T00:11:35.853 INFO:tasks.workunit.client.1.smithi153.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-09T00:11:35.853 INFO:tasks.workunit.client.1.smithi153.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-09T00:11:35.952 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2024-05-09T00:11:35.952 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T00:11:35.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T00:11:35.957 INFO:tasks.ceph.mds.c:Started 2024-05-09T00:11:35.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:35.986 INFO:tasks.workunit.client.0.smithi114.stdout:checking for main in -lm... yes 2024-05-09T00:11:36.084 INFO:tasks.workunit.client.1.smithi153.stdout:/bin/sh ./config.status --recheck 2024-05-09T00:11:36.098 INFO:tasks.workunit.client.0.smithi114.stdout:checking for main in -lpthread... yes 2024-05-09T00:11:36.185 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-05-09T00:11:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.213+0000 7fb124600640 1 Processor -- start 2024-05-09T00:11:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.213+0000 7fb124600640 1 -- start start 2024-05-09T00:11:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb124600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb11c0c43c0 0x7fb11c153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb124600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb11c0ae940 0x7fb11c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb124600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb11c156bb0 con 0x7fb11c159830 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb124600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb11c0ac710 con 0x7fb11c0c43c0 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb124600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb11c156e90 con 0x7fb11c0ae940 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb121c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb11c0c43c0 0x7fb11c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb121200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb11c159830 0x7fb11c159c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33368/0 (socket says 172.21.15.114:33368) 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb121200640 1 -- 172.21.15.114:0/1589417243 learned_addr learned my addr 172.21.15.114:0/1589417243 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.215+0000 7fb122600640 1 --2- 172.21.15.114:0/1589417243 >> v2:172.21.15.153:3300/0 conn(0x7fb11c0ae940 0x7fb11c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.216+0000 7fb11be00640 1 -- 172.21.15.114:0/1589417243 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102478866 0 0) 0x7fb11c156bb0 con 0x7fb11c159830 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.216+0000 7fb11be00640 1 -- 172.21.15.114:0/1589417243 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb104003520 con 0x7fb11c159830 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.216+0000 7fb121c00640 1 -- 172.21.15.114:0/1589417243 >> v2:172.21.15.153:3300/0 conn(0x7fb11c0ae940 msgr2=0x7fb11c0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.216+0000 7fb121c00640 1 --2- 172.21.15.114:0/1589417243 >> v2:172.21.15.153:3300/0 conn(0x7fb11c0ae940 0x7fb11c0aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.216+0000 7fb121c00640 1 -- 172.21.15.114:0/1589417243 >> v1:172.21.15.114:6789/0 conn(0x7fb11c159830 legacy=0x7fb11c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:36.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.216+0000 7fb121c00640 1 -- 172.21.15.114:0/1589417243 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11c0ac960 con 0x7fb11c0c43c0 2024-05-09T00:11:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.217+0000 7fb121c00640 1 --2- 172.21.15.114:0/1589417243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0c43c0 0x7fb11c153760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb11c15a770 tx=0x7fb11002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7ed42f194071bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.217+0000 7fb11be00640 1 -- 172.21.15.114:0/1589417243 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110037070 con 0x7fb11c0c43c0 2024-05-09T00:11:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.217+0000 7fb11be00640 1 -- 172.21.15.114:0/1589417243 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb110032440 con 0x7fb11c0c43c0 2024-05-09T00:11:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.217+0000 7fb11be00640 1 -- 172.21.15.114:0/1589417243 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11002ae60 con 0x7fb11c0c43c0 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 -- 172.21.15.114:0/1589417243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0c43c0 msgr2=0x7fb11c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 --2- 172.21.15.114:0/1589417243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0c43c0 0x7fb11c153760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb11c15a770 tx=0x7fb11002a110 comp rx=0 tx=0).stop 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 -- 172.21.15.114:0/1589417243 shutdown_connections 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 --2- 172.21.15.114:0/1589417243 >> v2:172.21.15.153:3300/0 conn(0x7fb11c0ae940 0x7fb11c0aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 --2- 172.21.15.114:0/1589417243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0c43c0 0x7fb11c153760 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 -- 172.21.15.114:0/1589417243 >> 172.21.15.114:0/1589417243 conn(0x7fb11c06c680 msgr2=0x7fb11c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 -- 172.21.15.114:0/1589417243 shutdown_connections 2024-05-09T00:11:36.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.218+0000 7fb124600640 1 -- 172.21.15.114:0/1589417243 wait complete. 2024-05-09T00:11:36.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.221+0000 7fb124600640 1 Processor -- start 2024-05-09T00:11:36.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.221+0000 7fb124600640 1 -- start start 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.222+0000 7fb124600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb11c0ae940 0x7fb11c1e1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.222+0000 7fb124600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb11c0c43c0 0x7fb11c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.222+0000 7fb124600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 0x7fb11c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.222+0000 7fb124600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c15a350 con 0x7fb11c159830 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.222+0000 7fb124600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0ad3c0 con 0x7fb11c0c43c0 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.222+0000 7fb124600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb11c15a4d0 con 0x7fb11c0ae940 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 0x7fb11c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 0x7fb11c14b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35772/0 (socket says 172.21.15.114:35772) 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 -- 172.21.15.114:0/903837021 learned_addr learned my addr 172.21.15.114:0/903837021 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb121200640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb11c0c43c0 0x7fb11c1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb121c00640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb11c0ae940 0x7fb11c1e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 -- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb11c0ae940 msgr2=0x7fb11c1e1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb11c0ae940 0x7fb11c1e1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 -- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb11c0c43c0 msgr2=0x7fb11c1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb11c0c43c0 0x7fb11c1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 -- 172.21.15.114:0/903837021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11c1e1a70 con 0x7fb11c159830 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb121c00640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb11c0ae940 0x7fb11c1e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.223+0000 7fb122600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 0x7fb11c14b850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb114009d30 tx=0x7fb11400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.224+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114018020 con 0x7fb11c159830 2024-05-09T00:11:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.224+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb114014480 con 0x7fb11c159830 2024-05-09T00:11:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.224+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11c153e00 con 0x7fb11c159830 2024-05-09T00:11:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.224+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114014870 con 0x7fb11c159830 2024-05-09T00:11:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.224+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11c1543a0 con 0x7fb11c159830 2024-05-09T00:11:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.226+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb11c077430 con 0x7fb11c159830 2024-05-09T00:11:36.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.227+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb114005d10 con 0x7fb11c159830 2024-05-09T00:11:36.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.228+0000 7fb119600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0fc0762d0 0x7fb0fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:36.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.228+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7fb1140986c0 con 0x7fb11c159830 2024-05-09T00:11:36.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.228+0000 7fb121c00640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0fc0762d0 0x7fb0fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:36.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.229+0000 7fb121c00640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0fc0762d0 0x7fb0fc0787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb110034000 tx=0x7fb11002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:36.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.233+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb114022030 con 0x7fb11c159830 2024-05-09T00:11:36.243 INFO:tasks.workunit.client.1.smithi153.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-05-09T00:11:36.398 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ANSI C header files... yes 2024-05-09T00:11:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.481+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb11c154570 con 0x7fb11c159830 2024-05-09T00:11:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.482+0000 7fb119600640 1 -- 172.21.15.114:0/903837021 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5670 (secure 0 0 0) 0x7fb114010040 con 0x7fb11c159830 2024-05-09T00:11:36.480 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:36.480 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2024-05-09T00:11:36.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0fc0762d0 msgr2=0x7fb0fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0fc0762d0 0x7fb0fc0787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb110034000 tx=0x7fb11002e000 comp rx=0 tx=0).stop 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 msgr2=0x7fb11c14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 0x7fb11c14b850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb114009d30 tx=0x7fb11400c490 comp rx=0 tx=0).stop 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 shutdown_connections 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0fc0762d0 0x7fb0fc0787e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c159830 0x7fb11c14b850 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb11c0c43c0 0x7fb11c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 --2- 172.21.15.114:0/903837021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb11c0ae940 0x7fb11c1e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 >> 172.21.15.114:0/903837021 conn(0x7fb11c06c680 msgr2=0x7fb11c0af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 shutdown_connections 2024-05-09T00:11:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:36.486+0000 7fb124600640 1 -- 172.21.15.114:0/903837021 wait complete. 2024-05-09T00:11:36.514 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-09T00:11:36.516 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-05-09T00:11:36.535 INFO:tasks.workunit.client.1.smithi153.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-09T00:11:36.642 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/types.h... yes 2024-05-09T00:11:36.781 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/stat.h... yes 2024-05-09T00:11:36.923 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdlib.h... yes 2024-05-09T00:11:37.065 INFO:tasks.workunit.client.0.smithi114.stdout:checking for string.h... yes 2024-05-09T00:11:37.207 INFO:tasks.workunit.client.0.smithi114.stdout:checking for memory.h... yes 2024-05-09T00:11:37.350 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strings.h... yes 2024-05-09T00:11:37.488 INFO:tasks.workunit.client.0.smithi114.stdout:checking for inttypes.h... yes 2024-05-09T00:11:37.555 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether build environment is sane... yes 2024-05-09T00:11:37.570 INFO:tasks.workunit.client.1.smithi153.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-09T00:11:37.570 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gawk... gawk 2024-05-09T00:11:37.601 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether make sets $(MAKE)... yes 2024-05-09T00:11:37.691 INFO:tasks.workunit.client.1.smithi153.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:37.691 INFO:tasks.workunit.client.1.smithi153.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:37.711 INFO:tasks.workunit.client.1.smithi153.stdout:checking for style of include used by make... GNU 2024-05-09T00:11:37.717 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc... gcc 2024-05-09T00:11:37.918 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether the C compiler works... yes 2024-05-09T00:11:37.918 INFO:tasks.workunit.client.1.smithi153.stdout:checking for C compiler default output file name... a.out 2024-05-09T00:11:38.000 INFO:tasks.workunit.client.1.smithi153.stdout:checking for suffix of executables... 2024-05-09T00:11:38.091 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether we are cross compiling... no 2024-05-09T00:11:38.195 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdint.h... yes 2024-05-09T00:11:38.248 INFO:tasks.workunit.client.1.smithi153.stdout:checking for suffix of object files... o 2024-05-09T00:11:38.307 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether we are using the GNU C compiler... yes 2024-05-09T00:11:38.323 INFO:tasks.workunit.client.0.smithi114.stdout:checking for unistd.h... yes 2024-05-09T00:11:38.368 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether gcc accepts -g... yes 2024-05-09T00:11:38.439 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-09T00:11:38.471 INFO:tasks.workunit.client.0.smithi114.stdout:checking pthread.h usability... yes 2024-05-09T00:11:38.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:38.545 INFO:tasks.workunit.client.0.smithi114.stdout:checking pthread.h presence... yes 2024-05-09T00:11:38.547 INFO:tasks.workunit.client.0.smithi114.stdout:checking for pthread.h... yes 2024-05-09T00:11:38.682 INFO:tasks.workunit.client.0.smithi114.stdout:checking fcntl.h usability... yes 2024-05-09T00:11:38.738 INFO:tasks.workunit.client.0.smithi114.stdout:checking fcntl.h presence... yes 2024-05-09T00:11:38.739 INFO:tasks.workunit.client.0.smithi114.stdout:checking for fcntl.h... yes 2024-05-09T00:11:38.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.774+0000 7f7468000640 1 Processor -- start 2024-05-09T00:11:38.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.774+0000 7f7468000640 1 -- start start 2024-05-09T00:11:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.776+0000 7f7468000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7460073800 0x7f7460072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.776+0000 7f7468000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74600c4a70 0x7f74600c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.776+0000 7f7468000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7460074040 con 0x7f74601585c0 2024-05-09T00:11:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.776+0000 7f7468000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7460073df0 con 0x7f74600c4a70 2024-05-09T00:11:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.776+0000 7f7468000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f74600c5f40 con 0x7f7460073800 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.777+0000 7f7465600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7460073800 0x7f7460072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.777+0000 7f7464c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74600c4a70 0x7f74600c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.777+0000 7f7464c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74600c4a70 0x7f74600c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:51910/0 (socket says 172.21.15.114:51910) 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.777+0000 7f7464c00640 1 -- 172.21.15.114:0/2598242310 learned_addr learned my addr 172.21.15.114:0/2598242310 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.777+0000 7f7465600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7460073800 0x7f7460072720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:59106/0 (socket says 172.21.15.114:59106) 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.778+0000 7f7464c00640 1 -- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7460073800 msgr2=0x7f7460072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.778+0000 7f7464c00640 1 --2- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7460073800 0x7f7460072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.778+0000 7f7464c00640 1 -- 172.21.15.114:0/2598242310 >> v1:172.21.15.153:6789/0 conn(0x7f74601585c0 legacy=0x7f7460154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.778+0000 7f7464c00640 1 -- 172.21.15.114:0/2598242310 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74600c58f0 con 0x7f74600c4a70 2024-05-09T00:11:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.779+0000 7f7464c00640 1 --2- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 0x7f74600c63d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f744c009870 tx=0x7f744c02a240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d847839f1d09d74c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:38.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.780+0000 7f745fe00640 1 -- 172.21.15.114:0/2598242310 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c037070 con 0x7f74600c4a70 2024-05-09T00:11:38.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.780+0000 7f745fe00640 1 -- 172.21.15.114:0/2598242310 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c032440 con 0x7f74600c4a70 2024-05-09T00:11:38.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.780+0000 7f745fe00640 1 -- 172.21.15.114:0/2598242310 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c032810 con 0x7f74600c4a70 2024-05-09T00:11:38.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.780+0000 7f7468000640 1 -- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 msgr2=0x7f74600c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:38.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.780+0000 7f7468000640 1 --2- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 0x7f74600c63d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f744c009870 tx=0x7f744c02a240 comp rx=0 tx=0).stop 2024-05-09T00:11:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.781+0000 7f7468000640 1 -- 172.21.15.114:0/2598242310 shutdown_connections 2024-05-09T00:11:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.781+0000 7f7468000640 1 --2- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 0x7f74600c63d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.781+0000 7f7468000640 1 --2- 172.21.15.114:0/2598242310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7460073800 0x7f7460072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.781+0000 7f7468000640 1 -- 172.21.15.114:0/2598242310 >> 172.21.15.114:0/2598242310 conn(0x7f746006c680 msgr2=0x7f746006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.781+0000 7f7468000640 1 -- 172.21.15.114:0/2598242310 shutdown_connections 2024-05-09T00:11:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.781+0000 7f7468000640 1 -- 172.21.15.114:0/2598242310 wait complete. 2024-05-09T00:11:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.783+0000 7f7468000640 1 Processor -- start 2024-05-09T00:11:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.783+0000 7f7468000640 1 -- start start 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7468000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 0x7f746014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7468000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 0x7f74600c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7468000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74601585c0 0x7f746014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7468000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7460074320 con 0x7f7460073800 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7468000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74600c4e80 con 0x7f74600c4a70 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7468000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f746014ebb0 con 0x7f74601585c0 2024-05-09T00:11:38.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 0x7f746014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 0x7f746014c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37144/0 (socket says 172.21.15.114:37144) 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 -- 172.21.15.114:0/3510286260 learned_addr learned my addr 172.21.15.114:0/3510286260 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 -- 172.21.15.114:0/3510286260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74601585c0 msgr2=0x7f746014de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74601585c0 0x7f746014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 -- 172.21.15.114:0/3510286260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 msgr2=0x7f74600c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 0x7f74600c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.785+0000 7f7465600640 1 -- 172.21.15.114:0/3510286260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74601dee40 con 0x7f7460073800 2024-05-09T00:11:38.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.786+0000 7f7465600640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 0x7f746014c6d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f745400e9d0 tx=0x7f745400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:38.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.786+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745400de60 con 0x7f7460073800 2024-05-09T00:11:38.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.786+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454010440 con 0x7f7460073800 2024-05-09T00:11:38.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.786+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454010830 con 0x7f7460073800 2024-05-09T00:11:38.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.786+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74601df120 con 0x7f7460073800 2024-05-09T00:11:38.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.786+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746014d970 con 0x7f7460073800 2024-05-09T00:11:38.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.787+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7460069d90 con 0x7f7460073800 2024-05-09T00:11:38.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.789+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74540109d0 con 0x7f7460073800 2024-05-09T00:11:38.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.790+0000 7f745d600640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7440076300 0x7f7440078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:38.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.790+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f7454098420 con 0x7f7460073800 2024-05-09T00:11:38.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.790+0000 7f7464c00640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7440076300 0x7f7440078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:38.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.791+0000 7f7464c00640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7440076300 0x7f7440078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f744c034000 tx=0x7f744c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:38.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:38.796+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7460069d90 con 0x7f7460073800 2024-05-09T00:11:38.868 INFO:tasks.workunit.client.0.smithi114.stdout:checking limits.h usability... yes 2024-05-09T00:11:38.924 INFO:tasks.workunit.client.0.smithi114.stdout:checking limits.h presence... yes 2024-05-09T00:11:38.925 INFO:tasks.workunit.client.0.smithi114.stdout:checking for limits.h... yes 2024-05-09T00:11:38.951 INFO:tasks.workunit.client.1.smithi153.stdout:checking dependency style of gcc... gcc3 2024-05-09T00:11:38.977 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdint.h... (cached) yes 2024-05-09T00:11:39.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.053+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7460077430 con 0x7f7460073800 2024-05-09T00:11:39.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.055+0000 7f745d600640 1 -- 172.21.15.114:0/3510286260 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f7454014030 con 0x7f7460073800 2024-05-09T00:11:39.053 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:11:39.053 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:11:39.054 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:11:39.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7440076300 msgr2=0x7f7440078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7440076300 0x7f7440078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f744c034000 tx=0x7f744c02c000 comp rx=0 tx=0).stop 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 msgr2=0x7f746014c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 0x7f746014c6d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f745400e9d0 tx=0x7f745400ee90 comp rx=0 tx=0).stop 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 shutdown_connections 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7440076300 0x7f7440078810 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f744c034000 tx=0x7f744c02c000 comp rx=0 tx=0).stop 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74601585c0 0x7f746014de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74600c4a70 0x7f74600c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 --2- 172.21.15.114:0/3510286260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7460073800 0x7f746014c6d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.058+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 >> 172.21.15.114:0/3510286260 conn(0x7f746006c680 msgr2=0x7f74600aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:39.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.059+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 shutdown_connections 2024-05-09T00:11:39.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:11:39.059+0000 7f7468000640 1 -- 172.21.15.114:0/3510286260 wait complete. 2024-05-09T00:11:39.074 INFO:tasks.workunit.client.1.smithi153.stdout:checking how to run the C preprocessor... gcc -E 2024-05-09T00:11:39.084 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2024-05-09T00:11:39.084 INFO:tasks.mds_thrash.fs.[a]:waiting for 97 secs before thrashing 2024-05-09T00:11:39.100 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/time.h usability... yes 2024-05-09T00:11:39.159 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/time.h presence... yes 2024-05-09T00:11:39.161 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/time.h... yes 2024-05-09T00:11:39.192 INFO:tasks.workunit.client.1.smithi153.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-09T00:11:39.195 INFO:tasks.workunit.client.1.smithi153.stdout:checking for egrep... /usr/bin/grep -E 2024-05-09T00:11:39.209 INFO:tasks.workunit.client.0.smithi114.stdout:checking for unistd.h... (cached) yes 2024-05-09T00:11:39.323 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/vfs.h usability... yes 2024-05-09T00:11:39.366 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/vfs.h presence... yes 2024-05-09T00:11:39.367 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/vfs.h... yes 2024-05-09T00:11:39.483 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/limits.h usability... no 2024-05-09T00:11:40.209 INFO:tasks.workunit.client.1.smithi153.stdout:checking for ANSI C header files... yes 2024-05-09T00:11:40.333 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/limits.h presence... no 2024-05-09T00:11:40.335 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/limits.h... no 2024-05-09T00:11:40.436 INFO:tasks.workunit.client.0.smithi114.stdout:checking for an ANSI C-conforming const... yes 2024-05-09T00:11:40.536 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-09T00:11:40.539 INFO:tasks.workunit.client.0.smithi114.stdout:checking for function prototypes... yes 2024-05-09T00:11:40.660 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether setvbuf arguments are reversed... no 2024-05-09T00:11:40.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:11:40.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:11:40.914 INFO:tasks.workunit.client.0.smithi114.stdout:checking for system... yes 2024-05-09T00:11:41.026 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/types.h... yes 2024-05-09T00:11:41.639 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/stat.h... yes 2024-05-09T00:11:41.731 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stdlib.h... yes 2024-05-09T00:11:41.829 INFO:tasks.workunit.client.1.smithi153.stdout:checking for string.h... yes 2024-05-09T00:11:41.836 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gettimeofday... yes 2024-05-09T00:11:41.917 INFO:tasks.workunit.client.1.smithi153.stdout:checking for memory.h... yes 2024-05-09T00:11:41.992 INFO:tasks.workunit.client.0.smithi114.stdout:checking for mkdir... yes 2024-05-09T00:11:42.017 INFO:tasks.workunit.client.1.smithi153.stdout:checking for strings.h... yes 2024-05-09T00:11:42.108 INFO:tasks.workunit.client.1.smithi153.stdout:checking for inttypes.h... yes 2024-05-09T00:11:42.148 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strerror... yes 2024-05-09T00:11:42.189 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stdint.h... yes 2024-05-09T00:11:42.277 INFO:tasks.workunit.client.1.smithi153.stdout:checking for unistd.h... yes 2024-05-09T00:11:42.295 INFO:tasks.workunit.client.0.smithi114.stdout:checking for open64... yes 2024-05-09T00:11:42.376 INFO:tasks.workunit.client.1.smithi153.stdout:checking minix/config.h usability... no 2024-05-09T00:11:42.443 INFO:tasks.workunit.client.1.smithi153.stdout:checking minix/config.h presence... no 2024-05-09T00:11:42.443 INFO:tasks.workunit.client.1.smithi153.stdout:checking for minix/config.h... no 2024-05-09T00:11:42.515 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-05-09T00:11:42.516 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc... (cached) gcc 2024-05-09T00:11:42.593 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-09T00:11:42.593 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-09T00:11:42.593 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-09T00:11:42.594 INFO:tasks.workunit.client.1.smithi153.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-09T00:11:42.689 INFO:tasks.workunit.client.1.smithi153.stdout:checking for main in -lm... yes 2024-05-09T00:11:42.778 INFO:tasks.workunit.client.1.smithi153.stdout:checking for main in -lpthread... yes 2024-05-09T00:11:42.781 INFO:tasks.workunit.client.1.smithi153.stdout:checking for ANSI C header files... (cached) yes 2024-05-09T00:11:42.982 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stat64... yes 2024-05-09T00:11:42.994 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-09T00:11:43.112 INFO:tasks.workunit.client.1.smithi153.stdout:checking pthread.h usability... yes 2024-05-09T00:11:43.157 INFO:tasks.workunit.client.1.smithi153.stdout:checking pthread.h presence... yes 2024-05-09T00:11:43.158 INFO:tasks.workunit.client.1.smithi153.stdout:checking for pthread.h... yes 2024-05-09T00:11:43.274 INFO:tasks.workunit.client.1.smithi153.stdout:checking fcntl.h usability... yes 2024-05-09T00:11:43.317 INFO:tasks.workunit.client.1.smithi153.stdout:checking fcntl.h presence... yes 2024-05-09T00:11:43.317 INFO:tasks.workunit.client.1.smithi153.stdout:checking for fcntl.h... yes 2024-05-09T00:11:43.428 INFO:tasks.workunit.client.1.smithi153.stdout:checking limits.h usability... yes 2024-05-09T00:11:43.470 INFO:tasks.workunit.client.1.smithi153.stdout:checking limits.h presence... yes 2024-05-09T00:11:43.471 INFO:tasks.workunit.client.1.smithi153.stdout:checking for limits.h... yes 2024-05-09T00:11:43.514 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stdint.h... (cached) yes 2024-05-09T00:11:43.603 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/time.h usability... yes 2024-05-09T00:11:43.640 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/time.h presence... yes 2024-05-09T00:11:43.640 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/time.h... yes 2024-05-09T00:11:43.672 INFO:tasks.workunit.client.1.smithi153.stdout:checking for unistd.h... (cached) yes 2024-05-09T00:11:43.751 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/vfs.h usability... yes 2024-05-09T00:11:43.785 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/vfs.h presence... yes 2024-05-09T00:11:43.785 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/vfs.h... yes 2024-05-09T00:11:44.200 INFO:tasks.workunit.client.0.smithi114.stdout:checking for fseeko64... yes 2024-05-09T00:11:44.345 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/limits.h usability... no 2024-05-09T00:11:44.366 INFO:tasks.workunit.client.0.smithi114.stdout:checking for lrand48_r... yes 2024-05-09T00:11:44.414 INFO:tasks.workunit.client.1.smithi153.stdout:checking sys/limits.h presence... no 2024-05-09T00:11:44.414 INFO:tasks.workunit.client.1.smithi153.stdout:checking for sys/limits.h... no 2024-05-09T00:11:44.473 INFO:tasks.workunit.client.1.smithi153.stdout:checking for an ANSI C-conforming const... yes 2024-05-09T00:11:44.528 INFO:tasks.workunit.client.0.smithi114.stdout:checking for srand48_r... yes 2024-05-09T00:11:44.534 INFO:tasks.workunit.client.1.smithi153.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-09T00:11:44.591 INFO:tasks.workunit.client.0.smithi114.stdout:configure: creating ./config.status 2024-05-09T00:11:44.660 INFO:tasks.workunit.client.1.smithi153.stdout:checking for system... yes 2024-05-09T00:11:44.761 INFO:tasks.workunit.client.1.smithi153.stdout:checking for gettimeofday... yes 2024-05-09T00:11:44.879 INFO:tasks.workunit.client.1.smithi153.stdout:checking for mkdir... yes 2024-05-09T00:11:44.883 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating Makefile 2024-05-09T00:11:44.935 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating config.h 2024-05-09T00:11:44.987 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: executing depfiles commands 2024-05-09T00:11:45.112 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: executing default commands 2024-05-09T00:11:45.411 INFO:tasks.workunit.client.1.smithi153.stdout:checking for strerror... yes 2024-05-09T00:11:45.519 INFO:tasks.workunit.client.0.smithi114.stderr:+ make 2024-05-09T00:11:45.533 INFO:tasks.workunit.client.0.smithi114.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-05-09T00:11:45.540 INFO:tasks.workunit.client.0.smithi114.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-05-09T00:11:45.543 INFO:tasks.workunit.client.0.smithi114.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-05-09T00:11:45.543 INFO:tasks.workunit.client.0.smithi114.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-05-09T00:11:45.543 INFO:tasks.workunit.client.0.smithi114.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-05-09T00:11:45.543 INFO:tasks.workunit.client.0.smithi114.stderr: any GNU archive site. 2024-05-09T00:11:45.550 INFO:tasks.workunit.client.0.smithi114.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-05-09T00:11:45.554 INFO:tasks.workunit.client.0.smithi114.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-05-09T00:11:45.557 INFO:tasks.workunit.client.0.smithi114.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-05-09T00:11:45.557 INFO:tasks.workunit.client.0.smithi114.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-05-09T00:11:45.557 INFO:tasks.workunit.client.0.smithi114.stderr: You might want to install the `Automake' and `Perl' packages. 2024-05-09T00:11:45.557 INFO:tasks.workunit.client.0.smithi114.stderr: Grab them from any GNU archive site. 2024-05-09T00:11:45.878 INFO:tasks.workunit.client.1.smithi153.stdout:checking for open64... yes 2024-05-09T00:11:46.164 INFO:tasks.workunit.client.1.smithi153.stdout:checking for stat64... yes 2024-05-09T00:11:46.361 INFO:tasks.workunit.client.0.smithi114.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-05-09T00:11:46.828 INFO:tasks.workunit.client.1.smithi153.stdout:checking for fseeko64... yes 2024-05-09T00:11:46.919 INFO:tasks.workunit.client.0.smithi114.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-09T00:11:46.919 INFO:tasks.workunit.client.0.smithi114.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-09T00:11:46.919 INFO:tasks.workunit.client.0.smithi114.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-09T00:11:46.919 INFO:tasks.workunit.client.0.smithi114.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-09T00:11:46.954 INFO:tasks.workunit.client.1.smithi153.stdout:checking for lrand48_r... yes 2024-05-09T00:11:47.078 INFO:tasks.workunit.client.1.smithi153.stdout:checking for srand48_r... yes 2024-05-09T00:11:47.131 INFO:tasks.workunit.client.1.smithi153.stdout:configure: creating ./config.status 2024-05-09T00:11:47.132 INFO:tasks.workunit.client.0.smithi114.stdout:/bin/sh ./config.status --recheck 2024-05-09T00:11:47.306 INFO:tasks.workunit.client.1.smithi153.stdout: /bin/sh ./config.status 2024-05-09T00:11:47.429 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: creating Makefile 2024-05-09T00:11:47.472 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: creating config.h 2024-05-09T00:11:47.534 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: executing depfiles commands 2024-05-09T00:11:47.578 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: executing default commands 2024-05-09T00:11:48.004 INFO:tasks.workunit.client.0.smithi114.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-05-09T00:11:48.352 INFO:tasks.workunit.client.0.smithi114.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-09T00:11:48.514 INFO:tasks.workunit.client.1.smithi153.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-05-09T00:11:48.773 INFO:tasks.workunit.client.1.smithi153.stdout:rm -f stamp-h1 2024-05-09T00:11:48.779 INFO:tasks.workunit.client.1.smithi153.stdout:touch config.h.in 2024-05-09T00:11:48.784 INFO:tasks.workunit.client.1.smithi153.stdout:cd . && /bin/sh ./config.status config.h 2024-05-09T00:11:48.906 INFO:tasks.workunit.client.1.smithi153.stdout:config.status: creating config.h 2024-05-09T00:11:48.988 INFO:tasks.workunit.client.1.smithi153.stdout:make all-am 2024-05-09T00:11:49.004 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-05-09T00:11:49.004 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-05-09T00:11:49.259 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-05-09T00:11:49.267 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-05-09T00:11:49.373 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether build environment is sane... yes 2024-05-09T00:11:49.391 INFO:tasks.workunit.client.0.smithi114.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-09T00:11:49.392 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gawk... gawk 2024-05-09T00:11:49.407 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-05-09T00:11:49.413 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-05-09T00:11:49.426 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether make sets $(MAKE)... yes 2024-05-09T00:11:49.532 INFO:tasks.workunit.client.0.smithi114.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:49.532 INFO:tasks.workunit.client.0.smithi114.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-09T00:11:49.546 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-05-09T00:11:49.555 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-05-09T00:11:49.558 INFO:tasks.workunit.client.0.smithi114.stdout:checking for style of include used by make... GNU 2024-05-09T00:11:49.567 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc... gcc 2024-05-09T00:11:49.693 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-05-09T00:11:49.699 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-05-09T00:11:49.819 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether the C compiler works... yes 2024-05-09T00:11:49.819 INFO:tasks.workunit.client.0.smithi114.stdout:checking for C compiler default output file name... a.out 2024-05-09T00:11:50.062 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-05-09T00:11:50.181 INFO:tasks.workunit.client.0.smithi114.stdout:checking for suffix of executables... 2024-05-09T00:11:50.278 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are cross compiling... no 2024-05-09T00:11:50.382 INFO:tasks.workunit.client.0.smithi114.stdout:checking for suffix of object files... o 2024-05-09T00:11:50.452 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are using the GNU C compiler... yes 2024-05-09T00:11:50.518 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc accepts -g... yes 2024-05-09T00:11:50.863 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-05-09T00:11:50.953 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-05-09T00:11:50.959 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-05-09T00:11:51.042 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-05-09T00:11:51.051 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-05-09T00:11:51.135 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-05-09T00:11:51.143 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-05-09T00:11:51.416 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-05-09T00:11:51.425 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-05-09T00:11:51.454 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-09T00:11:51.612 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-05-09T00:11:51.618 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-05-09T00:11:51.771 INFO:tasks.workunit.client.0.smithi114.stdout:checking dependency style of gcc... gcc3 2024-05-09T00:11:51.830 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-05-09T00:11:51.836 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-05-09T00:11:51.952 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-05-09T00:11:51.961 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-05-09T00:11:52.075 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-05-09T00:11:52.084 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-05-09T00:11:52.236 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-05-09T00:11:52.243 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-05-09T00:11:52.297 INFO:tasks.workunit.client.1.smithi153.stderr:In file included from parser.h:22, 2024-05-09T00:11:52.297 INFO:tasks.workunit.client.1.smithi153.stderr: from parser.c:25: 2024-05-09T00:11:52.297 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c: In function ‘init_filesys’: 2024-05-09T00:11:52.297 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.297 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-09T00:11:52.298 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.299 INFO:tasks.workunit.client.1.smithi153.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.300 INFO:tasks.workunit.client.1.smithi153.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.301 INFO:tasks.workunit.client.1.smithi153.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c: In function ‘init_tg_stats’: 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.302 INFO:tasks.workunit.client.1.smithi153.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.303 INFO:tasks.workunit.client.1.smithi153.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.304 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: | ^ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:11:52.305 INFO:tasks.workunit.client.1.smithi153.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:11:52.306 INFO:tasks.workunit.client.1.smithi153.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:11:52.306 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~ 2024-05-09T00:11:52.306 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:11:52.306 INFO:tasks.workunit.client.1.smithi153.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-09T00:11:52.306 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c: In function ‘get_optstr’: 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:200:14: note: source object declared here 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr: 200 | char temp[BUFSIZE]; 2024-05-09T00:11:52.353 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~ 2024-05-09T00:11:52.360 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c: In function ‘size64_convert’: 2024-05-09T00:11:52.360 INFO:tasks.workunit.client.1.smithi153.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-05-09T00:11:52.360 INFO:tasks.workunit.client.1.smithi153.stderr: 119 | memcpy(unit, "\0", 3); 2024-05-09T00:11:52.361 INFO:tasks.workunit.client.1.smithi153.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-09T00:11:52.718 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-05-09T00:11:52.726 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-05-09T00:11:52.819 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to run the C preprocessor... gcc -E 2024-05-09T00:11:52.823 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-05-09T00:11:52.829 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-05-09T00:11:52.979 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-05-09T00:11:52.984 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-05-09T00:11:53.044 INFO:tasks.workunit.client.1.smithi153.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-05-09T00:11:53.054 INFO:tasks.workunit.client.1.smithi153.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-05-09T00:11:53.122 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-05-09T00:11:53.124 INFO:tasks.workunit.client.1.smithi153.stderr:+ cd .. 2024-05-09T00:11:53.124 INFO:tasks.workunit.client.1.smithi153.stderr:+ mkdir tmp 2024-05-09T00:11:53.130 INFO:tasks.workunit.client.1.smithi153.stderr:+ cd tmp 2024-05-09T00:11:53.130 INFO:tasks.workunit.client.1.smithi153.stderr:+ for f in $mydir/*.ffsb 2024-05-09T00:11:53.130 INFO:tasks.workunit.client.1.smithi153.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/random_write.32.ffsb 2024-05-09T00:11:53.133 INFO:tasks.workunit.client.1.smithi153.stdout:FFSB version 6.0-RC2 started 2024-05-09T00:11:53.133 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.140 INFO:tasks.workunit.client.1.smithi153.stdout:benchmark time = 300 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout:ThreadGroup 0 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout:================ 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: num_threads = 32 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: read_random = off 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: read_size = 0 (0B) 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: read_blocksize = 0 (0B) 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: read_skip = off 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: read_skipsize = 0 (0B) 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: write_random = on 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: write_size = 5242880 (5MB) 2024-05-09T00:11:53.141 INFO:tasks.workunit.client.1.smithi153.stdout: fsync_file = 0 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: write_blocksize = 4096 (4KB) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: wait time = 0 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: op weights 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: read = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: readall = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: write = 1 (100.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: create = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: append = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: delete = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: metaop = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: createdir = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: stat = 0 (0.00%) 2024-05-09T00:11:53.142 INFO:tasks.workunit.client.1.smithi153.stdout: writeall = 0 (0.00%) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: writeall_fsync = 0 (0.00%) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: open_close = 0 (0.00%) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: write_fsync = 0 (0.00%) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: create_fsync = 0 (0.00%) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: append_fsync = 0 (0.00%) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout:FileSystem . 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout:========== 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: num_dirs = 0 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: starting files = 128 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: min file size = 104857600 (100MB) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: max file size = 104857600 (100MB) 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: directio = off 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: alignedio = on 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: bufferedio = off 2024-05-09T00:11:53.143 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.144 INFO:tasks.workunit.client.1.smithi153.stdout: aging is off 2024-05-09T00:11:53.144 INFO:tasks.workunit.client.1.smithi153.stdout: current utilization = 0.00% 2024-05-09T00:11:53.144 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:11:53.144 INFO:tasks.workunit.client.1.smithi153.stdout:checking existing fs: . 2024-05-09T00:11:53.144 INFO:tasks.workunit.client.1.smithi153.stdout:recreating new fileset 2024-05-09T00:11:53.145 INFO:tasks.workunit.client.1.smithi153.stderr:opendir: No such file or directory 2024-05-09T00:11:53.856 INFO:tasks.workunit.client.0.smithi114.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-09T00:11:53.862 INFO:tasks.workunit.client.0.smithi114.stdout:checking for egrep... /usr/bin/grep -E 2024-05-09T00:11:55.584 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ANSI C header files... yes 2024-05-09T00:11:55.674 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/types.h... yes 2024-05-09T00:11:55.762 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/stat.h... yes 2024-05-09T00:11:55.943 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdlib.h... yes 2024-05-09T00:11:56.046 INFO:tasks.workunit.client.0.smithi114.stdout:checking for string.h... yes 2024-05-09T00:11:56.134 INFO:tasks.workunit.client.0.smithi114.stdout:checking for memory.h... yes 2024-05-09T00:11:56.255 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strings.h... yes 2024-05-09T00:11:56.374 INFO:tasks.workunit.client.0.smithi114.stdout:checking for inttypes.h... yes 2024-05-09T00:11:56.459 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdint.h... yes 2024-05-09T00:11:56.566 INFO:tasks.workunit.client.0.smithi114.stdout:checking for unistd.h... yes 2024-05-09T00:11:56.717 INFO:tasks.workunit.client.0.smithi114.stdout:checking minix/config.h usability... no 2024-05-09T00:11:56.797 INFO:tasks.workunit.client.0.smithi114.stdout:checking minix/config.h presence... no 2024-05-09T00:11:56.797 INFO:tasks.workunit.client.0.smithi114.stdout:checking for minix/config.h... no 2024-05-09T00:11:56.886 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-05-09T00:11:56.886 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc... (cached) gcc 2024-05-09T00:11:57.001 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-09T00:11:57.002 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-09T00:11:57.003 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-09T00:11:57.004 INFO:tasks.workunit.client.0.smithi114.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-09T00:11:57.119 INFO:tasks.workunit.client.0.smithi114.stdout:checking for main in -lm... yes 2024-05-09T00:11:57.230 INFO:tasks.workunit.client.0.smithi114.stdout:checking for main in -lpthread... yes 2024-05-09T00:11:57.233 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ANSI C header files... (cached) yes 2024-05-09T00:11:57.324 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-09T00:11:57.500 INFO:tasks.workunit.client.0.smithi114.stdout:checking pthread.h usability... yes 2024-05-09T00:11:57.563 INFO:tasks.workunit.client.0.smithi114.stdout:checking pthread.h presence... yes 2024-05-09T00:11:57.563 INFO:tasks.workunit.client.0.smithi114.stdout:checking for pthread.h... yes 2024-05-09T00:11:57.703 INFO:tasks.workunit.client.0.smithi114.stdout:checking fcntl.h usability... yes 2024-05-09T00:11:57.753 INFO:tasks.workunit.client.0.smithi114.stdout:checking fcntl.h presence... yes 2024-05-09T00:11:57.753 INFO:tasks.workunit.client.0.smithi114.stdout:checking for fcntl.h... yes 2024-05-09T00:11:57.893 INFO:tasks.workunit.client.0.smithi114.stdout:checking limits.h usability... yes 2024-05-09T00:11:57.942 INFO:tasks.workunit.client.0.smithi114.stdout:checking limits.h presence... yes 2024-05-09T00:11:57.943 INFO:tasks.workunit.client.0.smithi114.stdout:checking for limits.h... yes 2024-05-09T00:11:57.985 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdint.h... (cached) yes 2024-05-09T00:11:58.085 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/time.h usability... yes 2024-05-09T00:11:58.135 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/time.h presence... yes 2024-05-09T00:11:58.135 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/time.h... yes 2024-05-09T00:11:58.181 INFO:tasks.workunit.client.0.smithi114.stdout:checking for unistd.h... (cached) yes 2024-05-09T00:11:58.284 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/vfs.h usability... yes 2024-05-09T00:11:58.330 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/vfs.h presence... yes 2024-05-09T00:11:58.330 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/vfs.h... yes 2024-05-09T00:11:58.474 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/limits.h usability... no 2024-05-09T00:11:58.571 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/limits.h presence... no 2024-05-09T00:11:58.572 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/limits.h... no 2024-05-09T00:11:58.645 INFO:tasks.workunit.client.0.smithi114.stdout:checking for an ANSI C-conforming const... yes 2024-05-09T00:11:58.721 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-09T00:11:58.871 INFO:tasks.workunit.client.0.smithi114.stdout:checking for system... yes 2024-05-09T00:11:59.020 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gettimeofday... yes 2024-05-09T00:11:59.173 INFO:tasks.workunit.client.0.smithi114.stdout:checking for mkdir... yes 2024-05-09T00:11:59.309 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strerror... yes 2024-05-09T00:11:59.449 INFO:tasks.workunit.client.0.smithi114.stdout:checking for open64... yes 2024-05-09T00:11:59.592 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stat64... yes 2024-05-09T00:11:59.730 INFO:tasks.workunit.client.0.smithi114.stdout:checking for fseeko64... yes 2024-05-09T00:11:59.876 INFO:tasks.workunit.client.0.smithi114.stdout:checking for lrand48_r... yes 2024-05-09T00:12:00.242 INFO:tasks.workunit.client.0.smithi114.stdout:checking for srand48_r... yes 2024-05-09T00:12:00.313 INFO:tasks.workunit.client.0.smithi114.stdout:configure: creating ./config.status 2024-05-09T00:12:00.528 INFO:tasks.workunit.client.0.smithi114.stdout: /bin/sh ./config.status 2024-05-09T00:12:00.728 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating Makefile 2024-05-09T00:12:01.029 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating config.h 2024-05-09T00:12:01.160 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: executing depfiles commands 2024-05-09T00:12:01.200 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: executing default commands 2024-05-09T00:12:01.345 INFO:tasks.workunit.client.0.smithi114.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-05-09T00:12:01.796 INFO:tasks.workunit.client.0.smithi114.stdout:rm -f stamp-h1 2024-05-09T00:12:01.804 INFO:tasks.workunit.client.0.smithi114.stdout:touch config.h.in 2024-05-09T00:12:01.809 INFO:tasks.workunit.client.0.smithi114.stdout:cd . && /bin/sh ./config.status config.h 2024-05-09T00:12:01.961 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating config.h 2024-05-09T00:12:02.060 INFO:tasks.workunit.client.0.smithi114.stdout:make all-am 2024-05-09T00:12:02.087 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-09T00:12:02.087 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-05-09T00:12:02.437 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-05-09T00:12:02.442 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-05-09T00:12:02.605 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-05-09T00:12:02.804 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-05-09T00:12:03.362 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-05-09T00:12:03.375 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-05-09T00:12:03.551 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-05-09T00:12:03.562 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-05-09T00:12:03.805 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-05-09T00:12:03.818 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-05-09T00:12:03.924 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-05-09T00:12:03.937 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-05-09T00:12:04.042 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-05-09T00:12:04.048 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-05-09T00:12:04.132 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-05-09T00:12:04.137 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-05-09T00:12:04.433 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-05-09T00:12:04.441 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-05-09T00:12:04.653 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-05-09T00:12:04.662 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-05-09T00:12:04.927 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-05-09T00:12:04.937 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-05-09T00:12:05.064 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-05-09T00:12:05.074 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-05-09T00:12:05.222 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-05-09T00:12:05.231 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-05-09T00:12:05.410 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-05-09T00:12:05.416 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-05-09T00:12:05.471 INFO:tasks.workunit.client.0.smithi114.stderr:In file included from parser.h:22, 2024-05-09T00:12:05.471 INFO:tasks.workunit.client.0.smithi114.stderr: from parser.c:25: 2024-05-09T00:12:05.471 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c: In function ‘init_filesys’: 2024-05-09T00:12:05.473 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.474 INFO:tasks.workunit.client.0.smithi114.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.475 INFO:tasks.workunit.client.0.smithi114.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.476 INFO:tasks.workunit.client.0.smithi114.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.477 INFO:tasks.workunit.client.0.smithi114.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c: In function ‘init_tg_stats’: 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:12:05.478 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:12:05.479 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-09T00:12:05.480 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: | ^ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: 36 | container_of(ptr, type, member) 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-09T00:12:05.481 INFO:tasks.workunit.client.0.smithi114.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-09T00:12:05.482 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~ 2024-05-09T00:12:05.482 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-09T00:12:05.482 INFO:tasks.workunit.client.0.smithi114.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-09T00:12:05.482 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.559 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c: In function ‘get_optstr’: 2024-05-09T00:12:05.559 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-05-09T00:12:05.559 INFO:tasks.workunit.client.0.smithi114.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-05-09T00:12:05.559 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:05.559 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:200:14: note: source object declared here 2024-05-09T00:12:05.559 INFO:tasks.workunit.client.0.smithi114.stderr: 200 | char temp[BUFSIZE]; 2024-05-09T00:12:05.560 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~ 2024-05-09T00:12:05.571 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c: In function ‘size64_convert’: 2024-05-09T00:12:05.571 INFO:tasks.workunit.client.0.smithi114.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-05-09T00:12:05.571 INFO:tasks.workunit.client.0.smithi114.stderr: 119 | memcpy(unit, "\0", 3); 2024-05-09T00:12:05.571 INFO:tasks.workunit.client.0.smithi114.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-09T00:12:06.107 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-05-09T00:12:06.113 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-05-09T00:12:06.269 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-05-09T00:12:06.274 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-05-09T00:12:06.404 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-05-09T00:12:06.413 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-05-09T00:12:06.474 INFO:tasks.workunit.client.0.smithi114.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-05-09T00:12:06.484 INFO:tasks.workunit.client.0.smithi114.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-05-09T00:12:06.554 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-09T00:12:06.555 INFO:tasks.workunit.client.0.smithi114.stderr:+ cd .. 2024-05-09T00:12:06.555 INFO:tasks.workunit.client.0.smithi114.stderr:+ mkdir tmp 2024-05-09T00:12:06.562 INFO:tasks.workunit.client.0.smithi114.stderr:+ cd tmp 2024-05-09T00:12:06.563 INFO:tasks.workunit.client.0.smithi114.stderr:+ for f in $mydir/*.ffsb 2024-05-09T00:12:06.563 INFO:tasks.workunit.client.0.smithi114.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-05-09T00:12:06.565 INFO:tasks.workunit.client.0.smithi114.stdout:FFSB version 6.0-RC2 started 2024-05-09T00:12:06.565 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout:benchmark time = 300 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout:ThreadGroup 0 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout:================ 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: num_threads = 32 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: read_random = off 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: read_size = 0 (0B) 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: read_blocksize = 0 (0B) 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: read_skip = off 2024-05-09T00:12:06.574 INFO:tasks.workunit.client.0.smithi114.stdout: read_skipsize = 0 (0B) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: write_random = on 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: write_size = 5242880 (5MB) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: fsync_file = 0 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: write_blocksize = 4096 (4KB) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: wait time = 0 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: op weights 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: read = 0 (0.00%) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: readall = 0 (0.00%) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: write = 1 (100.00%) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: create = 0 (0.00%) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: append = 0 (0.00%) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: delete = 0 (0.00%) 2024-05-09T00:12:06.575 INFO:tasks.workunit.client.0.smithi114.stdout: metaop = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: createdir = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: stat = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: writeall = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: writeall_fsync = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: open_close = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: write_fsync = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: create_fsync = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: append_fsync = 0 (0.00%) 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout:FileSystem . 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout:========== 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: num_dirs = 0 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: starting files = 128 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.576 INFO:tasks.workunit.client.0.smithi114.stdout: min file size = 104857600 (100MB) 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: max file size = 104857600 (100MB) 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: directio = off 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: alignedio = on 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: bufferedio = off 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: aging is off 2024-05-09T00:12:06.577 INFO:tasks.workunit.client.0.smithi114.stdout: current utilization = 0.00% 2024-05-09T00:12:06.578 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:12:06.578 INFO:tasks.workunit.client.0.smithi114.stdout:checking existing fs: . 2024-05-09T00:12:06.578 INFO:tasks.workunit.client.0.smithi114.stdout:recreating new fileset 2024-05-09T00:12:06.578 INFO:tasks.workunit.client.0.smithi114.stderr:opendir: No such file or directory 2024-05-09T00:12:11.649 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:12:11.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:12:41.907 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:12:41.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:12:42.972 INFO:tasks.workunit.client.1.smithi153.stdout:fs setup took 49 secs 2024-05-09T00:12:51.020 INFO:tasks.workunit.client.1.smithi153.stdout:Syncing()...8 sec 2024-05-09T00:12:51.025 INFO:tasks.workunit.client.1.smithi153.stdout:Starting Actual Benchmark At: Thu May 9 00:12:51 2024 2024-05-09T00:12:51.026 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:13:12.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:13:12.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:13:16.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.591+0000 7feb93e00640 1 Processor -- start 2024-05-09T00:13:16.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.594+0000 7feb93e00640 1 -- start start 2024-05-09T00:13:16.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.602+0000 7feb93e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb8c046380 0x7feb8c0ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:16.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.602+0000 7feb93e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c04aff0 con 0x7feb8c0dc600 2024-05-09T00:13:16.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.603+0000 7feb93e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c04b2b0 con 0x7feb8c04b4f0 2024-05-09T00:13:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.604+0000 7feb92000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feb8c0dc600 0x7feb8c03e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56084/0 (socket says 172.21.15.114:56084) 2024-05-09T00:13:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.604+0000 7feb92000640 1 -- 172.21.15.114:0/3490392270 learned_addr learned my addr 172.21.15.114:0/3490392270 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.604+0000 7feb92a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feb8c04b4f0 0x7feb8c047c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:36544/0 (socket says 172.21.15.114:36544) 2024-05-09T00:13:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.606+0000 7feb93400640 1 --2- 172.21.15.114:0/3490392270 >> v2:172.21.15.153:3300/0 conn(0x7feb8c046380 0x7feb8c0ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.607+0000 7feb93e00640 1 -- 172.21.15.114:0/3490392270 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c00b510 con 0x7feb8c046380 2024-05-09T00:13:16.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.607+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865307223 0 0) 0x7feb8c04b2b0 con 0x7feb8c04b4f0 2024-05-09T00:13:16.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.607+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb78003520 con 0x7feb8c04b4f0 2024-05-09T00:13:16.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.607+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664694417 0 0) 0x7feb8c04aff0 con 0x7feb8c0dc600 2024-05-09T00:13:16.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.607+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb8c04b2b0 con 0x7feb8c0dc600 2024-05-09T00:13:16.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.608+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1007657379 0 0) 0x7feb78003520 con 0x7feb8c04b4f0 2024-05-09T00:13:16.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.610+0000 7feb93400640 1 -- 172.21.15.114:0/3490392270 >> v1:172.21.15.153:6789/0 conn(0x7feb8c04b4f0 legacy=0x7feb8c047c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:16.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.610+0000 7feb93400640 1 -- 172.21.15.114:0/3490392270 >> v1:172.21.15.114:6789/0 conn(0x7feb8c0dc600 legacy=0x7feb8c03e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:16.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.610+0000 7feb93400640 1 -- 172.21.15.114:0/3490392270 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c00b9c0 con 0x7feb8c046380 2024-05-09T00:13:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.617+0000 7feb93400640 1 --2- 172.21.15.114:0/3490392270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c046380 0x7feb8c0ea6e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb94066140 tx=0x7feb940a7d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec06b9e8ab177af2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.618+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb940b5070 con 0x7feb8c046380 2024-05-09T00:13:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.618+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940a86c0 con 0x7feb8c046380 2024-05-09T00:13:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.618+0000 7feb91600640 1 -- 172.21.15.114:0/3490392270 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800015d0 con 0x7feb8c046380 2024-05-09T00:13:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.621+0000 7feb93e00640 1 -- 172.21.15.114:0/3490392270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c046380 msgr2=0x7feb8c0ea6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.621+0000 7feb93e00640 1 --2- 172.21.15.114:0/3490392270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c046380 0x7feb8c0ea6e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb94066140 tx=0x7feb940a7d80 comp rx=0 tx=0).stop 2024-05-09T00:13:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.625+0000 7feb93e00640 1 -- 172.21.15.114:0/3490392270 shutdown_connections 2024-05-09T00:13:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.625+0000 7feb93e00640 1 --2- 172.21.15.114:0/3490392270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c046380 0x7feb8c0ea6e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.625+0000 7feb93e00640 1 -- 172.21.15.114:0/3490392270 >> 172.21.15.114:0/3490392270 conn(0x7feb8c006090 msgr2=0x7feb8c0064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.625+0000 7feb93e00640 1 -- 172.21.15.114:0/3490392270 shutdown_connections 2024-05-09T00:13:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.625+0000 7feb93e00640 1 -- 172.21.15.114:0/3490392270 wait complete. 2024-05-09T00:13:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.632+0000 7feb93e00640 1 Processor -- start 2024-05-09T00:13:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.633+0000 7feb93e00640 1 -- start start 2024-05-09T00:13:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.642+0000 7feb93e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8c046380 0x7feb8c178de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.642+0000 7feb93e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 0x7feb8c04a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.643+0000 7feb92a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8c046380 0x7feb8c178de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.643+0000 7feb92a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8c046380 0x7feb8c178de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:34350/0 (socket says 172.21.15.114:34350) 2024-05-09T00:13:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.643+0000 7feb92000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 0x7feb8c04a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.643+0000 7feb92000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 0x7feb8c04a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:43962/0 (socket says 172.21.15.114:43962) 2024-05-09T00:13:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.643+0000 7feb92a00640 1 -- 172.21.15.114:0/1059970966 learned_addr learned my addr 172.21.15.114:0/1059970966 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.644+0000 7feb93e00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb8c0dc600 0x7feb8c175570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.644+0000 7feb93e00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c007080 con 0x7feb8c0dc600 2024-05-09T00:13:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.644+0000 7feb93e00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c007360 con 0x7feb8c04b4f0 2024-05-09T00:13:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.644+0000 7feb93e00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c03f0e0 con 0x7feb8c046380 2024-05-09T00:13:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.645+0000 7feb92000640 1 -- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8c046380 msgr2=0x7feb8c178de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.645+0000 7feb92000640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8c046380 0x7feb8c178de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.645+0000 7feb92000640 1 -- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb8c0dc600 msgr2=0x7feb8c175570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:13:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.646+0000 7feb93400640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb8c0dc600 0x7feb8c175570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.646+0000 7feb92000640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb8c0dc600 0x7feb8c175570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.647+0000 7feb92000640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0d6160 con 0x7feb8c04b4f0 2024-05-09T00:13:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.648+0000 7feb93400640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb8c0dc600 0x7feb8c175570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.648+0000 7feb92000640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 0x7feb8c04a4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c530 tx=0x7feb8000c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.650+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80018070 con 0x7feb8c04b4f0 2024-05-09T00:13:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.650+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb800074e0 con 0x7feb8c04b4f0 2024-05-09T00:13:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.650+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80007690 con 0x7feb8c04b4f0 2024-05-09T00:13:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.653+0000 7feb93e00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c02b870 con 0x7feb8c04b4f0 2024-05-09T00:13:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.653+0000 7feb93e00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c02be30 con 0x7feb8c04b4f0 2024-05-09T00:13:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.656+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb68005290 con 0x7feb8c04b4f0 2024-05-09T00:13:16.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.664+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb80004a20 con 0x7feb8c04b4f0 2024-05-09T00:13:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.669+0000 7feb8b400640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feb740762d0 0x7feb740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.669+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7feb800971e0 con 0x7feb8c04b4f0 2024-05-09T00:13:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.670+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb80060620 con 0x7feb8c04b4f0 2024-05-09T00:13:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.671+0000 7feb92a00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feb740762d0 0x7feb740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:16.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:16.673+0000 7feb92a00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feb740762d0 0x7feb740787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb84001170 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.203+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb68005580 con 0x7feb8c04b4f0 2024-05-09T00:13:17.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.211+0000 7feb8b400640 1 -- 172.21.15.114:0/1059970966 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7feb8005ff20 con 0x7feb8c04b4f0 2024-05-09T00:13:17.218 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:17.218 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:17.219 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:17.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.224+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feb740762d0 msgr2=0x7feb740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.224+0000 7feb88c00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feb740762d0 0x7feb740787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb84001170 tx=0x7feb84009040 comp rx=0 tx=0).stop 2024-05-09T00:13:17.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.224+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 msgr2=0x7feb8c04a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.224+0000 7feb88c00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 0x7feb8c04a4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c530 tx=0x7feb8000c9f0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.225+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 shutdown_connections 2024-05-09T00:13:17.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.225+0000 7feb88c00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7feb740762d0 0x7feb740787e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.225+0000 7feb88c00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb8c0dc600 0x7feb8c175570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.225+0000 7feb88c00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb8c04b4f0 0x7feb8c04a4d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.225+0000 7feb88c00640 1 --2- 172.21.15.114:0/1059970966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8c046380 0x7feb8c178de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.225+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 >> 172.21.15.114:0/1059970966 conn(0x7feb8c006090 msgr2=0x7feb8c0de5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.226+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 shutdown_connections 2024-05-09T00:13:17.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.226+0000 7feb88c00640 1 -- 172.21.15.114:0/1059970966 wait complete. 2024-05-09T00:13:17.281 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-05-09T00:13:17.281 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T00:13:17.281 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:13:17.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:17.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-09T00:13:17.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.817+0000 7f96a6c00640 1 Processor -- start 2024-05-09T00:13:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.817+0000 7f96a6c00640 1 -- start start 2024-05-09T00:13:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a6c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96a00aba00 0x7f96a00accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a6c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a00ad340 con 0x7f96a01566f0 2024-05-09T00:13:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a6c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a0155f10 con 0x7f96a0156b00 2024-05-09T00:13:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a6c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f96a0156260 con 0x7f96a00aba00 2024-05-09T00:13:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a4e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f96a01566f0 0x7f96a00ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52988/0 (socket says 172.21.15.114:52988) 2024-05-09T00:13:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a4e00640 1 -- 172.21.15.114:0/2622395370 learned_addr learned my addr 172.21.15.114:0/2622395370 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.819+0000 7f96a5800640 1 --2- 172.21.15.114:0/2622395370 >> v2:172.21.15.153:3300/0 conn(0x7f96a00aba00 0x7f96a00accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.820+0000 7f969fe00640 1 -- 172.21.15.114:0/2622395370 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563053776 0 0) 0x7f96a00ad340 con 0x7f96a01566f0 2024-05-09T00:13:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.820+0000 7f969fe00640 1 -- 172.21.15.114:0/2622395370 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a01566f0 2024-05-09T00:13:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.820+0000 7f96a5800640 1 -- 172.21.15.114:0/2622395370 >> v1:172.21.15.153:6789/0 conn(0x7f96a0156b00 legacy=0x7f96a00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.820+0000 7f96a5800640 1 -- 172.21.15.114:0/2622395370 >> v1:172.21.15.114:6789/0 conn(0x7f96a01566f0 legacy=0x7f96a00ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.820+0000 7f96a5800640 1 -- 172.21.15.114:0/2622395370 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00c4f40 con 0x7f96a00aba00 2024-05-09T00:13:17.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.821+0000 7f96a5800640 1 --2- 172.21.15.114:0/2622395370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a00aba00 0x7f96a00accb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96940097a0 tx=0x7f969402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14648b13583b84b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.822+0000 7f969fe00640 1 -- 172.21.15.114:0/2622395370 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694037070 con 0x7f96a00aba00 2024-05-09T00:13:17.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.822+0000 7f969fe00640 1 -- 172.21.15.114:0/2622395370 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9694032440 con 0x7f96a00aba00 2024-05-09T00:13:17.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.822+0000 7f969fe00640 1 -- 172.21.15.114:0/2622395370 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694032810 con 0x7f96a00aba00 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 -- 172.21.15.114:0/2622395370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a00aba00 msgr2=0x7f96a00accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2622395370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a00aba00 0x7f96a00accb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96940097a0 tx=0x7f969402a230 comp rx=0 tx=0).stop 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 -- 172.21.15.114:0/2622395370 shutdown_connections 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2622395370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a00aba00 0x7f96a00accb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 -- 172.21.15.114:0/2622395370 >> 172.21.15.114:0/2622395370 conn(0x7f96a00c9730 msgr2=0x7f96a00c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 -- 172.21.15.114:0/2622395370 shutdown_connections 2024-05-09T00:13:17.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.823+0000 7f96a6c00640 1 -- 172.21.15.114:0/2622395370 wait complete. 2024-05-09T00:13:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.825+0000 7f96a6c00640 1 Processor -- start 2024-05-09T00:13:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.825+0000 7f96a6c00640 1 -- start start 2024-05-09T00:13:17.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a00aba00 0x7f96a013aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 0x7f96a0073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a0156b00 0x7f96a0152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f96a013e830 con 0x7f96a01566f0 2024-05-09T00:13:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00c4920 con 0x7f96a0156b00 2024-05-09T00:13:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f96a013e9b0 con 0x7f96a00aba00 2024-05-09T00:13:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 0x7f96a0073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 0x7f96a0073a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42528/0 (socket says 172.21.15.114:42528) 2024-05-09T00:13:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a4e00640 1 -- 172.21.15.114:0/2062449167 learned_addr learned my addr 172.21.15.114:0/2062449167 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.827+0000 7f96a6200640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a0156b00 0x7f96a0152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a4e00640 1 -- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a00aba00 msgr2=0x7f96a013aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a4e00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a00aba00 0x7f96a013aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a4e00640 1 -- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a0156b00 msgr2=0x7f96a0152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a4e00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a0156b00 0x7f96a0152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a4e00640 1 -- 172.21.15.114:0/2062449167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a0159df0 con 0x7f96a01566f0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a4e00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 0x7f96a0073a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c3c0 tx=0x7f968c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c017070 con 0x7f96a01566f0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c005d00 con 0x7f96a01566f0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c007310 con 0x7f96a01566f0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a01f1aa0 con 0x7f96a01566f0 2024-05-09T00:13:17.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.828+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a015a0b0 con 0x7f96a01566f0 2024-05-09T00:13:17.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.830+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0078430 con 0x7f96a01566f0 2024-05-09T00:13:17.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.834+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f968c01a070 con 0x7f96a01566f0 2024-05-09T00:13:17.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.835+0000 7f969d600640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9680076320 0x7f9680078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.835+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f968c096c20 con 0x7f96a01566f0 2024-05-09T00:13:17.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.836+0000 7f96a5800640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9680076320 0x7f9680078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.837+0000 7f96a5800640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9680076320 0x7f9680078830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9694034000 tx=0x7f969402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:17.842+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f968c05fba0 con 0x7f96a01566f0 2024-05-09T00:13:18.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.301+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96a00748d0 con 0x7f96a01566f0 2024-05-09T00:13:18.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.303+0000 7f969d600640 1 -- 172.21.15.114:0/2062449167 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f968c0681e0 con 0x7f96a01566f0 2024-05-09T00:13:18.301 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:18.302 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9680076320 msgr2=0x7f9680078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9680076320 0x7f9680078830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9694034000 tx=0x7f969402c000 comp rx=0 tx=0).stop 2024-05-09T00:13:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 msgr2=0x7f96a0073a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 0x7f96a0073a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c3c0 tx=0x7f968c00c880 comp rx=0 tx=0).stop 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 shutdown_connections 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9680076320 0x7f9680078830 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a0156b00 0x7f96a0152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96a01566f0 0x7f96a0073a10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 --2- 172.21.15.114:0/2062449167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a00aba00 0x7f96a013aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.308+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 >> 172.21.15.114:0/2062449167 conn(0x7f96a00c9730 msgr2=0x7f96a006fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.309+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 shutdown_connections 2024-05-09T00:13:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.310+0000 7f96a6c00640 1 -- 172.21.15.114:0/2062449167 wait complete. 2024-05-09T00:13:18.343 INFO:tasks.mds_thrash.fs.[b]:kill mds.b (rank=0) 2024-05-09T00:13:18.344 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T00:13:18.344 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:13:18.415 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T00:13:18.416 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:18.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.799+0000 7fc70fe00640 1 Processor -- start 2024-05-09T00:13:18.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.799+0000 7fc70fe00640 1 -- start start 2024-05-09T00:13:18.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.801+0000 7fc70fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc708072890 0x7fc708159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:18.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.802+0000 7fc70fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70815a190 con 0x7fc708072d50 2024-05-09T00:13:18.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.802+0000 7fc70fe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70815fe20 con 0x7fc708160600 2024-05-09T00:13:18.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.802+0000 7fc70fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc708160170 con 0x7fc708072890 2024-05-09T00:13:18.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.804+0000 7fc70de00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc708160600 0x7fc7080c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:51102/0 (socket says 172.21.15.114:51102) 2024-05-09T00:13:18.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.804+0000 7fc70de00640 1 -- 172.21.15.114:0/1452021904 learned_addr learned my addr 172.21.15.114:0/1452021904 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:18.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.804+0000 7fc70ca00640 1 --2- 172.21.15.114:0/1452021904 >> v2:172.21.15.114:3300/0 conn(0x7fc708072890 0x7fc708159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:18.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.807+0000 7fc70ca00640 1 -- 172.21.15.114:0/1452021904 >> v1:172.21.15.153:6789/0 conn(0x7fc708160600 legacy=0x7fc7080c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.807+0000 7fc707e00640 1 -- 172.21.15.114:0/1452021904 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341316096 0 0) 0x7fc70815fe20 con 0x7fc708160600 2024-05-09T00:13:18.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.808+0000 7fc70ca00640 1 -- 172.21.15.114:0/1452021904 >> v1:172.21.15.114:6789/0 conn(0x7fc708072d50 legacy=0x7fc7080c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.808+0000 7fc70ca00640 1 -- 172.21.15.114:0/1452021904 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70815d1b0 con 0x7fc708072890 2024-05-09T00:13:18.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.811+0000 7fc70ca00640 1 --2- 172.21.15.114:0/1452021904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072890 0x7fc708159c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40097a0 tx=0x7fc6f402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61edde24877090bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:18.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.814+0000 7fc707e00640 1 -- 172.21.15.114:0/1452021904 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4037070 con 0x7fc708072890 2024-05-09T00:13:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.814+0000 7fc707e00640 1 -- 172.21.15.114:0/1452021904 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f402ad30 con 0x7fc708072890 2024-05-09T00:13:18.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.814+0000 7fc707e00640 1 -- 172.21.15.114:0/1452021904 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4037070 con 0x7fc708072890 2024-05-09T00:13:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.816+0000 7fc70fe00640 1 -- 172.21.15.114:0/1452021904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072890 msgr2=0x7fc708159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.816+0000 7fc70fe00640 1 --2- 172.21.15.114:0/1452021904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072890 0x7fc708159c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40097a0 tx=0x7fc6f402a0a0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.817+0000 7fc70fe00640 1 -- 172.21.15.114:0/1452021904 shutdown_connections 2024-05-09T00:13:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.817+0000 7fc70fe00640 1 --2- 172.21.15.114:0/1452021904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072890 0x7fc708159c50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.817+0000 7fc70fe00640 1 -- 172.21.15.114:0/1452021904 >> 172.21.15.114:0/1452021904 conn(0x7fc70806c680 msgr2=0x7fc70806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.818+0000 7fc70fe00640 1 -- 172.21.15.114:0/1452021904 shutdown_connections 2024-05-09T00:13:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.818+0000 7fc70fe00640 1 -- 172.21.15.114:0/1452021904 wait complete. 2024-05-09T00:13:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.821+0000 7fc70fe00640 1 Processor -- start 2024-05-09T00:13:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.821+0000 7fc70fe00640 1 -- start start 2024-05-09T00:13:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc708072890 0x7fc7080ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 0x7fc7080c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc708160600 0x7fc708151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc7080c6760 con 0x7fc708072d50 2024-05-09T00:13:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7080c42e0 con 0x7fc708072890 2024-05-09T00:13:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc7080c68e0 con 0x7fc708160600 2024-05-09T00:13:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.823+0000 7fc70de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc708160600 0x7fc708151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.824+0000 7fc70ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 0x7fc7080c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.824+0000 7fc70ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 0x7fc7080c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42548/0 (socket says 172.21.15.114:42548) 2024-05-09T00:13:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.824+0000 7fc70ca00640 1 -- 172.21.15.114:0/2303248534 learned_addr learned my addr 172.21.15.114:0/2303248534 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.824+0000 7fc70ca00640 1 -- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc708160600 msgr2=0x7fc708151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.824+0000 7fc70d400640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc708072890 0x7fc7080ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70ca00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc708160600 0x7fc708151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70ca00640 1 -- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc708072890 msgr2=0x7fc7080ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70ca00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc708072890 0x7fc7080ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70ca00640 1 -- 172.21.15.114:0/2303248534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7080af450 con 0x7fc708072d50 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70d400640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc708072890 0x7fc7080ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70de00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc708160600 0x7fc708151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.825+0000 7fc70ca00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 0x7fc7080c8690 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009890 tx=0x7fc6f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.826+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4037050 con 0x7fc708072d50 2024-05-09T00:13:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.826+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f4043070 con 0x7fc708072d50 2024-05-09T00:13:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.826+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f403e8b0 con 0x7fc708072d50 2024-05-09T00:13:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.827+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7080c30d0 con 0x7fc708072d50 2024-05-09T00:13:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.828+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7080af120 con 0x7fc708072d50 2024-05-09T00:13:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.829+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc708077430 con 0x7fc708072d50 2024-05-09T00:13:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.830+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6f402ab50 con 0x7fc708072d50 2024-05-09T00:13:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.831+0000 7fc705600640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6e8076350 0x7fc6e8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:18.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.834+0000 7fc70d400640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6e8076350 0x7fc6e8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:18.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.834+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7fc6f407d910 con 0x7fc708072d50 2024-05-09T00:13:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.835+0000 7fc70d400640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6e8076350 0x7fc6e8078860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7000012e0 tx=0x7fc700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:18.841+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6f404d020 con 0x7fc708072d50 2024-05-09T00:13:19.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.411+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc70815d800 con 0x7fc708072d50 2024-05-09T00:13:19.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.412+0000 7fc705600640 1 -- 172.21.15.114:0/2303248534 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7fc6f4081a20 con 0x7fc708072d50 2024-05-09T00:13:19.411 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:19.411 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:19.412 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.416+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6e8076350 msgr2=0x7fc6e8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.416+0000 7fc70fe00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6e8076350 0x7fc6e8078860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7000012e0 tx=0x7fc700009040 comp rx=0 tx=0).stop 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 msgr2=0x7fc7080c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 0x7fc7080c8690 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009890 tx=0x7fc6f40046c0 comp rx=0 tx=0).stop 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 shutdown_connections 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6e8076350 0x7fc6e8078860 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc708160600 0x7fc708151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc708072d50 0x7fc7080c8690 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:19.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 --2- 172.21.15.114:0/2303248534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc708072890 0x7fc7080ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:19.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 >> 172.21.15.114:0/2303248534 conn(0x7fc70806c680 msgr2=0x7fc70815a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:19.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.417+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 shutdown_connections 2024-05-09T00:13:19.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:19.418+0000 7fc70fe00640 1 -- 172.21.15.114:0/2303248534 wait complete. 2024-05-09T00:13:19.464 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T00:13:21.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:21.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.924+0000 7f1e71a00640 1 Processor -- start 2024-05-09T00:13:21.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.924+0000 7f1e71a00640 1 -- start start 2024-05-09T00:13:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.927+0000 7f1e71a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072d50 0x7f1e6c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.927+0000 7f1e71a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e6c072890 0x7f1e6c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.927+0000 7f1e71a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6c0c4ca0 con 0x7f1e6c160600 2024-05-09T00:13:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.927+0000 7f1e71a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6c160170 con 0x7f1e6c072890 2024-05-09T00:13:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.927+0000 7f1e71a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6c15a190 con 0x7f1e6c072d50 2024-05-09T00:13:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.928+0000 7f1e6a000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e6c072890 0x7f1e6c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.928+0000 7f1e6b400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e6c160600 0x7f1e6c0c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:51116/0 (socket says 172.21.15.114:51116) 2024-05-09T00:13:21.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.928+0000 7f1e6b400640 1 -- 172.21.15.114:0/1210027761 learned_addr learned my addr 172.21.15.114:0/1210027761 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:21.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.928+0000 7f1e6aa00640 1 --2- 172.21.15.114:0/1210027761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072d50 0x7f1e6c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:21.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.929+0000 7f1e6aa00640 1 -- 172.21.15.114:0/1210027761 >> v2:172.21.15.153:3300/0 conn(0x7f1e6c072890 msgr2=0x7f1e6c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:21.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.929+0000 7f1e6aa00640 1 --2- 172.21.15.114:0/1210027761 >> v2:172.21.15.153:3300/0 conn(0x7f1e6c072890 0x7f1e6c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:21.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.929+0000 7f1e6aa00640 1 -- 172.21.15.114:0/1210027761 >> v1:172.21.15.153:6789/0 conn(0x7f1e6c160600 legacy=0x7f1e6c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:21.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.929+0000 7f1e6aa00640 1 -- 172.21.15.114:0/1210027761 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c15fe20 con 0x7f1e6c072d50 2024-05-09T00:13:21.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.930+0000 7f1e6aa00640 1 --2- 172.21.15.114:0/1210027761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072d50 0x7f1e6c0c4760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097a0 tx=0x7f1e5c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=181b1ae556999138 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:21.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.931+0000 7f1e69600640 1 -- 172.21.15.114:0/1210027761 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c037070 con 0x7f1e6c072d50 2024-05-09T00:13:21.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.931+0000 7f1e69600640 1 -- 172.21.15.114:0/1210027761 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c032440 con 0x7f1e6c072d50 2024-05-09T00:13:21.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.931+0000 7f1e69600640 1 -- 172.21.15.114:0/1210027761 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c02ae60 con 0x7f1e6c072d50 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 -- 172.21.15.114:0/1210027761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072d50 msgr2=0x7f1e6c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 --2- 172.21.15.114:0/1210027761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072d50 0x7f1e6c0c4760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097a0 tx=0x7f1e5c02a110 comp rx=0 tx=0).stop 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 -- 172.21.15.114:0/1210027761 shutdown_connections 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 --2- 172.21.15.114:0/1210027761 >> v2:172.21.15.153:3300/0 conn(0x7f1e6c072890 0x7f1e6c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 --2- 172.21.15.114:0/1210027761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072d50 0x7f1e6c0c4760 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097a0 tx=0x7f1e5c02a110 comp rx=0 tx=0).stop 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 -- 172.21.15.114:0/1210027761 >> 172.21.15.114:0/1210027761 conn(0x7f1e6c06c680 msgr2=0x7f1e6c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.932+0000 7f1e71a00640 1 -- 172.21.15.114:0/1210027761 shutdown_connections 2024-05-09T00:13:21.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.933+0000 7f1e71a00640 1 -- 172.21.15.114:0/1210027761 wait complete. 2024-05-09T00:13:21.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.936+0000 7f1e71a00640 1 Processor -- start 2024-05-09T00:13:21.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.936+0000 7f1e71a00640 1 -- start start 2024-05-09T00:13:21.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.938+0000 7f1e71a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072890 0x7f1e6c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:21.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e71a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e6c160600 0x7f1e6c15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:21.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e71a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 0x7f1e6c1f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:21.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e71a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c0c42e0 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e71a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c15d490 con 0x7f1e6c160600 2024-05-09T00:13:21.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e71a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6c0c6760 con 0x7f1e6c072890 2024-05-09T00:13:21.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e6b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 0x7f1e6c1f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:21.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e6b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 0x7f1e6c1f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42562/0 (socket says 172.21.15.114:42562) 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.939+0000 7f1e6b400640 1 -- 172.21.15.114:0/3659589211 learned_addr learned my addr 172.21.15.114:0/3659589211 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6aa00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072890 0x7f1e6c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6b400640 1 -- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072890 msgr2=0x7f1e6c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6b400640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072890 0x7f1e6c1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6b400640 1 -- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e6c160600 msgr2=0x7f1e6c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6b400640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e6c160600 0x7f1e6c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6b400640 1 -- 172.21.15.114:0/3659589211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c150b50 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.940+0000 7f1e6b400640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 0x7f1e6c1f6110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400ce00 tx=0x7f1e6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:21.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.941+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64017070 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.941+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6400ad40 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.941+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012640 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.941+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6c150670 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.943+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e6c150f70 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.944+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e6401a070 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.945+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e6c077430 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.946+0000 7f1e62a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1e4c076320 0x7f1e4c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:21.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.946+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f1e64097350 con 0x7f1e6c1f5d00 2024-05-09T00:13:21.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.946+0000 7f1e6aa00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1e4c076320 0x7f1e4c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:21.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.947+0000 7f1e6aa00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1e4c076320 0x7f1e4c078830 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c034000 tx=0x7f1e5c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:21.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:21.951+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1e64060270 con 0x7f1e6c1f5d00 2024-05-09T00:13:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.426+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e6c0c6ec0 con 0x7f1e6c1f5d00 2024-05-09T00:13:22.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.428+0000 7f1e62a00640 1 -- 172.21.15.114:0/3659589211 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f1e64064570 con 0x7f1e6c1f5d00 2024-05-09T00:13:22.426 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:22.427 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:22.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.435+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1e4c076320 msgr2=0x7f1e4c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:22.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.435+0000 7f1e71a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1e4c076320 0x7f1e4c078830 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c034000 tx=0x7f1e5c02e000 comp rx=0 tx=0).stop 2024-05-09T00:13:22.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.436+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 msgr2=0x7f1e6c1f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:22.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.436+0000 7f1e71a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 0x7f1e6c1f6110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400ce00 tx=0x7f1e6400a430 comp rx=0 tx=0).stop 2024-05-09T00:13:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.438+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 shutdown_connections 2024-05-09T00:13:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.438+0000 7f1e71a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1e4c076320 0x7f1e4c078830 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.438+0000 7f1e71a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e6c1f5d00 0x7f1e6c1f6110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.438+0000 7f1e71a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e6c160600 0x7f1e6c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.438+0000 7f1e71a00640 1 --2- 172.21.15.114:0/3659589211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e6c072890 0x7f1e6c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.438+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 >> 172.21.15.114:0/3659589211 conn(0x7f1e6c06c680 msgr2=0x7f1e6c15a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:22.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.439+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 shutdown_connections 2024-05-09T00:13:22.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:22.439+0000 7f1e71a00640 1 -- 172.21.15.114:0/3659589211 wait complete. 2024-05-09T00:13:22.489 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T00:13:23.383 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T00:13:23.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.779+0000 7fa154600640 1 Processor -- start 2024-05-09T00:13:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.779+0000 7fa154600640 1 -- start start 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.780+0000 7fa154600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c1586e0 0x7fa14c06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.780+0000 7fa154600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 0x7fa14c06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.780+0000 7fa154600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa14c154730 0x7fa14c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.780+0000 7fa154600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c0c54c0 con 0x7fa14c0af300 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa154600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c073bc0 con 0x7fa14c154730 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa154600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c158c30 con 0x7fa14c1586e0 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa151200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 0x7fa14c06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa151c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c1586e0 0x7fa14c06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa151200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 0x7fa14c06f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42564/0 (socket says 172.21.15.114:42564) 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa151200640 1 -- 172.21.15.114:0/2394734775 learned_addr learned my addr 172.21.15.114:0/2394734775 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa152600640 1 --2- 172.21.15.114:0/2394734775 >> v2:172.21.15.153:3300/0 conn(0x7fa14c154730 0x7fa14c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa151c00640 1 -- 172.21.15.114:0/2394734775 >> v2:172.21.15.153:3300/0 conn(0x7fa14c154730 msgr2=0x7fa14c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.781+0000 7fa151c00640 1 --2- 172.21.15.114:0/2394734775 >> v2:172.21.15.153:3300/0 conn(0x7fa14c154730 0x7fa14c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.782+0000 7fa151c00640 1 -- 172.21.15.114:0/2394734775 >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 msgr2=0x7fa14c06f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.782+0000 7fa151c00640 1 --2- 172.21.15.114:0/2394734775 >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 0x7fa14c06f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.782+0000 7fa151c00640 1 -- 172.21.15.114:0/2394734775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c073600 con 0x7fa14c1586e0 2024-05-09T00:13:23.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.782+0000 7fa151200640 1 --2- 172.21.15.114:0/2394734775 >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 0x7fa14c06f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.786+0000 7fa151c00640 1 --2- 172.21.15.114:0/2394734775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c1586e0 0x7fa14c06f3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0aedf0 tx=0x7fa14002c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3821106024f0da45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.786+0000 7fa14be00640 1 -- 172.21.15.114:0/2394734775 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140038070 con 0x7fa14c1586e0 2024-05-09T00:13:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.786+0000 7fa14be00640 1 -- 172.21.15.114:0/2394734775 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa140031710 con 0x7fa14c1586e0 2024-05-09T00:13:23.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.786+0000 7fa14be00640 1 -- 172.21.15.114:0/2394734775 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140031ae0 con 0x7fa14c1586e0 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 -- 172.21.15.114:0/2394734775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c1586e0 msgr2=0x7fa14c06f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 --2- 172.21.15.114:0/2394734775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c1586e0 0x7fa14c06f3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0aedf0 tx=0x7fa14002c490 comp rx=0 tx=0).stop 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 -- 172.21.15.114:0/2394734775 shutdown_connections 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 --2- 172.21.15.114:0/2394734775 >> v2:172.21.15.153:3300/0 conn(0x7fa14c154730 0x7fa14c154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 --2- 172.21.15.114:0/2394734775 >> v2:172.21.15.114:3300/0 conn(0x7fa14c0af300 0x7fa14c06f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 --2- 172.21.15.114:0/2394734775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c1586e0 0x7fa14c06f3a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.787+0000 7fa154600640 1 -- 172.21.15.114:0/2394734775 >> 172.21.15.114:0/2394734775 conn(0x7fa14c06c680 msgr2=0x7fa14c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.788+0000 7fa154600640 1 -- 172.21.15.114:0/2394734775 shutdown_connections 2024-05-09T00:13:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.788+0000 7fa154600640 1 -- 172.21.15.114:0/2394734775 wait complete. 2024-05-09T00:13:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.791+0000 7fa154600640 1 Processor -- start 2024-05-09T00:13:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.791+0000 7fa154600640 1 -- start start 2024-05-09T00:13:23.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.793+0000 7fa154600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c0af300 0x7fa14c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.793+0000 7fa154600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa14c154730 0x7fa14c149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.793+0000 7fa154600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa14c1586e0 0x7fa14c1eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.793+0000 7fa154600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c151f70 con 0x7fa14c1586e0 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.793+0000 7fa154600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c06fe20 con 0x7fa14c154730 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.793+0000 7fa154600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c1520f0 con 0x7fa14c0af300 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.794+0000 7fa151200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa14c154730 0x7fa14c149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.794+0000 7fa151200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa14c154730 0x7fa14c149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:51522/0 (socket says 172.21.15.114:51522) 2024-05-09T00:13:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.794+0000 7fa151200640 1 -- 172.21.15.114:0/2032138330 learned_addr learned my addr 172.21.15.114:0/2032138330 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.794+0000 7fa152600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa14c1586e0 0x7fa14c1eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.794+0000 7fa151c00640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c0af300 0x7fa14c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.795+0000 7fa152600640 1 -- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c0af300 msgr2=0x7fa14c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.795+0000 7fa152600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c0af300 0x7fa14c0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.795+0000 7fa152600640 1 -- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa14c154730 msgr2=0x7fa14c149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.795+0000 7fa152600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa14c154730 0x7fa14c149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.795+0000 7fa152600640 1 -- 172.21.15.114:0/2032138330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c1f2940 con 0x7fa14c1586e0 2024-05-09T00:13:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.795+0000 7fa151c00640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c0af300 0x7fa14c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:23.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.796+0000 7fa152600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa14c1586e0 0x7fa14c1eebd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa14400ccb0 tx=0x7fa14400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.797+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14400ce60 con 0x7fa14c1586e0 2024-05-09T00:13:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.798+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa144003990 con 0x7fa14c1586e0 2024-05-09T00:13:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.798+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144003d60 con 0x7fa14c1586e0 2024-05-09T00:13:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.798+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c1f2c20 con 0x7fa14c1586e0 2024-05-09T00:13:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.798+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c123140 con 0x7fa14c1586e0 2024-05-09T00:13:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.806+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa128005290 con 0x7fa14c1586e0 2024-05-09T00:13:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.807+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa144003f00 con 0x7fa14c1586e0 2024-05-09T00:13:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.808+0000 7fa149600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa12c076320 0x7fa12c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.809+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7fa144097c00 con 0x7fa14c1586e0 2024-05-09T00:13:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.817+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa14409d020 con 0x7fa14c1586e0 2024-05-09T00:13:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.820+0000 7fa151c00640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa12c076320 0x7fa12c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:23.822+0000 7fa151c00640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa12c076320 0x7fa12c078830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa140035000 tx=0x7fa140008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-09T00:13:24.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.329+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa128005850 con 0x7fa14c1586e0 2024-05-09T00:13:24.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.330+0000 7fa149600640 1 -- 172.21.15.114:0/2032138330 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7fa144014030 con 0x7fa14c1586e0 2024-05-09T00:13:24.332 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:24.332 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:24.332 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:24.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.335+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa12c076320 msgr2=0x7fa12c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.335+0000 7fa154600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa12c076320 0x7fa12c078830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa140035000 tx=0x7fa140008030 comp rx=0 tx=0).stop 2024-05-09T00:13:24.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.335+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa14c1586e0 msgr2=0x7fa14c1eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.335+0000 7fa154600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa14c1586e0 0x7fa14c1eebd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa14400ccb0 tx=0x7fa14400a5c0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.335+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 shutdown_connections 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.335+0000 7fa154600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa12c076320 0x7fa12c078830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.336+0000 7fa154600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa14c1586e0 0x7fa14c1eebd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.336+0000 7fa154600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa14c154730 0x7fa14c149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.336+0000 7fa154600640 1 --2- 172.21.15.114:0/2032138330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa14c0af300 0x7fa14c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.336+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 >> 172.21.15.114:0/2032138330 conn(0x7fa14c06c680 msgr2=0x7fa14c0c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.336+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 shutdown_connections 2024-05-09T00:13:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.336+0000 7fa154600640 1 -- 172.21.15.114:0/2032138330 wait complete. 2024-05-09T00:13:24.382 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:13:24.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.844+0000 7f3364a00640 1 Processor -- start 2024-05-09T00:13:24.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.845+0000 7f3364a00640 1 -- start start 2024-05-09T00:13:24.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.849+0000 7f3364a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33600706b0 0x7f336006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.849+0000 7f3364a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3360155170 con 0x7f3360151f30 2024-05-09T00:13:24.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.849+0000 7f3364a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3360155450 con 0x7f33600c9910 2024-05-09T00:13:24.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.849+0000 7f3364a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33600c4900 con 0x7f33600706b0 2024-05-09T00:13:24.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.849+0000 7f335de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3360151f30 0x7f33600c7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53006/0 (socket says 172.21.15.114:53006) 2024-05-09T00:13:24.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.849+0000 7f335de00640 1 -- 172.21.15.114:0/996207763 learned_addr learned my addr 172.21.15.114:0/996207763 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:24.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.850+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466936420 0 0) 0x7f3360155170 con 0x7f3360151f30 2024-05-09T00:13:24.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.850+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3344003520 con 0x7f3360151f30 2024-05-09T00:13:24.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.850+0000 7f335e800640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33600706b0 0x7f336006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 38523114 0 0) 0x7f3344003520 con 0x7f3360151f30 2024-05-09T00:13:24.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33600706b0 msgr2=0x7f336006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33600706b0 0x7f336006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 >> v1:172.21.15.153:6789/0 conn(0x7f33600c9910 legacy=0x7f33600c67d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33600c4be0 con 0x7f3360151f30 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f3358001a70 con 0x7f3360151f30 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 >> v1:172.21.15.114:6789/0 conn(0x7f3360151f30 legacy=0x7f33600c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3344003a30 0x7f3344003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3344004800 0x7f3344004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33440051c0 0x7f334400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f33600c4900 con 0x7f33440051c0 2024-05-09T00:13:24.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3344010550 con 0x7f3344004800 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.851+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3344010750 con 0x7f3344003a30 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.852+0000 7f335de00640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3344003a30 0x7f3344003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.853+0000 7f335e800640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33440051c0 0x7f334400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.853+0000 7f335e800640 1 -- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3344003a30 msgr2=0x7f3344003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.853+0000 7f335e800640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3344003a30 0x7f3344003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.853+0000 7f335e800640 1 -- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3344004800 msgr2=0x7f3344004c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.853+0000 7f335e800640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3344004800 0x7f3344004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.853+0000 7f335e800640 1 -- 172.21.15.114:0/996207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3344003520 con 0x7f33440051c0 2024-05-09T00:13:24.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.855+0000 7f335e800640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33440051c0 0x7f334400b9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f33600c66c0 tx=0x7f3344005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b500629584b6f5a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.856+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c036070 con 0x7f33440051c0 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.856+0000 7f335ca00640 1 -- 172.21.15.114:0/996207763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c031400 con 0x7f33440051c0 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.857+0000 7f3364a00640 1 -- 172.21.15.114:0/996207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33440051c0 msgr2=0x7f334400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.857+0000 7f3364a00640 1 --2- 172.21.15.114:0/996207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33440051c0 0x7f334400b9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f33600c66c0 tx=0x7f3344005830 comp rx=0 tx=0).stop 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.858+0000 7f335e800640 1 -- 172.21.15.114:0/996207763 reap_dead start 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.858+0000 7f3364a00640 1 -- 172.21.15.114:0/996207763 shutdown_connections 2024-05-09T00:13:24.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.858+0000 7f3364a00640 1 -- 172.21.15.114:0/996207763 >> 172.21.15.114:0/996207763 conn(0x7f33600c9d40 msgr2=0x7f33600ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.859+0000 7f3364a00640 1 -- 172.21.15.114:0/996207763 shutdown_connections 2024-05-09T00:13:24.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.859+0000 7f3364a00640 1 -- 172.21.15.114:0/996207763 wait complete. 2024-05-09T00:13:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.864+0000 7f3364a00640 1 Processor -- start 2024-05-09T00:13:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.864+0000 7f3364a00640 1 -- start start 2024-05-09T00:13:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.867+0000 7f3364a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33440051c0 0x7f3360150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.867+0000 7f3364a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360158230 0x7f3360073b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.867+0000 7f3364a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 0x7f3360155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.868+0000 7f3364a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f33600c7060 con 0x7f3360158230 2024-05-09T00:13:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.868+0000 7f3364a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33600c6ee0 con 0x7f33600740c0 2024-05-09T00:13:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.868+0000 7f3364a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33600c41c0 con 0x7f33440051c0 2024-05-09T00:13:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.869+0000 7f335e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 0x7f3360155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.869+0000 7f335e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 0x7f3360155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:51540/0 (socket says 172.21.15.114:51540) 2024-05-09T00:13:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.869+0000 7f335e800640 1 -- 172.21.15.114:0/860557842 learned_addr learned my addr 172.21.15.114:0/860557842 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.869+0000 7f335de00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33440051c0 0x7f3360150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.869+0000 7f335e800640 1 -- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33440051c0 msgr2=0x7f3360150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.869+0000 7f335e800640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33440051c0 0x7f3360150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.870+0000 7f335e800640 1 -- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360158230 msgr2=0x7f3360073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.870+0000 7f335d400640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360158230 0x7f3360073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.870+0000 7f335e800640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360158230 0x7f3360073b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.870+0000 7f335e800640 1 -- 172.21.15.114:0/860557842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3360157680 con 0x7f33600740c0 2024-05-09T00:13:24.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.871+0000 7f335d400640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360158230 0x7f3360073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:24.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.871+0000 7f335e800640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 0x7f3360155a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3360158d20 tx=0x7f334c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.871+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c036040 con 0x7f33600740c0 2024-05-09T00:13:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.872+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3360151230 con 0x7f33600740c0 2024-05-09T00:13:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.872+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33600ae2b0 con 0x7f33600740c0 2024-05-09T00:13:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.872+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c043070 con 0x7f33600740c0 2024-05-09T00:13:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.873+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c009650 con 0x7f33600740c0 2024-05-09T00:13:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.873+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3338005290 con 0x7f33600740c0 2024-05-09T00:13:24.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.880+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f334c031400 con 0x7f33600740c0 2024-05-09T00:13:24.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.883+0000 7f3356000640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33400762d0 0x7f33400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.883+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f334c0b8dd0 con 0x7f33600740c0 2024-05-09T00:13:24.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.884+0000 7f335de00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33400762d0 0x7f33400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.885+0000 7f335de00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33400762d0 0x7f33400787e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f33580013d0 tx=0x7f3358006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:24.893+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f334c0044e0 con 0x7f33600740c0 2024-05-09T00:13:25.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.311+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3338005580 con 0x7f33600740c0 2024-05-09T00:13:25.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.314+0000 7f3356000640 1 -- 172.21.15.114:0/860557842 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f334c082220 con 0x7f33600740c0 2024-05-09T00:13:25.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:25.313 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:25.313 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33400762d0 msgr2=0x7f33400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33400762d0 0x7f33400787e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f33580013d0 tx=0x7f3358006040 comp rx=0 tx=0).stop 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 msgr2=0x7f3360155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 0x7f3360155a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3360158d20 tx=0x7f334c004730 comp rx=0 tx=0).stop 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 shutdown_connections 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33400762d0 0x7f33400787e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33600740c0 0x7f3360155a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360158230 0x7f3360073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 --2- 172.21.15.114:0/860557842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33440051c0 0x7f3360150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 >> 172.21.15.114:0/860557842 conn(0x7f33600c9d40 msgr2=0x7f33600c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 shutdown_connections 2024-05-09T00:13:25.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:25.317+0000 7f3364a00640 1 -- 172.21.15.114:0/860557842 wait complete. 2024-05-09T00:13:25.341 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T00:13:26.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:26.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.827+0000 7f1b6da00640 1 Processor -- start 2024-05-09T00:13:26.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.827+0000 7f1b6da00640 1 -- start start 2024-05-09T00:13:26.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.829+0000 7f1b6da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b6815c7a0 0x7f1b680c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.829+0000 7f1b6da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b680c6630 0x7f1b68167120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.829+0000 7f1b6da00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b68072ed0 con 0x7f1b68159ff0 2024-05-09T00:13:26.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.829+0000 7f1b6da00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1b68160100 con 0x7f1b6815c7a0 2024-05-09T00:13:26.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.829+0000 7f1b6da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1b680731b0 con 0x7f1b680c6630 2024-05-09T00:13:26.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.830+0000 7f1b67400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b680c6630 0x7f1b68167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:26.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.830+0000 7f1b66a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1b68159ff0 0x7f1b68160590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53018/0 (socket says 172.21.15.114:53018) 2024-05-09T00:13:26.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.830+0000 7f1b66a00640 1 -- 172.21.15.114:0/3670382566 learned_addr learned my addr 172.21.15.114:0/3670382566 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:26.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.831+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045495345 0 0) 0x7f1b68072ed0 con 0x7f1b68159ff0 2024-05-09T00:13:26.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.831+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b4c003520 con 0x7f1b68159ff0 2024-05-09T00:13:26.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1984467902 0 0) 0x7f1b4c003520 con 0x7f1b68159ff0 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b680c6630 msgr2=0x7f1b68167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b680c6630 0x7f1b68167120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 >> v2:172.21.15.153:3300/0 conn(0x7f1b6815c7a0 msgr2=0x7f1b680c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 --2- 172.21.15.114:0/3670382566 >> v2:172.21.15.153:3300/0 conn(0x7f1b6815c7a0 0x7f1b680c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6815fd90 con 0x7f1b68159ff0 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f1b58001710 con 0x7f1b68159ff0 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 >> v1:172.21.15.114:6789/0 conn(0x7f1b68159ff0 legacy=0x7f1b68160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4c0039b0 0x7f1b4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c004800 0x7f1b4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68160100 con 0x7f1b4c004800 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b680731b0 con 0x7f1b4c0051c0 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c00c1c0 con 0x7f1b4c0039b0 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.832+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4c0039b0 0x7f1b4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:26.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66000640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c004800 0x7f1b4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:26.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66a00640 1 -- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4c0051c0 msgr2=0x7f1b4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:26.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:26.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66a00640 1 -- 172.21.15.114:0/3670382566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c004800 msgr2=0x7f1b4c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:26.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c004800 0x7f1b4c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:26.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66a00640 1 -- 172.21.15.114:0/3670382566 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6815fd90 con 0x7f1b4c0039b0 2024-05-09T00:13:26.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.833+0000 7f1b66000640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c004800 0x7f1b4c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.838+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4c0039b0 0x7f1b4c003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b68072160 tx=0x7f1b4c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2c2aae089bbfdf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.839+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58036070 con 0x7f1b4c0039b0 2024-05-09T00:13:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.839+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b58005ad0 con 0x7f1b4c0039b0 2024-05-09T00:13:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.839+0000 7f1b65600640 1 -- 172.21.15.114:0/3670382566 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58007e30 con 0x7f1b4c0039b0 2024-05-09T00:13:26.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.840+0000 7f1b6da00640 1 -- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4c0039b0 msgr2=0x7f1b4c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.840+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3670382566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4c0039b0 0x7f1b4c003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b68072160 tx=0x7f1b4c005830 comp rx=0 tx=0).stop 2024-05-09T00:13:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.840+0000 7f1b67400640 1 -- 172.21.15.114:0/3670382566 reap_dead start 2024-05-09T00:13:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.840+0000 7f1b6da00640 1 -- 172.21.15.114:0/3670382566 shutdown_connections 2024-05-09T00:13:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.840+0000 7f1b6da00640 1 -- 172.21.15.114:0/3670382566 >> 172.21.15.114:0/3670382566 conn(0x7f1b6806c680 msgr2=0x7f1b6806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.841+0000 7f1b6da00640 1 -- 172.21.15.114:0/3670382566 shutdown_connections 2024-05-09T00:13:26.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.841+0000 7f1b6da00640 1 -- 172.21.15.114:0/3670382566 wait complete. 2024-05-09T00:13:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.844+0000 7f1b6da00640 1 Processor -- start 2024-05-09T00:13:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.844+0000 7f1b6da00640 1 -- start start 2024-05-09T00:13:26.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.846+0000 7f1b6da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c0039b0 0x7f1b68157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.846+0000 7f1b6da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68156c40 0x7f1b6814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.846+0000 7f1b6da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b68148790 0x7f1b68148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.846+0000 7f1b6da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6806d480 con 0x7f1b4c0039b0 2024-05-09T00:13:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.846+0000 7f1b6da00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b680c5760 con 0x7f1b68148790 2024-05-09T00:13:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.846+0000 7f1b6da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1b68072950 con 0x7f1b68156c40 2024-05-09T00:13:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b67400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b68148790 0x7f1b68148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b67400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b68148790 0x7f1b68148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:51576/0 (socket says 172.21.15.114:51576) 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b67400640 1 -- 172.21.15.114:0/3307988140 learned_addr learned my addr 172.21.15.114:0/3307988140 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c0039b0 0x7f1b68157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b66a00640 1 -- 172.21.15.114:0/3307988140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68156c40 msgr2=0x7f1b6814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68156c40 0x7f1b6814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b66a00640 1 -- 172.21.15.114:0/3307988140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b68148790 msgr2=0x7f1b68148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b68148790 0x7f1b68148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:26.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.847+0000 7f1b66a00640 1 -- 172.21.15.114:0/3307988140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b681591e0 con 0x7f1b4c0039b0 2024-05-09T00:13:26.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.848+0000 7f1b66a00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c0039b0 0x7f1b68157a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1b58030000 tx=0x7f1b58001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:26.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.848+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58041020 con 0x7f1b4c0039b0 2024-05-09T00:13:26.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.848+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b58007280 con 0x7f1b4c0039b0 2024-05-09T00:13:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.849+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b68159480 con 0x7f1b4c0039b0 2024-05-09T00:13:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.849+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b68148270 con 0x7f1b4c0039b0 2024-05-09T00:13:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.849+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58036030 con 0x7f1b4c0039b0 2024-05-09T00:13:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.850+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b40005290 con 0x7f1b4c0039b0 2024-05-09T00:13:26.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.852+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b58044020 con 0x7f1b4c0039b0 2024-05-09T00:13:26.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.853+0000 7f1b5ea00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b480762d0 0x7f1b480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:26.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.853+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f1b580b7da0 con 0x7f1b4c0039b0 2024-05-09T00:13:26.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.854+0000 7f1b66000640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b480762d0 0x7f1b480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:26.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.855+0000 7f1b66000640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b480762d0 0x7f1b480787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b6814fb00 tx=0x7f1b54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:26.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:26.860+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b58080bb0 con 0x7f1b4c0039b0 2024-05-09T00:13:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.271+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b40005580 con 0x7f1b4c0039b0 2024-05-09T00:13:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.272+0000 7f1b5ea00640 1 -- 172.21.15.114:0/3307988140 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f1b58084eb0 con 0x7f1b4c0039b0 2024-05-09T00:13:27.271 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:27.271 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b480762d0 msgr2=0x7f1b480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b480762d0 0x7f1b480787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b6814fb00 tx=0x7f1b54008040 comp rx=0 tx=0).stop 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c0039b0 msgr2=0x7f1b68157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c0039b0 0x7f1b68157a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1b58030000 tx=0x7f1b58001a90 comp rx=0 tx=0).stop 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 shutdown_connections 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b480762d0 0x7f1b480787e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b68148790 0x7f1b68148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68156c40 0x7f1b6814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 --2- 172.21.15.114:0/3307988140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b4c0039b0 0x7f1b68157a80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 >> 172.21.15.114:0/3307988140 conn(0x7f1b6806c680 msgr2=0x7f1b680c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 shutdown_connections 2024-05-09T00:13:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.276+0000 7f1b6da00640 1 -- 172.21.15.114:0/3307988140 wait complete. 2024-05-09T00:13:27.322 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:13:27.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.870+0000 7f9c76200640 1 Processor -- start 2024-05-09T00:13:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.870+0000 7f9c76200640 1 -- start start 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.872+0000 7f9c76200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c70072d50 0x7f9c700c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.872+0000 7f9c76200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c700c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.872+0000 7f9c76200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c700c4ca0 con 0x7f9c70072890 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.872+0000 7f9c76200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9c70160170 con 0x7f9c70072d50 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.872+0000 7f9c76200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c7015fe20 con 0x7f9c70160600 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.873+0000 7f9c6ea00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c70072890 0x7f9c70159c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:53772/0 (socket says 172.21.15.114:53772) 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.873+0000 7f9c6ea00640 1 -- 172.21.15.114:0/3489863246 learned_addr learned my addr 172.21.15.114:0/3489863246 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.873+0000 7f9c6fe00640 1 --2- 172.21.15.114:0/3489863246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c700c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.873+0000 7f9c6f400640 1 --2- 172.21.15.114:0/3489863246 >> v2:172.21.15.114:3300/0 conn(0x7f9c70072d50 0x7f9c700c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.874+0000 7f9c6f400640 1 -- 172.21.15.114:0/3489863246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 msgr2=0x7f9c700c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.874+0000 7f9c6f400640 1 --2- 172.21.15.114:0/3489863246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c700c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.874+0000 7f9c6f400640 1 -- 172.21.15.114:0/3489863246 >> v1:172.21.15.153:6789/0 conn(0x7f9c70072890 legacy=0x7f9c70159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:27.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.874+0000 7f9c6f400640 1 -- 172.21.15.114:0/3489863246 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7015d1b0 con 0x7f9c70072d50 2024-05-09T00:13:27.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.875+0000 7f9c6f400640 1 --2- 172.21.15.114:0/3489863246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c700c4760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9c600097a0 tx=0x7f9c6002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6963b18e7c5e48 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:27.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.875+0000 7f9c6e000640 1 -- 172.21.15.114:0/3489863246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60037070 con 0x7f9c70072d50 2024-05-09T00:13:27.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.875+0000 7f9c6e000640 1 -- 172.21.15.114:0/3489863246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6002ae50 con 0x7f9c70072d50 2024-05-09T00:13:27.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.875+0000 7f9c6e000640 1 -- 172.21.15.114:0/3489863246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60032660 con 0x7f9c70072d50 2024-05-09T00:13:27.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 -- 172.21.15.114:0/3489863246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 msgr2=0x7f9c700c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:27.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 --2- 172.21.15.114:0/3489863246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c700c4760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9c600097a0 tx=0x7f9c6002a100 comp rx=0 tx=0).stop 2024-05-09T00:13:27.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 -- 172.21.15.114:0/3489863246 shutdown_connections 2024-05-09T00:13:27.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 --2- 172.21.15.114:0/3489863246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c700c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 --2- 172.21.15.114:0/3489863246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c700c4760 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 -- 172.21.15.114:0/3489863246 >> 172.21.15.114:0/3489863246 conn(0x7f9c7006c680 msgr2=0x7f9c7006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:27.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 -- 172.21.15.114:0/3489863246 shutdown_connections 2024-05-09T00:13:27.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.876+0000 7f9c76200640 1 -- 172.21.15.114:0/3489863246 wait complete. 2024-05-09T00:13:27.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.879+0000 7f9c76200640 1 Processor -- start 2024-05-09T00:13:27.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.879+0000 7f9c76200640 1 -- start start 2024-05-09T00:13:27.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c76200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c70072890 0x7f9c70151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:27.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c76200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c70157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:27.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c76200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c701576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:27.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c76200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70160a10 con 0x7f9c70072d50 2024-05-09T00:13:27.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c76200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c700c42e0 con 0x7f9c70072890 2024-05-09T00:13:27.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c76200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c70160b90 con 0x7f9c70160600 2024-05-09T00:13:27.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c6ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c70157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c6ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c70157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56308/0 (socket says 172.21.15.114:56308) 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c70072890 0x7f9c70151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.881+0000 7f9c6ea00640 1 -- 172.21.15.114:0/2555533768 learned_addr learned my addr 172.21.15.114:0/2555533768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.882+0000 7f9c6fe00640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c701576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.882+0000 7f9c6ea00640 1 -- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 msgr2=0x7f9c701576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.882+0000 7f9c6ea00640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c701576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.882+0000 7f9c6ea00640 1 -- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c70072890 msgr2=0x7f9c70151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:27.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.882+0000 7f9c6ea00640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c70072890 0x7f9c70151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:27.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.882+0000 7f9c6ea00640 1 -- 172.21.15.114:0/2555533768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7015f430 con 0x7f9c70072d50 2024-05-09T00:13:27.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.883+0000 7f9c6ea00640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c70157190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c370 tx=0x7f9c5c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:27.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.883+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c017070 con 0x7f9c70072d50 2024-05-09T00:13:27.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.883+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5c005ce0 con 0x7f9c70072d50 2024-05-09T00:13:27.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.883+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0072f0 con 0x7f9c70072d50 2024-05-09T00:13:27.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.884+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c70154e60 con 0x7f9c70072d50 2024-05-09T00:13:27.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.884+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c70158660 con 0x7f9c70072d50 2024-05-09T00:13:27.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.886+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c70150060 con 0x7f9c70072d50 2024-05-09T00:13:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.890+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c5c01a070 con 0x7f9c70072d50 2024-05-09T00:13:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.892+0000 7f9c67400640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9c500763d0 0x7f9c500788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.892+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f9c5c096dd0 con 0x7f9c70072d50 2024-05-09T00:13:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.892+0000 7f9c6f400640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9c500763d0 0x7f9c500788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:27.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.900+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c5c09a030 con 0x7f9c70072d50 2024-05-09T00:13:27.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:27.901+0000 7f9c6f400640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9c500763d0 0x7f9c500788e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c60034000 tx=0x7f9c6002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:28.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.458+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c70077430 con 0x7f9c70072d50 2024-05-09T00:13:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.460+0000 7f9c67400640 1 -- 172.21.15.114:0/2555533768 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f9c5c0602a0 con 0x7f9c70072d50 2024-05-09T00:13:28.459 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:28.463 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:28.463 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:28.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.469+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9c500763d0 msgr2=0x7f9c500788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:28.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.469+0000 7f9c76200640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9c500763d0 0x7f9c500788e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c60034000 tx=0x7f9c6002e000 comp rx=0 tx=0).stop 2024-05-09T00:13:28.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.472+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 msgr2=0x7f9c70157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:28.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.473+0000 7f9c76200640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c70157190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c370 tx=0x7f9c5c00c830 comp rx=0 tx=0).stop 2024-05-09T00:13:28.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.473+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 shutdown_connections 2024-05-09T00:13:28.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.473+0000 7f9c76200640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9c500763d0 0x7f9c500788e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:28.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.473+0000 7f9c76200640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c70160600 0x7f9c701576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:28.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.474+0000 7f9c76200640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c70072d50 0x7f9c70157190 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:28.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.474+0000 7f9c76200640 1 --2- 172.21.15.114:0/2555533768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c70072890 0x7f9c70151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:28.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.474+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 >> 172.21.15.114:0/2555533768 conn(0x7f9c7006c680 msgr2=0x7f9c7006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:28.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.474+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 shutdown_connections 2024-05-09T00:13:28.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:28.475+0000 7f9c76200640 1 -- 172.21.15.114:0/2555533768 wait complete. 2024-05-09T00:13:28.596 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T00:13:29.323 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:29.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.680+0000 7f8ffe000640 1 Processor -- start 2024-05-09T00:13:29.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.680+0000 7f8ffe000640 1 -- start start 2024-05-09T00:13:29.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffe000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ff80c8730 0x7f8ff8155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffe000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 0x7f8ff80cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffe000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff8158e80 con 0x7f8ff8158a70 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffe000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff80b3460 con 0x7f8ff80c8730 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffe000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff815b630 con 0x7f8ff80cb800 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffd600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 0x7f8ff80cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffcc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ff80c8730 0x7f8ff8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffd600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 0x7f8ff80cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:36684/0 (socket says 172.21.15.114:36684) 2024-05-09T00:13:29.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.682+0000 7f8ffd600640 1 -- 172.21.15.114:0/152662556 learned_addr learned my addr 172.21.15.114:0/152662556 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:29.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.683+0000 7f8ffd600640 1 -- 172.21.15.114:0/152662556 >> v2:172.21.15.153:3300/0 conn(0x7f8ff80c8730 msgr2=0x7f8ff8155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:29.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.683+0000 7f8ffd600640 1 --2- 172.21.15.114:0/152662556 >> v2:172.21.15.153:3300/0 conn(0x7f8ff80c8730 0x7f8ff8155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:29.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.683+0000 7f8ffd600640 1 -- 172.21.15.114:0/152662556 >> v1:172.21.15.114:6789/0 conn(0x7f8ff8158a70 legacy=0x7f8ff80ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:29.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.683+0000 7f8ffd600640 1 -- 172.21.15.114:0/152662556 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff808f550 con 0x7f8ff80cb800 2024-05-09T00:13:29.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.685+0000 7f8ffd600640 1 --2- 172.21.15.114:0/152662556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 0x7f8ff80cbc10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ff815b7b0 tx=0x7f8ff002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=510ad2da77081c63 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:29.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.686+0000 7f8ff7400640 1 -- 172.21.15.114:0/152662556 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0036070 con 0x7f8ff80cb800 2024-05-09T00:13:29.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.686+0000 7f8ff7400640 1 -- 172.21.15.114:0/152662556 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff0031600 con 0x7f8ff80cb800 2024-05-09T00:13:29.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.686+0000 7f8ff7400640 1 -- 172.21.15.114:0/152662556 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00319d0 con 0x7f8ff80cb800 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 -- 172.21.15.114:0/152662556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 msgr2=0x7f8ff80cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 --2- 172.21.15.114:0/152662556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 0x7f8ff80cbc10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ff815b7b0 tx=0x7f8ff002a5f0 comp rx=0 tx=0).stop 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 -- 172.21.15.114:0/152662556 shutdown_connections 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 --2- 172.21.15.114:0/152662556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80cb800 0x7f8ff80cbc10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 --2- 172.21.15.114:0/152662556 >> v2:172.21.15.153:3300/0 conn(0x7f8ff80c8730 0x7f8ff8155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 -- 172.21.15.114:0/152662556 >> 172.21.15.114:0/152662556 conn(0x7f8ff80af450 msgr2=0x7f8ff80af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 -- 172.21.15.114:0/152662556 shutdown_connections 2024-05-09T00:13:29.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.687+0000 7f8ffe000640 1 -- 172.21.15.114:0/152662556 wait complete. 2024-05-09T00:13:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.690+0000 7f8ffe000640 1 Processor -- start 2024-05-09T00:13:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.690+0000 7f8ffe000640 1 -- start start 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ffe000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80c8730 0x7f8ff81eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ffe000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 0x7f8ff81542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ffe000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff8158a70 0x7f8ff80b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ffe000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff815bb60 con 0x7f8ff80cb800 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ffe000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff815c1b0 con 0x7f8ff8158a70 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ffe000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff815be40 con 0x7f8ff80c8730 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ff7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 0x7f8ff81542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ff7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 0x7f8ff81542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56310/0 (socket says 172.21.15.114:56310) 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.691+0000 7f8ff7e00640 1 -- 172.21.15.114:0/2748489954 learned_addr learned my addr 172.21.15.114:0/2748489954 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.692+0000 7f8ffcc00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80c8730 0x7f8ff81eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.692+0000 7f8ff7e00640 1 -- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80c8730 msgr2=0x7f8ff81eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.692+0000 7f8ff7e00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80c8730 0x7f8ff81eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.692+0000 7f8ff7e00640 1 -- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff8158a70 msgr2=0x7f8ff80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.692+0000 7f8ff7e00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff8158a70 0x7f8ff80b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.692+0000 7f8ff7e00640 1 -- 172.21.15.114:0/2748489954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff81ee520 con 0x7f8ff80cb800 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.693+0000 7f8ff7e00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 0x7f8ff81542f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4001eb0 tx=0x7f8fe400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.693+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4017070 con 0x7f8ff80cb800 2024-05-09T00:13:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.693+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff81f2530 con 0x7f8ff80cb800 2024-05-09T00:13:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.693+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe40052d0 con 0x7f8ff80cb800 2024-05-09T00:13:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.693+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff81eeaa0 con 0x7f8ff80cb800 2024-05-09T00:13:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.693+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40037f0 con 0x7f8ff80cb800 2024-05-09T00:13:29.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.695+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd4005290 con 0x7f8ff80cb800 2024-05-09T00:13:29.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.697+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fe401a070 con 0x7f8ff80cb800 2024-05-09T00:13:29.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.699+0000 7f8ff4c00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8fd8076300 0x7f8fd8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:29.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.699+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f8fe4096b90 con 0x7f8ff80cb800 2024-05-09T00:13:29.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.700+0000 7f8ffcc00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8fd8076300 0x7f8fd8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:29.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.701+0000 7f8ffcc00640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8fd8076300 0x7f8fd8078810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80c0e90 tx=0x7f8fec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:29.713+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8fe405f990 con 0x7f8ff80cb800 2024-05-09T00:13:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.229+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fd4005580 con 0x7f8ff80cb800 2024-05-09T00:13:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.230+0000 7f8ff4c00640 1 -- 172.21.15.114:0/2748489954 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f8fe4064e20 con 0x7f8ff80cb800 2024-05-09T00:13:30.230 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:30.230 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:30.230 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:30.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.235+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8fd8076300 msgr2=0x7f8fd8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.235+0000 7f8ffe000640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8fd8076300 0x7f8fd8078810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80c0e90 tx=0x7f8fec008040 comp rx=0 tx=0).stop 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 msgr2=0x7f8ff81542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 0x7f8ff81542f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4001eb0 tx=0x7f8fe400c890 comp rx=0 tx=0).stop 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 shutdown_connections 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8fd8076300 0x7f8fd8078810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff8158a70 0x7f8ff80b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80cb800 0x7f8ff81542f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 --2- 172.21.15.114:0/2748489954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff80c8730 0x7f8ff81eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.236+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 >> 172.21.15.114:0/2748489954 conn(0x7f8ff80af450 msgr2=0x7f8ff8158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.237+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 shutdown_connections 2024-05-09T00:13:30.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:30.237+0000 7f8ffe000640 1 -- 172.21.15.114:0/2748489954 wait complete. 2024-05-09T00:13:30.286 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:13:30.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:31.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.016+0000 7fa684e00640 1 Processor -- start 2024-05-09T00:13:31.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.016+0000 7fa684e00640 1 -- start start 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa684e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6800aba00 0x7fa6800accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa684e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6800ad340 con 0x7fa6801566f0 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa684e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa680155f10 con 0x7fa680156b00 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa684e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa680156260 con 0x7fa6800aba00 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa67f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6800aba00 0x7fa6800accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa67f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6800aba00 0x7fa6800accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56314/0 (socket says 172.21.15.114:56314) 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa67f400640 1 -- 172.21.15.114:0/2472112565 learned_addr learned my addr 172.21.15.114:0/2472112565 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:31.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.018+0000 7fa67ea00640 1 --1- 172.21.15.114:0/2472112565 >> v1:172.21.15.114:6789/0 conn(0x7fa6801566f0 0x7fa6800ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50066/0 (socket says 172.21.15.114:50066) 2024-05-09T00:13:31.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.019+0000 7fa67f400640 1 -- 172.21.15.114:0/2472112565 >> v1:172.21.15.153:6789/0 conn(0x7fa680156b00 legacy=0x7fa6800aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.019+0000 7fa67f400640 1 -- 172.21.15.114:0/2472112565 >> v1:172.21.15.114:6789/0 conn(0x7fa6801566f0 legacy=0x7fa6800ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.019+0000 7fa67f400640 1 -- 172.21.15.114:0/2472112565 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800c4f40 con 0x7fa6800aba00 2024-05-09T00:13:31.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.019+0000 7fa67e000640 1 -- 172.21.15.114:0/2472112565 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507763822 0 0) 0x7fa6800ad340 con 0x7fa6801566f0 2024-05-09T00:13:31.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.020+0000 7fa67f400640 1 --2- 172.21.15.114:0/2472112565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6800aba00 0x7fa6800accb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa670009870 tx=0x7fa67002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31301bdbd6623ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:31.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.020+0000 7fa67e000640 1 -- 172.21.15.114:0/2472112565 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670037070 con 0x7fa6800aba00 2024-05-09T00:13:31.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.020+0000 7fa67e000640 1 -- 172.21.15.114:0/2472112565 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67002ae50 con 0x7fa6800aba00 2024-05-09T00:13:31.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.020+0000 7fa67e000640 1 -- 172.21.15.114:0/2472112565 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670032860 con 0x7fa6800aba00 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 -- 172.21.15.114:0/2472112565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6800aba00 msgr2=0x7fa6800accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 --2- 172.21.15.114:0/2472112565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6800aba00 0x7fa6800accb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa670009870 tx=0x7fa67002a300 comp rx=0 tx=0).stop 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 -- 172.21.15.114:0/2472112565 shutdown_connections 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 --2- 172.21.15.114:0/2472112565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6800aba00 0x7fa6800accb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 -- 172.21.15.114:0/2472112565 >> 172.21.15.114:0/2472112565 conn(0x7fa6800c9730 msgr2=0x7fa6800c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 -- 172.21.15.114:0/2472112565 shutdown_connections 2024-05-09T00:13:31.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.021+0000 7fa684e00640 1 -- 172.21.15.114:0/2472112565 wait complete. 2024-05-09T00:13:31.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.024+0000 7fa684e00640 1 Processor -- start 2024-05-09T00:13:31.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.024+0000 7fa684e00640 1 -- start start 2024-05-09T00:13:31.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.025+0000 7fa684e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6800aba00 0x7fa680159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:31.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.025+0000 7fa684e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6801566f0 0x7fa6800c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:31.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.025+0000 7fa684e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa680156b00 0x7fa68013b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:31.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.025+0000 7fa684e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa68013e830 con 0x7fa680156b00 2024-05-09T00:13:31.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.025+0000 7fa684e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6800c4920 con 0x7fa6800aba00 2024-05-09T00:13:31.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.025+0000 7fa684e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa68013e9b0 con 0x7fa6801566f0 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa680156b00 0x7fa68013b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6800aba00 0x7fa680159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6801566f0 0x7fa6800c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6800aba00 0x7fa680159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:45868/0 (socket says 172.21.15.114:45868) 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67f400640 1 -- 172.21.15.114:0/1863063351 learned_addr learned my addr 172.21.15.114:0/1863063351 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67fe00640 1 -- 172.21.15.114:0/1863063351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6801566f0 msgr2=0x7fa6800c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67fe00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6801566f0 0x7fa6800c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67fe00640 1 -- 172.21.15.114:0/1863063351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6800aba00 msgr2=0x7fa680159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67fe00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6800aba00 0x7fa680159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.026+0000 7fa67fe00640 1 -- 172.21.15.114:0/1863063351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800c8b10 con 0x7fa680156b00 2024-05-09T00:13:31.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.027+0000 7fa67fe00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa680156b00 0x7fa68013b620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c700 tx=0x7fa67800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:31.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.027+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678003b70 con 0x7fa680156b00 2024-05-09T00:13:31.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.027+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6800c7920 con 0x7fa680156b00 2024-05-09T00:13:31.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.027+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa678003d10 con 0x7fa680156b00 2024-05-09T00:13:31.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.027+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6780052d0 con 0x7fa680156b00 2024-05-09T00:13:31.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.027+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6800c8f60 con 0x7fa680156b00 2024-05-09T00:13:31.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.029+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa658005290 con 0x7fa680156b00 2024-05-09T00:13:31.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.030+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa678005470 con 0x7fa680156b00 2024-05-09T00:13:31.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.031+0000 7fa677400640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa6600762d0 0x7fa6600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:31.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.031+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7fa678097820 con 0x7fa680156b00 2024-05-09T00:13:31.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.031+0000 7fa67f400640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa6600762d0 0x7fa6600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:31.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.032+0000 7fa67f400640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa6600762d0 0x7fa6600787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa670035040 tx=0x7fa67002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:31.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.035+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa678060be0 con 0x7fa680156b00 2024-05-09T00:13:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.430+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa658005580 con 0x7fa680156b00 2024-05-09T00:13:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.432+0000 7fa677400640 1 -- 172.21.15.114:0/1863063351 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7fa6780604e0 con 0x7fa680156b00 2024-05-09T00:13:31.430 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:31.431 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:31.431 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.440+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa6600762d0 msgr2=0x7fa6600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa6600762d0 0x7fa6600787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa670035040 tx=0x7fa67002e000 comp rx=0 tx=0).stop 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa680156b00 msgr2=0x7fa68013b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa680156b00 0x7fa68013b620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c700 tx=0x7fa67800cbc0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 shutdown_connections 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa6600762d0 0x7fa6600787e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa680156b00 0x7fa68013b620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6801566f0 0x7fa6800c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 --2- 172.21.15.114:0/1863063351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6800aba00 0x7fa680159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.441+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 >> 172.21.15.114:0/1863063351 conn(0x7fa6800c9730 msgr2=0x7fa6800ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:31.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.445+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 shutdown_connections 2024-05-09T00:13:31.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:31.445+0000 7fa684e00640 1 -- 172.21.15.114:0/1863063351 wait complete. 2024-05-09T00:13:31.495 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T00:13:32.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:32.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.708+0000 7fa810000640 1 Processor -- start 2024-05-09T00:13:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.708+0000 7fa810000640 1 -- start start 2024-05-09T00:13:32.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.712+0000 7fa810000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8080730f0 0x7fa808151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.713+0000 7fa810000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa808151d60 0x7fa808157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.714+0000 7fa810000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8080c4880 con 0x7fa8080c5bb0 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.714+0000 7fa810000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa808073500 con 0x7fa8080730f0 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.714+0000 7fa810000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa808073730 con 0x7fa808151d60 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.714+0000 7fa80e000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa808151d60 0x7fa808157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.714+0000 7fa80e000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa808151d60 0x7fa808157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:45874/0 (socket says 172.21.15.114:45874) 2024-05-09T00:13:32.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.714+0000 7fa80e000640 1 -- 172.21.15.114:0/1576087203 learned_addr learned my addr 172.21.15.114:0/1576087203 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:32.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.715+0000 7fa80e000640 1 -- 172.21.15.114:0/1576087203 >> v2:172.21.15.114:3300/0 conn(0x7fa8080730f0 msgr2=0x7fa808151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:32.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.716+0000 7fa80cc00640 1 --2- 172.21.15.114:0/1576087203 >> v2:172.21.15.114:3300/0 conn(0x7fa8080730f0 0x7fa808151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:32.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.716+0000 7fa80e000640 1 --2- 172.21.15.114:0/1576087203 >> v2:172.21.15.114:3300/0 conn(0x7fa8080730f0 0x7fa808151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:32.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.716+0000 7fa80e000640 1 -- 172.21.15.114:0/1576087203 >> v1:172.21.15.114:6789/0 conn(0x7fa8080c5bb0 legacy=0x7fa8080c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:32.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.716+0000 7fa80e000640 1 -- 172.21.15.114:0/1576087203 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080c4b60 con 0x7fa808151d60 2024-05-09T00:13:32.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.719+0000 7fa80e000640 1 --2- 172.21.15.114:0/1576087203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa808151d60 0x7fa808157c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8080c5fc0 tx=0x7fa7f402e870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2552010f403fa4ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:32.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.721+0000 7fa807e00640 1 -- 172.21.15.114:0/1576087203 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f403d070 con 0x7fa808151d60 2024-05-09T00:13:32.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.721+0000 7fa807e00640 1 -- 172.21.15.114:0/1576087203 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f40356e0 con 0x7fa808151d60 2024-05-09T00:13:32.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.722+0000 7fa807e00640 1 -- 172.21.15.114:0/1576087203 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4035a90 con 0x7fa808151d60 2024-05-09T00:13:32.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.724+0000 7fa810000640 1 -- 172.21.15.114:0/1576087203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa808151d60 msgr2=0x7fa808157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:32.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.724+0000 7fa810000640 1 --2- 172.21.15.114:0/1576087203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa808151d60 0x7fa808157c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8080c5fc0 tx=0x7fa7f402e870 comp rx=0 tx=0).stop 2024-05-09T00:13:32.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.725+0000 7fa810000640 1 -- 172.21.15.114:0/1576087203 shutdown_connections 2024-05-09T00:13:32.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.725+0000 7fa810000640 1 --2- 172.21.15.114:0/1576087203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa808151d60 0x7fa808157c70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:32.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.725+0000 7fa810000640 1 --2- 172.21.15.114:0/1576087203 >> v2:172.21.15.114:3300/0 conn(0x7fa8080730f0 0x7fa808151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:32.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.725+0000 7fa810000640 1 -- 172.21.15.114:0/1576087203 >> 172.21.15.114:0/1576087203 conn(0x7fa80806c680 msgr2=0x7fa80806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:32.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.727+0000 7fa810000640 1 -- 172.21.15.114:0/1576087203 shutdown_connections 2024-05-09T00:13:32.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.728+0000 7fa810000640 1 -- 172.21.15.114:0/1576087203 wait complete. 2024-05-09T00:13:32.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.739+0000 7fa810000640 1 Processor -- start 2024-05-09T00:13:32.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.740+0000 7fa810000640 1 -- start start 2024-05-09T00:13:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.743+0000 7fa810000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 0x7fa8081de840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.743+0000 7fa810000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8080c5bb0 0x7fa8081e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.748+0000 7fa80d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 0x7fa8081de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:32.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.748+0000 7fa80d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 0x7fa8081de840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:36712/0 (socket says 172.21.15.114:36712) 2024-05-09T00:13:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.750+0000 7fa810000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa808151d60 0x7fa8081df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.750+0000 7fa80d600640 1 -- 172.21.15.114:0/3309372130 learned_addr learned my addr 172.21.15.114:0/3309372130 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.752+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080af6c0 con 0x7fa808151d60 2024-05-09T00:13:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.752+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080c5120 con 0x7fa8080c5bb0 2024-05-09T00:13:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.752+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080af840 con 0x7fa8080730f0 2024-05-09T00:13:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.752+0000 7fa80cc00640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8080c5bb0 0x7fa8081e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.754+0000 7fa80d600640 1 -- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8080c5bb0 msgr2=0x7fa8081e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.754+0000 7fa80e000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa808151d60 0x7fa8081df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.754+0000 7fa80d600640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8080c5bb0 0x7fa8081e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:32.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.754+0000 7fa80d600640 1 -- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa808151d60 msgr2=0x7fa8081df0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:32.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.755+0000 7fa80d600640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa808151d60 0x7fa8081df0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:32.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.755+0000 7fa80d600640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080ae590 con 0x7fa8080730f0 2024-05-09T00:13:32.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.755+0000 7fa80e000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa808151d60 0x7fa8081df0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:32.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.755+0000 7fa80d600640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 0x7fa8081de840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa80000b9e0 tx=0x7fa80000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:32.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.756+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800019070 con 0x7fa8080730f0 2024-05-09T00:13:32.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.757+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8080ae870 con 0x7fa8080730f0 2024-05-09T00:13:32.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.757+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8081de320 con 0x7fa8080730f0 2024-05-09T00:13:32.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.757+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80000cba0 con 0x7fa8080730f0 2024-05-09T00:13:32.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.757+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800014440 con 0x7fa8080730f0 2024-05-09T00:13:32.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.759+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e4005290 con 0x7fa8080730f0 2024-05-09T00:13:32.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.768+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa80001c070 con 0x7fa8080730f0 2024-05-09T00:13:32.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.770+0000 7fa805600640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7e80762d0 0x7fa7e80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:32.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.770+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7fa8000978d0 con 0x7fa8080730f0 2024-05-09T00:13:32.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.777+0000 7fa80cc00640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7e80762d0 0x7fa7e80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.779+0000 7fa80cc00640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7e80762d0 0x7fa7e80787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc006fd0 tx=0x7fa7fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:32.780+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa80003c020 con 0x7fa8080730f0 2024-05-09T00:13:33.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.369+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7e4005580 con 0x7fa8080730f0 2024-05-09T00:13:33.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.370+0000 7fa805600640 1 -- 172.21.15.114:0/3309372130 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7fa8000608e0 con 0x7fa8080730f0 2024-05-09T00:13:33.368 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:33.368 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:33.368 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.374+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7e80762d0 msgr2=0x7fa7e80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:33.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.374+0000 7fa810000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7e80762d0 0x7fa7e80787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc006fd0 tx=0x7fa7fc008040 comp rx=0 tx=0).stop 2024-05-09T00:13:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.375+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 msgr2=0x7fa8081de840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.375+0000 7fa810000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 0x7fa8081de840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa80000b9e0 tx=0x7fa80000bea0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.376+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 shutdown_connections 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.376+0000 7fa810000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa7e80762d0 0x7fa7e80787e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.376+0000 7fa810000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa808151d60 0x7fa8081df0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.376+0000 7fa810000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8080c5bb0 0x7fa8081e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.376+0000 7fa810000640 1 --2- 172.21.15.114:0/3309372130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8080730f0 0x7fa8081de840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.377+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 >> 172.21.15.114:0/3309372130 conn(0x7fa80806c680 msgr2=0x7fa80814e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.377+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 shutdown_connections 2024-05-09T00:13:33.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.377+0000 7fa810000640 1 -- 172.21.15.114:0/3309372130 wait complete. 2024-05-09T00:13:33.413 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:13:33.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.904+0000 7f8c5f800640 1 Processor -- start 2024-05-09T00:13:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.904+0000 7f8c5f800640 1 -- start start 2024-05-09T00:13:33.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.907+0000 7f8c5f800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c58159170 0x7f8c580b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.907+0000 7f8c5f800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c5815c360 0x7f8c580cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.907+0000 7f8c5f800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c580c8a50 con 0x7f8c580ce360 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.907+0000 7f8c5f800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5815c770 con 0x7f8c58159170 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.907+0000 7f8c5f800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8c580c8d30 con 0x7f8c5815c360 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c58159170 0x7f8c580b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c58159170 0x7f8c580b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56352/0 (socket says 172.21.15.114:56352) 2024-05-09T00:13:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 -- 172.21.15.114:0/3067323913 learned_addr learned my addr 172.21.15.114:0/3067323913 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:33.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c57e00640 1 --2- 172.21.15.114:0/3067323913 >> v2:172.21.15.153:3300/0 conn(0x7f8c5815c360 0x7f8c580cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:33.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 -- 172.21.15.114:0/3067323913 >> v2:172.21.15.153:3300/0 conn(0x7f8c5815c360 msgr2=0x7f8c580cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:33.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 --2- 172.21.15.114:0/3067323913 >> v2:172.21.15.153:3300/0 conn(0x7f8c5815c360 0x7f8c580cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 -- 172.21.15.114:0/3067323913 >> v1:172.21.15.114:6789/0 conn(0x7f8c580ce360 legacy=0x7f8c580cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:33.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.908+0000 7f8c5ce00640 1 -- 172.21.15.114:0/3067323913 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c580cbad0 con 0x7f8c58159170 2024-05-09T00:13:33.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.910+0000 7f8c5ce00640 1 --2- 172.21.15.114:0/3067323913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c58159170 0x7f8c580b2dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8c5808f670 tx=0x7f8c4c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c784579265acb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:33.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.911+0000 7f8c57400640 1 -- 172.21.15.114:0/3067323913 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c036070 con 0x7f8c58159170 2024-05-09T00:13:33.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.911+0000 7f8c57400640 1 -- 172.21.15.114:0/3067323913 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c031600 con 0x7f8c58159170 2024-05-09T00:13:33.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.911+0000 7f8c57400640 1 -- 172.21.15.114:0/3067323913 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0319d0 con 0x7f8c58159170 2024-05-09T00:13:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 -- 172.21.15.114:0/3067323913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c58159170 msgr2=0x7f8c580b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 --2- 172.21.15.114:0/3067323913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c58159170 0x7f8c580b2dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8c5808f670 tx=0x7f8c4c02a610 comp rx=0 tx=0).stop 2024-05-09T00:13:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 -- 172.21.15.114:0/3067323913 shutdown_connections 2024-05-09T00:13:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 --2- 172.21.15.114:0/3067323913 >> v2:172.21.15.153:3300/0 conn(0x7f8c5815c360 0x7f8c580cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 --2- 172.21.15.114:0/3067323913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c58159170 0x7f8c580b2dd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 -- 172.21.15.114:0/3067323913 >> 172.21.15.114:0/3067323913 conn(0x7f8c580af930 msgr2=0x7f8c580cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 -- 172.21.15.114:0/3067323913 shutdown_connections 2024-05-09T00:13:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.912+0000 7f8c5f800640 1 -- 172.21.15.114:0/3067323913 wait complete. 2024-05-09T00:13:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.914+0000 7f8c5f800640 1 Processor -- start 2024-05-09T00:13:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.915+0000 7f8c5f800640 1 -- start start 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c5f800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c580ce360 0x7f8c58156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c5f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 0x7f8c58150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c5f800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c5814ef00 0x7f8c58144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c5f800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c580c9fb0 con 0x7f8c5815c360 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c5f800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c580c9e30 con 0x7f8c580ce360 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c5f800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c580cc9e0 con 0x7f8c5814ef00 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.916+0000 7f8c57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 0x7f8c58150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 0x7f8c58150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56354/0 (socket says 172.21.15.114:56354) 2024-05-09T00:13:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 -- 172.21.15.114:0/530936404 learned_addr learned my addr 172.21.15.114:0/530936404 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c5d800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c5814ef00 0x7f8c58144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 -- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c5814ef00 msgr2=0x7f8c58144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c5814ef00 0x7f8c58144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 -- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c580ce360 msgr2=0x7f8c58156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c580ce360 0x7f8c58156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.917+0000 7f8c57e00640 1 -- 172.21.15.114:0/530936404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c58159b00 con 0x7f8c5815c360 2024-05-09T00:13:33.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.918+0000 7f8c57e00640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 0x7f8c58150ce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400e840 tx=0x7f8c4400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:33.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.918+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44017070 con 0x7f8c5815c360 2024-05-09T00:13:33.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.918+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4400c6d0 con 0x7f8c5815c360 2024-05-09T00:13:33.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.918+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4400cac0 con 0x7f8c5815c360 2024-05-09T00:13:33.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.920+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5814f560 con 0x7f8c5815c360 2024-05-09T00:13:33.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.920+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c581eecf0 con 0x7f8c5815c360 2024-05-09T00:13:33.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.921+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c58077430 con 0x7f8c5815c360 2024-05-09T00:13:33.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.923+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c4401a070 con 0x7f8c5815c360 2024-05-09T00:13:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.925+0000 7f8c54c00640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c38076300 0x7f8c38078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.925+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6838+0+0 (secure 0 0 0) 0x7f8c44097be0 con 0x7f8c5815c360 2024-05-09T00:13:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.925+0000 7f8c5ce00640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c38076300 0x7f8c38078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:33.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.926+0000 7f8c5ce00640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c38076300 0x7f8c38078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c033000 tx=0x7f8c4c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:33.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:33.930+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c44061030 con 0x7f8c5815c360 2024-05-09T00:13:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.553+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c58159720 con 0x7f8c5815c360 2024-05-09T00:13:34.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.554+0000 7f8c54c00640 1 -- 172.21.15.114:0/530936404 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6498 (secure 0 0 0) 0x7f8c44060930 con 0x7f8c5815c360 2024-05-09T00:13:34.555 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:34.555 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:11:27.994296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4523":{"gid":4523,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1585617173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1585617173},{"type":"v1","addr":"172.21.15.153:6835","nonce":1585617173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4523,"qdb_cluster":[4523]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:11:17.910761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":43,"addr":"172.21.15.153:6833/690310809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":690310809},{"type":"v1","addr":"172.21.15.153:6833","nonce":690310809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-05-09T00:13:34.555 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-05-09T00:13:34.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.559+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c38076300 msgr2=0x7f8c38078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:34.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.559+0000 7f8c5f800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c38076300 0x7f8c38078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c033000 tx=0x7f8c4c02e000 comp rx=0 tx=0).stop 2024-05-09T00:13:34.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.559+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 msgr2=0x7f8c58150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:34.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.559+0000 7f8c5f800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 0x7f8c58150ce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400e840 tx=0x7f8c4400ed00 comp rx=0 tx=0).stop 2024-05-09T00:13:34.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.560+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 shutdown_connections 2024-05-09T00:13:34.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.560+0000 7f8c5f800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c38076300 0x7f8c38078810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:34.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.560+0000 7f8c5f800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c5814ef00 0x7f8c58144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:34.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.560+0000 7f8c5f800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c5815c360 0x7f8c58150ce0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:34.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.560+0000 7f8c5f800640 1 --2- 172.21.15.114:0/530936404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c580ce360 0x7f8c58156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:34.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.560+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 >> 172.21.15.114:0/530936404 conn(0x7f8c580af930 msgr2=0x7f8c580cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:34.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.561+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 shutdown_connections 2024-05-09T00:13:34.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:34.561+0000 7f8c5f800640 1 -- 172.21.15.114:0/530936404 wait complete. 2024-05-09T00:13:34.603 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T00:13:35.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.845+0000 7f761e000640 1 Processor -- start 2024-05-09T00:13:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.845+0000 7f761e000640 1 -- start start 2024-05-09T00:13:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.849+0000 7f761e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76180bfbc0 0x7f7618158700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.849+0000 7f761e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76180aba00 0x7f76180abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.850+0000 7f761e000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76180ac350 con 0x7f76180c6b40 2024-05-09T00:13:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.850+0000 7f761e000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f76180c5e90 con 0x7f76180aba00 2024-05-09T00:13:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.850+0000 7f761e000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76181590d0 con 0x7f76180bfbc0 2024-05-09T00:13:35.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.852+0000 7f7617e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76180aba00 0x7f76180abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.852+0000 7f7616a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f76180c6b40 0x7f76181522e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50098/0 (socket says 172.21.15.114:50098) 2024-05-09T00:13:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.852+0000 7f7616a00640 1 -- 172.21.15.114:0/1151983923 learned_addr learned my addr 172.21.15.114:0/1151983923 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.853+0000 7f7617400640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76180bfbc0 0x7f7618158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.853+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439049121 0 0) 0x7f7604001110 con 0x7f76180c6b40 2024-05-09T00:13:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.854+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75fc003520 con 0x7f76180c6b40 2024-05-09T00:13:35.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.855+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3779816094 0 0) 0x7f75fc003520 con 0x7f76180c6b40 2024-05-09T00:13:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76180bfbc0 msgr2=0x7f7618158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76180bfbc0 0x7f7618158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 >> v2:172.21.15.114:3300/0 conn(0x7f76180aba00 msgr2=0x7f76180abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 --2- 172.21.15.114:0/1151983923 >> v2:172.21.15.114:3300/0 conn(0x7f76180aba00 0x7f76180abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76181593b0 con 0x7f76180c6b40 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f76040018c0 con 0x7f76180c6b40 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 >> v1:172.21.15.114:6789/0 conn(0x7f76180c6b40 legacy=0x7f76181522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc003a50 0x7f75fc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75fc004800 0x7f75fc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc005150 0x7f75fc0145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76180c5e90 con 0x7f75fc005150 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76181590d0 con 0x7f75fc003a50 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc009b60 con 0x7f75fc004800 2024-05-09T00:13:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.856+0000 7f7617e00640 1 --2- 172.21.15.114:0/1151983923 >> v2:172.21.15.114:3300/0 conn(0x7f76180aba00 0x7f76180abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.859+0000 7f7617400640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc003a50 0x7f75fc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.860+0000 7f7617e00640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc005150 0x7f75fc0145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.861+0000 7f7616a00640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75fc004800 0x7f75fc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7616a00640 1 -- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc003a50 msgr2=0x7f75fc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:35.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7616a00640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc003a50 0x7f75fc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7616a00640 1 -- 172.21.15.114:0/1151983923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc005150 msgr2=0x7f75fc0145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7616a00640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc005150 0x7f75fc0145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7616a00640 1 -- 172.21.15.114:0/1151983923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76181593b0 con 0x7f75fc004800 2024-05-09T00:13:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7617e00640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc005150 0x7f75fc0145c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.864+0000 7f7617400640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc003a50 0x7f75fc003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:35.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.866+0000 7f7616a00640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75fc004800 0x7f75fc004c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f760400c4c0 tx=0x7f75fc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea1284f923699d36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.873+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760400c0e0 con 0x7f75fc004800 2024-05-09T00:13:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.873+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604034070 con 0x7f75fc004800 2024-05-09T00:13:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.873+0000 7f7616000640 1 -- 172.21.15.114:0/1151983923 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604005d70 con 0x7f75fc004800 2024-05-09T00:13:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.875+0000 7f761e000640 1 -- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75fc004800 msgr2=0x7f75fc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.875+0000 7f761e000640 1 --2- 172.21.15.114:0/1151983923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75fc004800 0x7f75fc004c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f760400c4c0 tx=0x7f75fc005830 comp rx=0 tx=0).stop 2024-05-09T00:13:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.875+0000 7f7617e00640 1 -- 172.21.15.114:0/1151983923 reap_dead start 2024-05-09T00:13:35.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.876+0000 7f761e000640 1 -- 172.21.15.114:0/1151983923 shutdown_connections 2024-05-09T00:13:35.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.876+0000 7f761e000640 1 -- 172.21.15.114:0/1151983923 >> 172.21.15.114:0/1151983923 conn(0x7f76180c7170 msgr2=0x7f76180c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:35.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.877+0000 7f761e000640 1 -- 172.21.15.114:0/1151983923 shutdown_connections 2024-05-09T00:13:35.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.877+0000 7f761e000640 1 -- 172.21.15.114:0/1151983923 wait complete. 2024-05-09T00:13:35.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.882+0000 7f761e000640 1 Processor -- start 2024-05-09T00:13:35.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.883+0000 7f761e000640 1 -- start start 2024-05-09T00:13:35.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.885+0000 7f761e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc004800 0x7f76181ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.885+0000 7f761e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 0x7f76180c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.885+0000 7f761e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76181499d0 0x7f7618142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.885+0000 7f761e000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76180c6320 con 0x7f75fc004800 2024-05-09T00:13:35.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.885+0000 7f761e000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76180748d0 con 0x7f76181495c0 2024-05-09T00:13:35.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.885+0000 7f761e000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76180c64a0 con 0x7f76181499d0 2024-05-09T00:13:35.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.887+0000 7f7616a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 0x7f76180c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.888+0000 7f7616a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 0x7f76180c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:45908/0 (socket says 172.21.15.114:45908) 2024-05-09T00:13:35.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.888+0000 7f7617400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc004800 0x7f76181ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.888+0000 7f7616a00640 1 -- 172.21.15.114:0/3272521862 learned_addr learned my addr 172.21.15.114:0/3272521862 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:35.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.890+0000 7f7616a00640 1 -- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76181499d0 msgr2=0x7f7618142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:35.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.890+0000 7f7616a00640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76181499d0 0x7f7618142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:35.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.891+0000 7f7616a00640 1 -- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc004800 msgr2=0x7f76181ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:35.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.891+0000 7f7616a00640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc004800 0x7f76181ea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:35.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.891+0000 7f7616a00640 1 -- 172.21.15.114:0/3272521862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7618143810 con 0x7f76181495c0 2024-05-09T00:13:35.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.892+0000 7f7616a00640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 0x7f76180c8d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f760400c520 tx=0x7f7604001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:35.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.893+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604007070 con 0x7f76181495c0 2024-05-09T00:13:35.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.896+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604007210 con 0x7f76181495c0 2024-05-09T00:13:35.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.896+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040075c0 con 0x7f76181495c0 2024-05-09T00:13:35.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.896+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76180c97b0 con 0x7f76181495c0 2024-05-09T00:13:35.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.896+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76180c9d70 con 0x7f76181495c0 2024-05-09T00:13:35.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.898+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76180b0a10 con 0x7f76181495c0 2024-05-09T00:13:35.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.908+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f760402f480 con 0x7f76181495c0 2024-05-09T00:13:35.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.915+0000 7f760f400640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75f8076300 0x7f75f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.916+0000 7f7617400640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75f8076300 0x7f75f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.916+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f76040b88f0 con 0x7f76181495c0 2024-05-09T00:13:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.917+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f76180b0a10 con 0x7f76181495c0 2024-05-09T00:13:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:35.922+0000 7f7617400640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75f8076300 0x7f75f8078810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7610009670 tx=0x7f761000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:36.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.554+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7618077430 con 0x7f76181495c0 2024-05-09T00:13:36.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.556+0000 7f760f400640 1 -- 172.21.15.114:0/3272521862 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+4832 (secure 0 0 0) 0x7f76180ac350 con 0x7f76181495c0 2024-05-09T00:13:36.557 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:36.557 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:34.914590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:34.914591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:13:36.557 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 25 2024-05-09T00:13:36.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.565+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75f8076300 msgr2=0x7f75f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:36.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.565+0000 7f761e000640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75f8076300 0x7f75f8078810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7610009670 tx=0x7f761000b040 comp rx=0 tx=0).stop 2024-05-09T00:13:36.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.565+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 msgr2=0x7f76180c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:36.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.565+0000 7f761e000640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 0x7f76180c8d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f760400c520 tx=0x7f7604001a60 comp rx=0 tx=0).stop 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 shutdown_connections 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75f8076300 0x7f75f8078810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76181499d0 0x7f7618142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76181495c0 0x7f76180c8d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 --2- 172.21.15.114:0/3272521862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc004800 0x7f76181ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 >> 172.21.15.114:0/3272521862 conn(0x7f76180c7170 msgr2=0x7f7618151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 shutdown_connections 2024-05-09T00:13:36.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:36.568+0000 7f761e000640 1 -- 172.21.15.114:0/3272521862 wait complete. 2024-05-09T00:13:36.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:36.626 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-05-09T00:13:36.626 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T00:13:36.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:37.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.146+0000 7fb778c00640 1 Processor -- start 2024-05-09T00:13:37.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.146+0000 7fb778c00640 1 -- start start 2024-05-09T00:13:37.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.150+0000 7f8d16c00640 1 Processor -- start 2024-05-09T00:13:37.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.150+0000 7fb778c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb7740739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.150+0000 7fb778c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb774073f10 0x7fb7740c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.151+0000 7fb778c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb774074320 con 0x7fb7740c31b0 2024-05-09T00:13:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.151+0000 7fb772800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb774073f10 0x7fb7740c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.151+0000 7fb772800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb774073f10 0x7fb7740c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56390/0 (socket says 172.21.15.114:56390) 2024-05-09T00:13:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.151+0000 7fb772800640 1 -- 172.21.15.114:0/4268616151 learned_addr learned my addr 172.21.15.114:0/4268616151 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.153+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb77415c620 con 0x7fb774073f10 2024-05-09T00:13:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.153+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb77415ba10 con 0x7fb7740735c0 2024-05-09T00:13:37.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.150+0000 7f8d16c00640 1 -- start start 2024-05-09T00:13:37.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.156+0000 7fb771400640 1 --2- 172.21.15.114:0/4268616151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb7740739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.156+0000 7fb771400640 1 -- 172.21.15.114:0/4268616151 >> v2:172.21.15.114:3300/0 conn(0x7fb774073f10 msgr2=0x7fb7740c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:37.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.156+0000 7fb771400640 1 --2- 172.21.15.114:0/4268616151 >> v2:172.21.15.114:3300/0 conn(0x7fb774073f10 0x7fb7740c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.156+0000 7fb771400640 1 -- 172.21.15.114:0/4268616151 >> v1:172.21.15.153:6789/0 conn(0x7fb7740c31b0 legacy=0x7fb774158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:37.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.156+0000 7fb771400640 1 -- 172.21.15.114:0/4268616151 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77415bcf0 con 0x7fb7740735c0 2024-05-09T00:13:37.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.157+0000 7f8d16c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d10072890 0x7f8d10159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.157+0000 7f8d16c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1015a190 con 0x7f8d10160600 2024-05-09T00:13:37.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.159+0000 7f8d16c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1015fe20 con 0x7f8d10072d50 2024-05-09T00:13:37.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.160+0000 7f8d16c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8d10160170 con 0x7f8d10072890 2024-05-09T00:13:37.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.161+0000 7f8d14c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8d10160600 0x7f8d100c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50104/0 (socket says 172.21.15.114:50104) 2024-05-09T00:13:37.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.161+0000 7f8d14c00640 1 -- 172.21.15.114:0/4028342653 learned_addr learned my addr 172.21.15.114:0/4028342653 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:37.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.159+0000 7f8d0f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d10072890 0x7f8d10159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.163+0000 7fb771400640 1 --2- 172.21.15.114:0/4268616151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb7740739d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7640097a0 tx=0x7fb76402a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a89d647247e81919 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.164+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439409817 0 0) 0x7f8d1015a190 con 0x7f8d10160600 2024-05-09T00:13:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.164+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cf4003520 con 0x7f8d10160600 2024-05-09T00:13:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.164+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020238133 0 0) 0x7f8d1015fe20 con 0x7f8d10072d50 2024-05-09T00:13:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.164+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d1015a190 con 0x7f8d10072d50 2024-05-09T00:13:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.164+0000 7fb770a00640 1 -- 172.21.15.114:0/4268616151 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764037070 con 0x7fb7740735c0 2024-05-09T00:13:37.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.168+0000 7fb770a00640 1 -- 172.21.15.114:0/4268616151 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76402ae30 con 0x7fb7740735c0 2024-05-09T00:13:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.169+0000 7fb770a00640 1 -- 172.21.15.114:0/4268616151 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764037070 con 0x7fb7740735c0 2024-05-09T00:13:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.170+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 msgr2=0x7fb7740739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.170+0000 7fb778c00640 1 --2- 172.21.15.114:0/4268616151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb7740739d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7640097a0 tx=0x7fb76402a0e0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.165+0000 7f8d0f400640 1 -- 172.21.15.114:0/4028342653 >> v1:172.21.15.153:6789/0 conn(0x7f8d10072d50 legacy=0x7f8d100c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.165+0000 7f8d0f400640 1 -- 172.21.15.114:0/4028342653 >> v1:172.21.15.114:6789/0 conn(0x7f8d10160600 legacy=0x7f8d100c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.165+0000 7f8d0f400640 1 -- 172.21.15.114:0/4028342653 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1015d1b0 con 0x7f8d10072890 2024-05-09T00:13:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.173+0000 7f8d0f400640 1 --2- 172.21.15.114:0/4028342653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d10159c50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0097a0 tx=0x7f8cfc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d46c0ccab1e0889 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:37.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.174+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc037070 con 0x7f8d10072890 2024-05-09T00:13:37.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.175+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cfc032440 con 0x7f8d10072890 2024-05-09T00:13:37.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.175+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 shutdown_connections 2024-05-09T00:13:37.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.175+0000 7fb778c00640 1 --2- 172.21.15.114:0/4268616151 >> v2:172.21.15.114:3300/0 conn(0x7fb774073f10 0x7fb7740c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.175+0000 7fb778c00640 1 --2- 172.21.15.114:0/4268616151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb7740739d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.175+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 >> 172.21.15.114:0/4268616151 conn(0x7fb77406c680 msgr2=0x7fb77406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:37.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.176+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 shutdown_connections 2024-05-09T00:13:37.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.176+0000 7fb778c00640 1 -- 172.21.15.114:0/4268616151 wait complete. 2024-05-09T00:13:37.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.177+0000 7f8d0ea00640 1 -- 172.21.15.114:0/4028342653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc032810 con 0x7f8d10072890 2024-05-09T00:13:37.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.179+0000 7f8d16c00640 1 -- 172.21.15.114:0/4028342653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 msgr2=0x7f8d10159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.179+0000 7f8d16c00640 1 --2- 172.21.15.114:0/4028342653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d10159c50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0097a0 tx=0x7f8cfc02a1e0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.180+0000 7f8d16c00640 1 -- 172.21.15.114:0/4028342653 shutdown_connections 2024-05-09T00:13:37.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.180+0000 7f8d16c00640 1 --2- 172.21.15.114:0/4028342653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d10159c50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.180+0000 7f8d16c00640 1 -- 172.21.15.114:0/4028342653 >> 172.21.15.114:0/4028342653 conn(0x7f8d1006c680 msgr2=0x7f8d1006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:37.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.184+0000 7f8d16c00640 1 -- 172.21.15.114:0/4028342653 shutdown_connections 2024-05-09T00:13:37.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.185+0000 7fb778c00640 1 Processor -- start 2024-05-09T00:13:37.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.185+0000 7f8d16c00640 1 -- 172.21.15.114:0/4028342653 wait complete. 2024-05-09T00:13:37.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.190+0000 7fb778c00640 1 -- start start 2024-05-09T00:13:37.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb778c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb774155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb778c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 0x7fb774139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb778c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7740c31b0 0x7fb7740acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb778c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb7740c5f60 con 0x7fb774073f10 2024-05-09T00:13:37.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb778c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb77415c2b0 con 0x7fb7740c31b0 2024-05-09T00:13:37.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb778c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb7740c60e0 con 0x7fb7740735c0 2024-05-09T00:13:37.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.193+0000 7fb771400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 0x7fb774139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.194+0000 7f8d16c00640 1 Processor -- start 2024-05-09T00:13:37.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.194+0000 7fb771400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 0x7fb774139950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56394/0 (socket says 172.21.15.114:56394) 2024-05-09T00:13:37.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.194+0000 7fb771400640 1 -- 172.21.15.114:0/2272971924 learned_addr learned my addr 172.21.15.114:0/2272971924 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:37.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.194+0000 7fb772800640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7740c31b0 0x7fb7740acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.195+0000 7fb771e00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb774155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.195+0000 7fb771400640 1 -- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 msgr2=0x7fb774155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.195+0000 7fb771400640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb774155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.195+0000 7fb771400640 1 -- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7740c31b0 msgr2=0x7fb7740acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.195+0000 7fb771400640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7740c31b0 0x7fb7740acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.195+0000 7fb771400640 1 -- 172.21.15.114:0/2272971924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77415b380 con 0x7fb774073f10 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.196+0000 7fb771400640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 0x7fb774139950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb764000c00 tx=0x7fb7640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.196+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764041070 con 0x7fb774073f10 2024-05-09T00:13:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.194+0000 7f8d16c00640 1 -- start start 2024-05-09T00:13:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.197+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7741eee50 con 0x7fb774073f10 2024-05-09T00:13:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.197+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76403c460 con 0x7fb774073f10 2024-05-09T00:13:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.197+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb774154a10 con 0x7fb774073f10 2024-05-09T00:13:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.197+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764041070 con 0x7fb774073f10 2024-05-09T00:13:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.202+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb764044070 con 0x7fb774073f10 2024-05-09T00:13:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.203+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74c005290 con 0x7fb774073f10 2024-05-09T00:13:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.204+0000 7fb76a000640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb754076500 0x7fb754078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.205+0000 7f8d16c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d1015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.205+0000 7f8d16c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d10072d50 0x7f8d100c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.204+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fb764004480 con 0x7fb774073f10 2024-05-09T00:13:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.205+0000 7fb771e00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb754076500 0x7fb754078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.206+0000 7f8d0fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d1015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.206+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d10072d50 0x7f8d100c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.206+0000 7f8d0fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d1015f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56398/0 (socket says 172.21.15.114:56398) 2024-05-09T00:13:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.206+0000 7f8d0fe00640 1 -- 172.21.15.114:0/2848166159 learned_addr learned my addr 172.21.15.114:0/2848166159 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.207+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d10160600 0x7f8d1014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.208+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100c6760 con 0x7f8d10072890 2024-05-09T00:13:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.208+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100c42e0 con 0x7f8d10160600 2024-05-09T00:13:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.209+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8d100c68e0 con 0x7f8d10072d50 2024-05-09T00:13:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.209+0000 7f8d14c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d10160600 0x7f8d1014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d0fe00640 1 -- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d10072d50 msgr2=0x7f8d100c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d0fe00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d10072d50 0x7f8d100c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d0fe00640 1 -- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d10160600 msgr2=0x7f8d1014b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d0fe00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d10160600 0x7f8d1014b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d0fe00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d100ac8c0 con 0x7f8d10072890 2024-05-09T00:13:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d14c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d10160600 0x7f8d1014b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.210+0000 7f8d0fe00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d1015f6b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000c400 tx=0x7f8d0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.211+0000 7fb771e00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb754076500 0x7fb754078a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb774141b60 tx=0x7fb76c0072d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.212+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00017070 con 0x7f8d10072890 2024-05-09T00:13:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.212+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d000052d0 con 0x7f8d10072890 2024-05-09T00:13:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.212+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00003830 con 0x7f8d10072890 2024-05-09T00:13:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.213+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb774074320 con 0x7fb774073f10 2024-05-09T00:13:37.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.214+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d100adbc0 con 0x7f8d10072890 2024-05-09T00:13:37.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.214+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d101f2ec0 con 0x7f8d10072890 2024-05-09T00:13:37.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.219+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d0001a070 con 0x7f8d10072890 2024-05-09T00:13:37.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.221+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1015e500 con 0x7f8d10072890 2024-05-09T00:13:37.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.222+0000 7f8d07e00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8cf00763a0 0x7f8cf00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.223+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f8d00096d90 con 0x7f8d10072890 2024-05-09T00:13:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.223+0000 7f8d0f400640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8cf00763a0 0x7f8cf00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.226+0000 7f8d0f400640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8cf00763a0 0x7f8cf00788b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc034000 tx=0x7f8cfc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:37.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.228+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8d0005fbf0 con 0x7f8d10072890 2024-05-09T00:13:37.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.805+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb74c005580 con 0x7fb774073f10 2024-05-09T00:13:37.804 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:37.804 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:34.914590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:37.062178+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":32,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:13:37.804 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2024-05-09T00:13:37.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.807+0000 7fb76a000640 1 -- 172.21.15.114:0/2272971924 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+4836 (secure 0 0 0) 0x7fb764081900 con 0x7fb774073f10 2024-05-09T00:13:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.804+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d10077430 con 0x7f8d10072890 2024-05-09T00:13:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.806+0000 7f8d07e00640 1 -- 172.21.15.114:0/2848166159 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+4836 (secure 0 0 0) 0x7f8d00068230 con 0x7f8d10072890 2024-05-09T00:13:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.809+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8cf00763a0 msgr2=0x7f8cf00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.809+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8cf00763a0 0x7f8cf00788b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc034000 tx=0x7f8cfc02e000 comp rx=0 tx=0).stop 2024-05-09T00:13:37.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.809+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 msgr2=0x7f8d1015f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.809+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d1015f6b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000c400 tx=0x7f8d0000c8c0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 shutdown_connections 2024-05-09T00:13:37.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8cf00763a0 0x7f8cf00788b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d10160600 0x7f8d1014b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d10072d50 0x7f8d100c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 --2- 172.21.15.114:0/2848166159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d10072890 0x7f8d1015f6b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 >> 172.21.15.114:0/2848166159 conn(0x7f8d1006c680 msgr2=0x7f8d10075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 shutdown_connections 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.811+0000 7f8d16c00640 1 -- 172.21.15.114:0/2848166159 wait complete. 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:37.811 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:34.914590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:37.062178+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":32,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:13:37.812 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2024-05-09T00:13:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.819+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb754076500 msgr2=0x7fb754078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.819+0000 7fb778c00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb754076500 0x7fb754078a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb774141b60 tx=0x7fb76c0072d0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.819+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 msgr2=0x7fb774139950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.819+0000 7fb778c00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 0x7fb774139950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb764000c00 tx=0x7fb7640046c0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 shutdown_connections 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb754076500 0x7fb754078a10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7740c31b0 0x7fb7740acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb774073f10 0x7fb774139950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 --2- 172.21.15.114:0/2272971924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7740735c0 0x7fb774155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 >> 172.21.15.114:0/2272971924 conn(0x7fb77406c680 msgr2=0x7fb7741410b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 shutdown_connections 2024-05-09T00:13:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:37.820+0000 7fb778c00640 1 -- 172.21.15.114:0/2272971924 wait complete. 2024-05-09T00:13:37.865 INFO:tasks.mds_thrash.fs.[b]:mds.b down, removed from mdsmap 2024-05-09T00:13:37.865 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T00:13:37.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:37.872 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 26, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4226": { "addr": "172.21.15.114:6837/2960717153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2960717153, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2960717153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4226, "incarnation": 25, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:13:34.914590+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4226 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 26, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4914": { "addr": "172.21.15.114:6836/1891949153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 1891949153, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 1891949153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4914, "incarnation": 25, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:reconnect", "state_seq": 32 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:13:37.062178+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4914 } } } ], "standbys": [] } 2024-05-09T00:13:38.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.300+0000 7ffbcac00640 1 Processor -- start 2024-05-09T00:13:38.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.300+0000 7ffbcac00640 1 -- start start 2024-05-09T00:13:38.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.302+0000 7ffbcac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbc40ae680 0x7ffbc40b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:38.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.302+0000 7ffbcac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc40c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:38.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.302+0000 7ffbcac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc40aee90 con 0x7ffbc4159650 2024-05-09T00:13:38.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.302+0000 7ffbcac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc40c6100 con 0x7ffbc40ae680 2024-05-09T00:13:38.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.302+0000 7ffbcac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40aebb0 con 0x7ffbc40c74a0 2024-05-09T00:13:38.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.303+0000 7ffbc3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbc40ae680 0x7ffbc40b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:38.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.303+0000 7ffbc3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbc40ae680 0x7ffbc40b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44108/0 (socket says 172.21.15.114:44108) 2024-05-09T00:13:38.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.303+0000 7ffbc3e00640 1 -- 172.21.15.114:0/705213830 learned_addr learned my addr 172.21.15.114:0/705213830 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:38.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.304+0000 7ffbc3e00640 1 -- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 msgr2=0x7ffbc40c78b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:13:38.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.304+0000 7ffbc3e00640 1 --2- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc40c78b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.304+0000 7ffbc3e00640 1 -- 172.21.15.114:0/705213830 >> v1:172.21.15.153:6789/0 conn(0x7ffbc4159650 legacy=0x7ffbc4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:38.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.304+0000 7ffbc3e00640 1 -- 172.21.15.114:0/705213830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40c63a0 con 0x7ffbc40ae680 2024-05-09T00:13:38.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.308+0000 7ffbc3e00640 1 --2- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 0x7ffbc40b0560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009870 tx=0x7ffbb402a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e16c93f7b977e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:38.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.310+0000 7ffbc2a00640 1 -- 172.21.15.114:0/705213830 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4037070 con 0x7ffbc40ae680 2024-05-09T00:13:38.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.310+0000 7ffbc2a00640 1 -- 172.21.15.114:0/705213830 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb4032440 con 0x7ffbc40ae680 2024-05-09T00:13:38.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.310+0000 7ffbc2a00640 1 -- 172.21.15.114:0/705213830 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4032810 con 0x7ffbc40ae680 2024-05-09T00:13:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.314+0000 7ffbcac00640 1 -- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 msgr2=0x7ffbc40b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.314+0000 7ffbcac00640 1 --2- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 0x7ffbc40b0560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009870 tx=0x7ffbb402a150 comp rx=0 tx=0).stop 2024-05-09T00:13:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.315+0000 7ffbcac00640 1 -- 172.21.15.114:0/705213830 shutdown_connections 2024-05-09T00:13:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.315+0000 7ffbcac00640 1 --2- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc40c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.315+0000 7ffbcac00640 1 --2- 172.21.15.114:0/705213830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 0x7ffbc40b0560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.315+0000 7ffbcac00640 1 -- 172.21.15.114:0/705213830 >> 172.21.15.114:0/705213830 conn(0x7ffbc40cb7b0 msgr2=0x7ffbc40cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:38.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.315+0000 7ffbcac00640 1 -- 172.21.15.114:0/705213830 shutdown_connections 2024-05-09T00:13:38.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.315+0000 7ffbcac00640 1 -- 172.21.15.114:0/705213830 wait complete. 2024-05-09T00:13:38.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.320+0000 7ffbcac00640 1 Processor -- start 2024-05-09T00:13:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.321+0000 7ffbcac00640 1 -- start start 2024-05-09T00:13:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.326+0000 7ffbcac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 0x7ffbc40ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.327+0000 7ffbcac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc4154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.327+0000 7ffbcac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbc4159650 0x7ffbc414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:38.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.328+0000 7ffbc3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc4154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:38.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.328+0000 7ffbc3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc4154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:49062/0 (socket says 172.21.15.114:49062) 2024-05-09T00:13:38.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.328+0000 7ffbcac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40c6ba0 con 0x7ffbc4159650 2024-05-09T00:13:38.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.328+0000 7ffbcac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4150560 con 0x7ffbc40ae680 2024-05-09T00:13:38.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.328+0000 7ffbcac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40b0aa0 con 0x7ffbc40c74a0 2024-05-09T00:13:38.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.328+0000 7ffbc3400640 1 -- 172.21.15.114:0/1979732643 learned_addr learned my addr 172.21.15.114:0/1979732643 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:38.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.329+0000 7ffbc8c00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbc4159650 0x7ffbc414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:38.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.329+0000 7ffbc8c00640 1 -- 172.21.15.114:0/1979732643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 msgr2=0x7ffbc4154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:38.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.329+0000 7ffbc8c00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc4154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.329+0000 7ffbc8c00640 1 -- 172.21.15.114:0/1979732643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 msgr2=0x7ffbc40ab4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:13:38.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.329+0000 7ffbc8c00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 0x7ffbc40ab4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.329+0000 7ffbc8c00640 1 -- 172.21.15.114:0/1979732643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40acc70 con 0x7ffbc4159650 2024-05-09T00:13:38.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.330+0000 7ffbc8c00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbc4159650 0x7ffbc414d130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00be00 tx=0x7ffbbc00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:38.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.331+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc003970 con 0x7ffbc4159650 2024-05-09T00:13:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.331+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc4155df0 con 0x7ffbc4159650 2024-05-09T00:13:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.332+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc4156e00 con 0x7ffbc4159650 2024-05-09T00:13:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.334+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc003b10 con 0x7ffbc4159650 2024-05-09T00:13:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.334+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004020 con 0x7ffbc4159650 2024-05-09T00:13:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.339+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb9c005290 con 0x7ffbc4159650 2024-05-09T00:13:38.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.343+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffbbc0041c0 con 0x7ffbc4159650 2024-05-09T00:13:38.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.347+0000 7ffbbbe00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffba40763d0 0x7ffba40788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:38.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.348+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7ffbbc097a50 con 0x7ffbc4159650 2024-05-09T00:13:38.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.348+0000 7ffbc3e00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffba40763d0 0x7ffba40788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:38.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.356+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffbbc060820 con 0x7ffbc4159650 2024-05-09T00:13:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.358+0000 7ffbc3e00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffba40763d0 0x7ffba40788e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4034000 tx=0x7ffbb402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.946+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb9c005580 con 0x7ffbc4159650 2024-05-09T00:13:38.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.950+0000 7ffbbbe00640 1 -- 172.21.15.114:0/1979732643 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+4833 (secure 0 0 0) 0x7ffbbc064b20 con 0x7ffbc4159650 2024-05-09T00:13:38.949 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:38.949 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:34.914590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:38.120108+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":33,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:13:38.949 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 27 2024-05-09T00:13:38.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.959+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffba40763d0 msgr2=0x7ffba40788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.959+0000 7ffbcac00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffba40763d0 0x7ffba40788e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4034000 tx=0x7ffbb402e000 comp rx=0 tx=0).stop 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.959+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbc4159650 msgr2=0x7ffbc414d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.959+0000 7ffbcac00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbc4159650 0x7ffbc414d130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00be00 tx=0x7ffbbc00bef0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.960+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 shutdown_connections 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.960+0000 7ffbcac00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffba40763d0 0x7ffba40788e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.960+0000 7ffbcac00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbc4159650 0x7ffbc414d130 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.960+0000 7ffbcac00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc40c74a0 0x7ffbc4154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.960+0000 7ffbcac00640 1 --2- 172.21.15.114:0/1979732643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc40ae680 0x7ffbc40ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:38.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.960+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 >> 172.21.15.114:0/1979732643 conn(0x7ffbc40cb7b0 msgr2=0x7ffbc414fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:38.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.967+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 shutdown_connections 2024-05-09T00:13:38.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:38.970+0000 7ffbcac00640 1 -- 172.21.15.114:0/1979732643 wait complete. 2024-05-09T00:13:39.050 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 27, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4226": { "addr": "172.21.15.114:6837/2960717153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2960717153, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2960717153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4226, "incarnation": 25, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:13:34.914590+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4226 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4914": { "addr": "172.21.15.114:6836/1891949153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 1891949153, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 1891949153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4914, "incarnation": 25, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 33 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:13:38.120108+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4914 } } } ], "standbys": [] } 2024-05-09T00:13:39.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:40.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.368+0000 7fefa4a00640 1 Processor -- start 2024-05-09T00:13:40.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.373+0000 7fefa4a00640 1 -- start start 2024-05-09T00:13:40.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.382+0000 7fefa4a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefa015c360 0x7fefa00cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:40.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.384+0000 7fef9de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fefa0159170 0x7fefa00cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55462/0 (socket says 172.21.15.114:55462) 2024-05-09T00:13:40.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.384+0000 7fef9de00640 1 -- 172.21.15.114:0/1913522515 learned_addr learned my addr 172.21.15.114:0/1913522515 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:40.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.384+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa00c8a50 con 0x7fefa0159170 2024-05-09T00:13:40.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.386+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa00c8d30 con 0x7fefa00b2dd0 2024-05-09T00:13:40.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.386+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fefa015c770 con 0x7fefa015c360 2024-05-09T00:13:40.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.386+0000 7fef9e800640 1 --2- 172.21.15.114:0/1913522515 >> v2:172.21.15.153:3300/0 conn(0x7fefa015c360 0x7fefa00cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.388+0000 7fef9e800640 1 -- 172.21.15.114:0/1913522515 >> v1:172.21.15.153:6789/0 conn(0x7fefa00b2dd0 legacy=0x7fefa00cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.388+0000 7fef9ca00640 1 -- 172.21.15.114:0/1913522515 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889625692 0 0) 0x7fefa00c8d30 con 0x7fefa00b2dd0 2024-05-09T00:13:40.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.388+0000 7fef9e800640 1 -- 172.21.15.114:0/1913522515 >> v1:172.21.15.114:6789/0 conn(0x7fefa0159170 legacy=0x7fefa00cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.388+0000 7fef9e800640 1 -- 172.21.15.114:0/1913522515 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa00cbad0 con 0x7fefa015c360 2024-05-09T00:13:40.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.393+0000 7fef9e800640 1 --2- 172.21.15.114:0/1913522515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa015c360 0x7fefa00cc9e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef98009d90 tx=0x7fef9802a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c9d6e98b5462a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.394+0000 7fef9ca00640 1 -- 172.21.15.114:0/1913522515 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98007740 con 0x7fefa015c360 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.395+0000 7fef9ca00640 1 -- 172.21.15.114:0/1913522515 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef980078e0 con 0x7fefa015c360 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.395+0000 7fef9ca00640 1 -- 172.21.15.114:0/1913522515 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98007740 con 0x7fefa015c360 2024-05-09T00:13:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.396+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa015c360 msgr2=0x7fefa00cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.396+0000 7fefa4a00640 1 --2- 172.21.15.114:0/1913522515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa015c360 0x7fefa00cc9e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef98009d90 tx=0x7fef9802a610 comp rx=0 tx=0).stop 2024-05-09T00:13:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.406+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 shutdown_connections 2024-05-09T00:13:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.406+0000 7fefa4a00640 1 --2- 172.21.15.114:0/1913522515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa015c360 0x7fefa00cc9e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.406+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 >> 172.21.15.114:0/1913522515 conn(0x7fefa00af930 msgr2=0x7fefa00cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.407+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 shutdown_connections 2024-05-09T00:13:40.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.408+0000 7fefa4a00640 1 -- 172.21.15.114:0/1913522515 wait complete. 2024-05-09T00:13:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.425+0000 7fefa4a00640 1 Processor -- start 2024-05-09T00:13:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.426+0000 7fefa4a00640 1 -- start start 2024-05-09T00:13:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.442+0000 7fefa4a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa00b2dd0 0x7fefa01ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.443+0000 7fef9de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa00b2dd0 0x7fefa01ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.443+0000 7fef9de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa00b2dd0 0x7fefa01ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44134/0 (socket says 172.21.15.114:44134) 2024-05-09T00:13:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.443+0000 7fef9de00640 1 -- 172.21.15.114:0/348679962 learned_addr learned my addr 172.21.15.114:0/348679962 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.443+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefa015c360 0x7fefa015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.443+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefa0151ce0 0x7fefa01479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.444+0000 7fef9d400640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefa015c360 0x7fefa015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.446+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fefa00ce530 con 0x7fefa015c360 2024-05-09T00:13:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.446+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fefa00ccf20 con 0x7fefa00b2dd0 2024-05-09T00:13:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.446+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fefa01eeb30 con 0x7fefa0151ce0 2024-05-09T00:13:40.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.448+0000 7fef9e800640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefa0151ce0 0x7fefa01479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.448+0000 7fef9d400640 1 -- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefa0151ce0 msgr2=0x7fefa01479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.448+0000 7fef9d400640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefa0151ce0 0x7fefa01479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.448+0000 7fef9d400640 1 -- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa00b2dd0 msgr2=0x7fefa01ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.448+0000 7fef9d400640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa00b2dd0 0x7fefa01ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.448+0000 7fef9d400640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa0158c70 con 0x7fefa015c360 2024-05-09T00:13:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.450+0000 7fef9d400640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefa015c360 0x7fefa015a930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefa00b3820 tx=0x7fef8c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.451+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c005270 con 0x7fefa015c360 2024-05-09T00:13:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.452+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c005430 con 0x7fefa015c360 2024-05-09T00:13:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.452+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c003830 con 0x7fefa015c360 2024-05-09T00:13:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.452+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa01f2260 con 0x7fefa015c360 2024-05-09T00:13:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.452+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa01ee870 con 0x7fefa015c360 2024-05-09T00:13:40.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.455+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef78005290 con 0x7fefa015c360 2024-05-09T00:13:40.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.458+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef8c0039d0 con 0x7fefa015c360 2024-05-09T00:13:40.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.463+0000 7fef96000640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fef80076320 0x7fef80078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:40.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.464+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fef8c0974b0 con 0x7fefa015c360 2024-05-09T00:13:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.475+0000 7fef9de00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fef80076320 0x7fef80078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.480+0000 7fef9de00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fef80076320 0x7fef80078830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef90000f60 tx=0x7fef90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.484+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fef8c0608d0 con 0x7fefa015c360 2024-05-09T00:13:40.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.981+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef78005580 con 0x7fefa015c360 2024-05-09T00:13:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.985+0000 7fef96000640 1 -- 172.21.15.114:0/348679962 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4844 (secure 0 0 0) 0x7fef8c0601d0 con 0x7fefa015c360 2024-05-09T00:13:40.983 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:40.983 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:39.122770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":77,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:40.983 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-05-09T00:13:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.997+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fef80076320 msgr2=0x7fef80078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.997+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fef80076320 0x7fef80078830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef90000f60 tx=0x7fef90009040 comp rx=0 tx=0).stop 2024-05-09T00:13:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.997+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefa015c360 msgr2=0x7fefa015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.997+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefa015c360 0x7fefa015a930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefa00b3820 tx=0x7fef8c00c9b0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 shutdown_connections 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fef80076320 0x7fef80078830 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefa0151ce0 0x7fefa01479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefa015c360 0x7fefa015a930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 --2- 172.21.15.114:0/348679962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa00b2dd0 0x7fefa01ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 >> 172.21.15.114:0/348679962 conn(0x7fefa00af930 msgr2=0x7fefa0154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 shutdown_connections 2024-05-09T00:13:40.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:40.998+0000 7fefa4a00640 1 -- 172.21.15.114:0/348679962 wait complete. 2024-05-09T00:13:41.051 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:41.068 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:13:41.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.632+0000 7f0da3c00640 1 Processor -- start 2024-05-09T00:13:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.632+0000 7f0da3c00640 1 -- start start 2024-05-09T00:13:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.637+0000 7f0da3c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0d9c072d50 0x7f0d9c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.637+0000 7f0da3c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 0x7f0d9c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.637+0000 7f0da3c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c0c4ca0 con 0x7f0d9c160600 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.637+0000 7f0da3c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c160170 con 0x7f0d9c072d50 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.637+0000 7f0da3c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c15a190 con 0x7f0d9c072890 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.639+0000 7f0d9be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 0x7f0d9c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.639+0000 7f0d9be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 0x7f0d9c159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:49070/0 (socket says 172.21.15.114:49070) 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.639+0000 7f0d9be00640 1 -- 172.21.15.114:0/2852481559 learned_addr learned my addr 172.21.15.114:0/2852481559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.641+0000 7f0d9be00640 1 -- 172.21.15.114:0/2852481559 >> v2:172.21.15.114:3300/0 conn(0x7f0d9c072d50 msgr2=0x7f0d9c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.641+0000 7f0d9be00640 1 --2- 172.21.15.114:0/2852481559 >> v2:172.21.15.114:3300/0 conn(0x7f0d9c072d50 0x7f0d9c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.641+0000 7f0d9be00640 1 -- 172.21.15.114:0/2852481559 >> v1:172.21.15.153:6789/0 conn(0x7f0d9c160600 legacy=0x7f0d9c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.641+0000 7f0d9be00640 1 -- 172.21.15.114:0/2852481559 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c15fe20 con 0x7f0d9c072890 2024-05-09T00:13:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.642+0000 7f0d9be00640 1 --2- 172.21.15.114:0/2852481559 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 0x7f0d9c159c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009870 tx=0x7f0d8802a150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25ee185bcd4a8727 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.643+0000 7f0d9b400640 1 -- 172.21.15.114:0/2852481559 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88037070 con 0x7f0d9c072890 2024-05-09T00:13:41.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.643+0000 7f0d9b400640 1 -- 172.21.15.114:0/2852481559 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d88032440 con 0x7f0d9c072890 2024-05-09T00:13:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.643+0000 7f0d9b400640 1 -- 172.21.15.114:0/2852481559 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88032810 con 0x7f0d9c072890 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.644+0000 7f0da3c00640 1 -- 172.21.15.114:0/2852481559 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 msgr2=0x7f0d9c159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.644+0000 7f0da3c00640 1 --2- 172.21.15.114:0/2852481559 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 0x7f0d9c159c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009870 tx=0x7f0d8802a150 comp rx=0 tx=0).stop 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.645+0000 7f0da3c00640 1 -- 172.21.15.114:0/2852481559 shutdown_connections 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.645+0000 7f0da3c00640 1 --2- 172.21.15.114:0/2852481559 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c072890 0x7f0d9c159c50 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009870 tx=0x7f0d8802a150 comp rx=0 tx=0).stop 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.645+0000 7f0da3c00640 1 --2- 172.21.15.114:0/2852481559 >> v2:172.21.15.114:3300/0 conn(0x7f0d9c072d50 0x7f0d9c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.645+0000 7f0da3c00640 1 -- 172.21.15.114:0/2852481559 >> 172.21.15.114:0/2852481559 conn(0x7f0d9c06c680 msgr2=0x7f0d9c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.647+0000 7f0da3c00640 1 -- 172.21.15.114:0/2852481559 shutdown_connections 2024-05-09T00:13:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.647+0000 7f0da3c00640 1 -- 172.21.15.114:0/2852481559 wait complete. 2024-05-09T00:13:41.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.655+0000 7f0da3c00640 1 Processor -- start 2024-05-09T00:13:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.660+0000 7f0da3c00640 1 -- start start 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.664+0000 7f0da3c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 0x7f0d9c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.664+0000 7f0da3c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c15ebd0 0x7f0d9c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.664+0000 7f0da3c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d9c1526b0 0x7f0d9c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.664+0000 7f0da3c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0c42e0 con 0x7f0d9c1526b0 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.664+0000 7f0da3c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c15d490 con 0x7f0d9c160600 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.664+0000 7f0da3c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c0c6760 con 0x7f0d9c15ebd0 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.665+0000 7f0da1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 0x7f0d9c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.665+0000 7f0da1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 0x7f0d9c15da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44140/0 (socket says 172.21.15.114:44140) 2024-05-09T00:13:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.665+0000 7f0da1200640 1 -- 172.21.15.114:0/4053445098 learned_addr learned my addr 172.21.15.114:0/4053445098 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:41.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.667+0000 7f0da1200640 1 -- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c15ebd0 msgr2=0x7f0d9c154ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:13:41.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.667+0000 7f0da1200640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c15ebd0 0x7f0d9c154ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:41.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.667+0000 7f0da1200640 1 -- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d9c1526b0 msgr2=0x7f0d9c152ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:13:41.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.667+0000 7f0da1c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d9c1526b0 0x7f0d9c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.668+0000 7f0da1200640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d9c1526b0 0x7f0d9c152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:41.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.668+0000 7f0da1200640 1 -- 172.21.15.114:0/4053445098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1f6900 con 0x7f0d9c160600 2024-05-09T00:13:41.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.668+0000 7f0da1c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d9c1526b0 0x7f0d9c152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:41.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.669+0000 7f0da1200640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 0x7f0d9c15da00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00b420 tx=0x7f0d8c00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.670+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c011830 con 0x7f0d9c160600 2024-05-09T00:13:41.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.671+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c016070 con 0x7f0d9c160600 2024-05-09T00:13:41.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.671+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c011c30 con 0x7f0d9c160600 2024-05-09T00:13:41.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.672+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c15f670 con 0x7f0d9c160600 2024-05-09T00:13:41.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.672+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c153000 con 0x7f0d9c160600 2024-05-09T00:13:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.676+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c074cc0 con 0x7f0d9c160600 2024-05-09T00:13:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.680+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d8c01b460 con 0x7f0d9c160600 2024-05-09T00:13:41.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.684+0000 7f0d98c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0d7c076300 0x7f0d7c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:41.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.688+0000 7f0d9be00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0d7c076300 0x7f0d7c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.688+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f0d8c097840 con 0x7f0d9c160600 2024-05-09T00:13:41.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.692+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d9c074cc0 con 0x7f0d9c160600 2024-05-09T00:13:41.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:41.694+0000 7f0d9be00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0d7c076300 0x7f0d7c078810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d88034000 tx=0x7f0d8802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:42.069 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-05-09T00:13:42.071+0000 7f1cc5000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:13:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.343+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d9c077430 con 0x7f0d9c160600 2024-05-09T00:13:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.344+0000 7f0d98c00640 1 -- 172.21.15.114:0/4053445098 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4844 (secure 0 0 0) 0x7f0d8c060be0 con 0x7f0d9c160600 2024-05-09T00:13:42.344 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:42.344 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:39.122770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":77,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-05-09T00:13:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.350+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0d7c076300 msgr2=0x7f0d7c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.350+0000 7f0da3c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0d7c076300 0x7f0d7c078810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d88034000 tx=0x7f0d8802e000 comp rx=0 tx=0).stop 2024-05-09T00:13:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.350+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 msgr2=0x7f0d9c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.350+0000 7f0da3c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 0x7f0d9c15da00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00b420 tx=0x7f0d8c00b8e0 comp rx=0 tx=0).stop 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 shutdown_connections 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0d7c076300 0x7f0d7c078810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d9c1526b0 0x7f0d9c152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d9c15ebd0 0x7f0d9c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 --2- 172.21.15.114:0/4053445098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d9c160600 0x7f0d9c15da00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 >> 172.21.15.114:0/4053445098 conn(0x7f0d9c06c680 msgr2=0x7f0d9c075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 shutdown_connections 2024-05-09T00:13:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:42.351+0000 7f0da3c00640 1 -- 172.21.15.114:0/4053445098 wait complete. 2024-05-09T00:13:42.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:13:42.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:13:42.419 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=4235 2024-05-09T00:13:42.419 INFO:tasks.mds_thrash.fs.[b]:waiting for 8 secs before reviving mds.b 2024-05-09T00:13:43.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:43.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.559+0000 7f97d1400640 1 Processor -- start 2024-05-09T00:13:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.559+0000 7f97d1400640 1 -- start start 2024-05-09T00:13:43.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.562+0000 7f97d1400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97cc0ae680 0x7f97cc0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.562+0000 7f97d1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97cc0c74a0 0x7f97cc0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.562+0000 7f97d1400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc0aee90 con 0x7f97cc159650 2024-05-09T00:13:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.562+0000 7f97d1400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc0c6100 con 0x7f97cc0c74a0 2024-05-09T00:13:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.562+0000 7f97d1400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc0aebb0 con 0x7f97cc0ae680 2024-05-09T00:13:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.563+0000 7f97cb200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f97cc159650 0x7f97cc159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:56482/0 (socket says 172.21.15.114:56482) 2024-05-09T00:13:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.563+0000 7f97cb200640 1 -- 172.21.15.114:0/153907003 learned_addr learned my addr 172.21.15.114:0/153907003 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.564+0000 7f97ca800640 1 --2- 172.21.15.114:0/153907003 >> v2:172.21.15.153:3300/0 conn(0x7f97cc0ae680 0x7f97cc0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.564+0000 7f97c9e00640 1 --2- 172.21.15.114:0/153907003 >> v2:172.21.15.114:3300/0 conn(0x7f97cc0c74a0 0x7f97cc0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.565+0000 7f97c9e00640 1 -- 172.21.15.114:0/153907003 >> v2:172.21.15.153:3300/0 conn(0x7f97cc0ae680 msgr2=0x7f97cc0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.566+0000 7f97c9e00640 1 --2- 172.21.15.114:0/153907003 >> v2:172.21.15.153:3300/0 conn(0x7f97cc0ae680 0x7f97cc0b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.566+0000 7f97c9e00640 1 -- 172.21.15.114:0/153907003 >> v1:172.21.15.153:6789/0 conn(0x7f97cc159650 legacy=0x7f97cc159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.566+0000 7f97c9400640 1 -- 172.21.15.114:0/153907003 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930905147 0 0) 0x7f97cc0aee90 con 0x7f97cc159650 2024-05-09T00:13:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.566+0000 7f97c9e00640 1 -- 172.21.15.114:0/153907003 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0c63a0 con 0x7f97cc0c74a0 2024-05-09T00:13:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.566+0000 7f97ca800640 1 --2- 172.21.15.114:0/153907003 >> v2:172.21.15.153:3300/0 conn(0x7f97cc0ae680 0x7f97cc0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:43.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.568+0000 7f97c9e00640 1 --2- 172.21.15.114:0/153907003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0c74a0 0x7f97cc0c78b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0c8c90 tx=0x7f97b802a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a18bef6b4f602a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.569+0000 7f97c9400640 1 -- 172.21.15.114:0/153907003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037070 con 0x7f97cc0c74a0 2024-05-09T00:13:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.569+0000 7f97c9400640 1 -- 172.21.15.114:0/153907003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8032440 con 0x7f97cc0c74a0 2024-05-09T00:13:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.570+0000 7f97c9400640 1 -- 172.21.15.114:0/153907003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037070 con 0x7f97cc0c74a0 2024-05-09T00:13:43.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.571+0000 7f97d1400640 1 -- 172.21.15.114:0/153907003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0c74a0 msgr2=0x7f97cc0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.571+0000 7f97d1400640 1 --2- 172.21.15.114:0/153907003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0c74a0 0x7f97cc0c78b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0c8c90 tx=0x7f97b802a370 comp rx=0 tx=0).stop 2024-05-09T00:13:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.574+0000 7f97d1400640 1 -- 172.21.15.114:0/153907003 shutdown_connections 2024-05-09T00:13:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.574+0000 7f97d1400640 1 --2- 172.21.15.114:0/153907003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0c74a0 0x7f97cc0c78b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.574+0000 7f97d1400640 1 --2- 172.21.15.114:0/153907003 >> v2:172.21.15.153:3300/0 conn(0x7f97cc0ae680 0x7f97cc0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.574+0000 7f97d1400640 1 -- 172.21.15.114:0/153907003 >> 172.21.15.114:0/153907003 conn(0x7f97cc0cb7b0 msgr2=0x7f97cc0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.576+0000 7f97d1400640 1 -- 172.21.15.114:0/153907003 shutdown_connections 2024-05-09T00:13:43.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.576+0000 7f97d1400640 1 -- 172.21.15.114:0/153907003 wait complete. 2024-05-09T00:13:43.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.590+0000 7f97d1400640 1 Processor -- start 2024-05-09T00:13:43.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.593+0000 7f97d1400640 1 -- start start 2024-05-09T00:13:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.608+0000 7f97d1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0ae680 0x7f97cc1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.610+0000 7f97d1400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97cc0c74a0 0x7f97cc0c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.610+0000 7f97d1400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97cc159650 0x7f97cc1efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.610+0000 7f97d1400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0c6ba0 con 0x7f97cc0ae680 2024-05-09T00:13:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.610+0000 7f97d1400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc150560 con 0x7f97cc159650 2024-05-09T00:13:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.610+0000 7f97d1400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc0b0aa0 con 0x7f97cc0c74a0 2024-05-09T00:13:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.613+0000 7f97c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97cc0c74a0 0x7f97cc0c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.613+0000 7f97cb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97cc159650 0x7f97cc1efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.617+0000 7f97cb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97cc159650 0x7f97cc1efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44158/0 (socket says 172.21.15.114:44158) 2024-05-09T00:13:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.617+0000 7f97cb200640 1 -- 172.21.15.114:0/2454273712 learned_addr learned my addr 172.21.15.114:0/2454273712 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.617+0000 7f97ca800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0ae680 0x7f97cc1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.618+0000 7f97c9e00640 1 -- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97cc159650 msgr2=0x7f97cc1efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.618+0000 7f97c9e00640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97cc159650 0x7f97cc1efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.618+0000 7f97c9e00640 1 -- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0ae680 msgr2=0x7f97cc1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.619+0000 7f97c9e00640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0ae680 0x7f97cc1f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.620+0000 7f97c9e00640 1 -- 172.21.15.114:0/2454273712 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc1f6b00 con 0x7f97cc0c74a0 2024-05-09T00:13:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.620+0000 7f97ca800640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0ae680 0x7f97cc1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.624+0000 7f97c9e00640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97cc0c74a0 0x7f97cc0c2a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97b8031000 tx=0x7f97b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.625+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8042020 con 0x7f97cc0c74a0 2024-05-09T00:13:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.625+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8003be0 con 0x7f97cc0c74a0 2024-05-09T00:13:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.625+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037040 con 0x7f97cc0c74a0 2024-05-09T00:13:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.629+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc0c5930 con 0x7f97cc0c74a0 2024-05-09T00:13:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.629+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc0c3730 con 0x7f97cc0c74a0 2024-05-09T00:13:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.632+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc077430 con 0x7f97cc0c74a0 2024-05-09T00:13:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.642+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f97b8045020 con 0x7f97cc0c74a0 2024-05-09T00:13:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.650+0000 7f97c2a00640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97ac076320 0x7f97ac078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.651+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f97b80b8310 con 0x7f97cc0c74a0 2024-05-09T00:13:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.651+0000 7f97ca800640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97ac076320 0x7f97ac078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.653+0000 7f97ca800640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97ac076320 0x7f97ac078830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97c4003e60 tx=0x7f97c40097f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:43.662+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f97b8081150 con 0x7f97cc0c74a0 2024-05-09T00:13:44.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.179+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97cc0cb280 con 0x7f97cc0c74a0 2024-05-09T00:13:44.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.180+0000 7f97c2a00640 1 -- 172.21.15.114:0/2454273712 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4844 (secure 0 0 0) 0x7f97b8085450 con 0x7f97cc0c74a0 2024-05-09T00:13:44.178 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:44.179 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:39.122770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":77,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:44.179 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-05-09T00:13:44.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.184+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97ac076320 msgr2=0x7f97ac078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:44.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.184+0000 7f97d1400640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97ac076320 0x7f97ac078830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97c4003e60 tx=0x7f97c40097f0 comp rx=0 tx=0).stop 2024-05-09T00:13:44.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.184+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97cc0c74a0 msgr2=0x7f97cc0c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:44.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.184+0000 7f97d1400640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97cc0c74a0 0x7f97cc0c2a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97b8031000 tx=0x7f97b80046c0 comp rx=0 tx=0).stop 2024-05-09T00:13:44.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.185+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 shutdown_connections 2024-05-09T00:13:44.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.185+0000 7f97d1400640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97ac076320 0x7f97ac078830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:44.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.185+0000 7f97d1400640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97cc159650 0x7f97cc1efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:44.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.185+0000 7f97d1400640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97cc0c74a0 0x7f97cc0c2a10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:44.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.185+0000 7f97d1400640 1 --2- 172.21.15.114:0/2454273712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97cc0ae680 0x7f97cc1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:44.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.185+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 >> 172.21.15.114:0/2454273712 conn(0x7f97cc0cb7b0 msgr2=0x7f97cc0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:44.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.187+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 shutdown_connections 2024-05-09T00:13:44.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:44.187+0000 7f97d1400640 1 -- 172.21.15.114:0/2454273712 wait complete. 2024-05-09T00:13:44.232 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:13:46.234 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.701+0000 7efe89000640 1 Processor -- start 2024-05-09T00:13:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.701+0000 7efe89000640 1 -- start start 2024-05-09T00:13:46.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe89000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efe84155710 0x7efe84158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe89000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe89000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8408f550 con 0x7efe840c8730 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe89000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efe840b3460 con 0x7efe84155710 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe89000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe84155b20 con 0x7efe840cb800 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe82a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efe84155710 0x7efe84158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe83400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efe840c8730 0x7efe840ca440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55476/0 (socket says 172.21.15.114:55476) 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe83400640 1 -- 172.21.15.114:0/1788873571 learned_addr learned my addr 172.21.15.114:0/1788873571 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe83e00640 1 --2- 172.21.15.114:0/1788873571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe82a00640 1 -- 172.21.15.114:0/1788873571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 msgr2=0x7efe840cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe82a00640 1 --2- 172.21.15.114:0/1788873571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe82a00640 1 -- 172.21.15.114:0/1788873571 >> v1:172.21.15.114:6789/0 conn(0x7efe840c8730 legacy=0x7efe840ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe82a00640 1 -- 172.21.15.114:0/1788873571 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8415b880 con 0x7efe84155710 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.703+0000 7efe82000640 1 -- 172.21.15.114:0/1788873571 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658410690 0 0) 0x7efe8408f550 con 0x7efe840c8730 2024-05-09T00:13:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.705+0000 7efe82a00640 1 --2- 172.21.15.114:0/1788873571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84158a70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe700097a0 tx=0x7efe7002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2edc965e72394 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.705+0000 7efe82000640 1 -- 172.21.15.114:0/1788873571 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70037070 con 0x7efe84155710 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.705+0000 7efe82000640 1 -- 172.21.15.114:0/1788873571 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7002adb0 con 0x7efe84155710 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.705+0000 7efe82000640 1 -- 172.21.15.114:0/1788873571 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70032660 con 0x7efe84155710 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.706+0000 7efe89000640 1 -- 172.21.15.114:0/1788873571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 msgr2=0x7efe84158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.706+0000 7efe89000640 1 --2- 172.21.15.114:0/1788873571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84158a70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe700097a0 tx=0x7efe7002a060 comp rx=0 tx=0).stop 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.707+0000 7efe89000640 1 -- 172.21.15.114:0/1788873571 shutdown_connections 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.707+0000 7efe89000640 1 --2- 172.21.15.114:0/1788873571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.707+0000 7efe89000640 1 --2- 172.21.15.114:0/1788873571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84158a70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.707+0000 7efe89000640 1 -- 172.21.15.114:0/1788873571 >> 172.21.15.114:0/1788873571 conn(0x7efe840af450 msgr2=0x7efe840af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.707+0000 7efe89000640 1 -- 172.21.15.114:0/1788873571 shutdown_connections 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.707+0000 7efe89000640 1 -- 172.21.15.114:0/1788873571 wait complete. 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.709+0000 7efe89000640 1 Processor -- start 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.709+0000 7efe89000640 1 -- start start 2024-05-09T00:13:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe89000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe840c8730 0x7efe841f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe89000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe89000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe89000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe8415c1b0 con 0x7efe84155710 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe89000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe8415b630 con 0x7efe840c8730 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe89000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe8415be40 con 0x7efe840cb800 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38820/0 (socket says 172.21.15.114:38820) 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe83e00640 1 -- 172.21.15.114:0/3061412814 learned_addr learned my addr 172.21.15.114:0/3061412814 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.712+0000 7efe83400640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe840c8730 0x7efe841f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe83e00640 1 -- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 msgr2=0x7efe840c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe83e00640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe83e00640 1 -- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe840c8730 msgr2=0x7efe841f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe83e00640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe840c8730 0x7efe841f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe83e00640 1 -- 172.21.15.114:0/3061412814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe841f1fd0 con 0x7efe84155710 2024-05-09T00:13:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe83e00640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84152500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009fd0 tx=0x7efe7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c014420 con 0x7efe84155710 2024-05-09T00:13:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c019070 con 0x7efe84155710 2024-05-09T00:13:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c014800 con 0x7efe84155710 2024-05-09T00:13:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.713+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe841f22b0 con 0x7efe84155710 2024-05-09T00:13:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.714+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe84153000 con 0x7efe84155710 2024-05-09T00:13:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.716+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe840c0ec0 con 0x7efe84155710 2024-05-09T00:13:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.718+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe7c0149a0 con 0x7efe84155710 2024-05-09T00:13:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.720+0000 7efe7b400640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe64076300 0x7efe64078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.720+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7efe7c098270 con 0x7efe84155710 2024-05-09T00:13:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.722+0000 7efe83400640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe64076300 0x7efe64078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.723+0000 7efe83400640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe64076300 0x7efe64078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe74000f60 tx=0x7efe74007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:46.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:46.731+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efe7c061060 con 0x7efe84155710 2024-05-09T00:13:47.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.332+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe84078430 con 0x7efe84155710 2024-05-09T00:13:47.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.333+0000 7efe7b400640 1 -- 172.21.15.114:0/3061412814 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4848 (secure 0 0 0) 0x7efe7c065360 con 0x7efe84155710 2024-05-09T00:13:47.332 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:47.332 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 30 2024-05-09T00:13:47.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.340+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe64076300 msgr2=0x7efe64078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.340+0000 7efe89000640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe64076300 0x7efe64078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe74000f60 tx=0x7efe74007d00 comp rx=0 tx=0).stop 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.340+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 msgr2=0x7efe84152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.340+0000 7efe89000640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84152500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009fd0 tx=0x7efe7c00e4b0 comp rx=0 tx=0).stop 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.341+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 shutdown_connections 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.341+0000 7efe89000640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe64076300 0x7efe64078810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.341+0000 7efe89000640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe84155710 0x7efe84152500 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.341+0000 7efe89000640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe840cb800 0x7efe840c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.341+0000 7efe89000640 1 --2- 172.21.15.114:0/3061412814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe840c8730 0x7efe841f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.341+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 >> 172.21.15.114:0/3061412814 conn(0x7efe840af450 msgr2=0x7efe840ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.342+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 shutdown_connections 2024-05-09T00:13:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:47.342+0000 7efe89000640 1 -- 172.21.15.114:0/3061412814 wait complete. 2024-05-09T00:13:47.395 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4523 2024-05-09T00:13:47.396 INFO:tasks.mds_thrash.fs.[a]:waiting for 5 secs before reviving mds.d 2024-05-09T00:13:49.361 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-05-09T00:13:49.363+0000 7f8622600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:13:50.420 INFO:tasks.mds_thrash.fs.[b]:reviving mds.b 2024-05-09T00:13:50.420 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T00:13:50.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T00:13:50.426 INFO:tasks.ceph.mds.b:Started 2024-05-09T00:13:50.427 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:50.889 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-09T00:13:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.918+0000 7f9488200640 1 Processor -- start 2024-05-09T00:13:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.919+0000 7f9488200640 1 -- start start 2024-05-09T00:13:50.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.922+0000 7f9488200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9480157770 0x7f9480072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:50.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.923+0000 7f9488200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9480154c20 0x7f94800af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:50.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.924+0000 7f9486c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9480157770 0x7f9480072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:50.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.924+0000 7f9488200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94800c49b0 con 0x7f94800c5580 2024-05-09T00:13:50.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.924+0000 7f9488200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9480155190 con 0x7f9480154c20 2024-05-09T00:13:50.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.924+0000 7f9488200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f94800af800 con 0x7f9480157770 2024-05-09T00:13:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.925+0000 7f9486c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9480157770 0x7f9480072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:60010/0 (socket says 172.21.15.114:60010) 2024-05-09T00:13:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.925+0000 7f9486c00640 1 -- 172.21.15.114:0/1834413014 learned_addr learned my addr 172.21.15.114:0/1834413014 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.926+0000 7f9484e00640 1 --2- 172.21.15.114:0/1834413014 >> v2:172.21.15.114:3300/0 conn(0x7f9480154c20 0x7f94800af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.927+0000 7f9486c00640 1 -- 172.21.15.114:0/1834413014 >> v2:172.21.15.114:3300/0 conn(0x7f9480154c20 msgr2=0x7f94800af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.928+0000 7f9486c00640 1 --2- 172.21.15.114:0/1834413014 >> v2:172.21.15.114:3300/0 conn(0x7f9480154c20 0x7f94800af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.928+0000 7f9486c00640 1 -- 172.21.15.114:0/1834413014 >> v1:172.21.15.114:6789/0 conn(0x7f94800c5580 legacy=0x7f94800c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.928+0000 7f9486c00640 1 -- 172.21.15.114:0/1834413014 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480073110 con 0x7f9480157770 2024-05-09T00:13:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.930+0000 7f9484e00640 1 --2- 172.21.15.114:0/1834413014 >> v2:172.21.15.114:3300/0 conn(0x7f9480154c20 0x7f94800af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.931+0000 7f9486c00640 1 --2- 172.21.15.114:0/1834413014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480072500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9480071e80 tx=0x7f947402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845534315a587c72 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.935+0000 7f947fe00640 1 -- 172.21.15.114:0/1834413014 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474037070 con 0x7f9480157770 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.936+0000 7f947fe00640 1 -- 172.21.15.114:0/1834413014 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474032440 con 0x7f9480157770 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.936+0000 7f947fe00640 1 -- 172.21.15.114:0/1834413014 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474032850 con 0x7f9480157770 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.937+0000 7f9488200640 1 -- 172.21.15.114:0/1834413014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 msgr2=0x7f9480072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.937+0000 7f9488200640 1 --2- 172.21.15.114:0/1834413014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480072500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9480071e80 tx=0x7f947402a230 comp rx=0 tx=0).stop 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.938+0000 7f9488200640 1 -- 172.21.15.114:0/1834413014 shutdown_connections 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.938+0000 7f9488200640 1 --2- 172.21.15.114:0/1834413014 >> v2:172.21.15.114:3300/0 conn(0x7f9480154c20 0x7f94800af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.938+0000 7f9488200640 1 --2- 172.21.15.114:0/1834413014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480072500 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.938+0000 7f9488200640 1 -- 172.21.15.114:0/1834413014 >> 172.21.15.114:0/1834413014 conn(0x7f94800c95f0 msgr2=0x7f94800c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.938+0000 7f9488200640 1 -- 172.21.15.114:0/1834413014 shutdown_connections 2024-05-09T00:13:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.938+0000 7f9488200640 1 -- 172.21.15.114:0/1834413014 wait complete. 2024-05-09T00:13:50.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.944+0000 7f9488200640 1 Processor -- start 2024-05-09T00:13:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.947+0000 7f9488200640 1 -- start start 2024-05-09T00:13:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.951+0000 7f9488200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 0x7f9480147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:50.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.952+0000 7f9488200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 0x7f94801ef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:50.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.952+0000 7f9488200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:50.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.952+0000 7f9486c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 0x7f9480147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:50.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.952+0000 7f9486c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 0x7f9480147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:32774/0 (socket says 172.21.15.114:32774) 2024-05-09T00:13:50.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.953+0000 7f9485800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:50.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.953+0000 7f9484e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 0x7f94801ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:50.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.954+0000 7f9484e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 0x7f94801ef650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46720/0 (socket says 172.21.15.114:46720) 2024-05-09T00:13:50.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.954+0000 7f9485800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:60012/0 (socket says 172.21.15.114:60012) 2024-05-09T00:13:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.954+0000 7f9486c00640 1 -- 172.21.15.114:0/1988953783 learned_addr learned my addr 172.21.15.114:0/1988953783 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.954+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f94800c6760 con 0x7f9480154c20 2024-05-09T00:13:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.954+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f94800c4c50 con 0x7f9480157770 2024-05-09T00:13:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.954+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94800c68e0 con 0x7f94800c5580 2024-05-09T00:13:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.956+0000 7f9484e00640 1 -- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 msgr2=0x7f9480147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.956+0000 7f9484e00640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 0x7f9480147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.956+0000 7f9484e00640 1 -- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 msgr2=0x7f9480141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:50.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.958+0000 7f9484e00640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:50.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.958+0000 7f9486c00640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 0x7f9480147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:50.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.958+0000 7f9484e00640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480162e50 con 0x7f9480154c20 2024-05-09T00:13:50.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.958+0000 7f9485800640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:50.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.959+0000 7f9484e00640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 0x7f94801ef650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f946c00e840 tx=0x7f946c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:50.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.961+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c017070 con 0x7f9480154c20 2024-05-09T00:13:50.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.961+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c00c940 con 0x7f9480154c20 2024-05-09T00:13:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.961+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c00cd30 con 0x7f9480154c20 2024-05-09T00:13:50.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.961+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9480161ff0 con 0x7f9480154c20 2024-05-09T00:13:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.965+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9480162650 con 0x7f9480154c20 2024-05-09T00:13:50.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.971+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480077430 con 0x7f9480154c20 2024-05-09T00:13:50.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.973+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f946c01a070 con 0x7f9480154c20 2024-05-09T00:13:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.982+0000 7f947d600640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9460076320 0x7f9460078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.982+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f946c097750 con 0x7f9480154c20 2024-05-09T00:13:50.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.986+0000 7f9486c00640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9460076320 0x7f9460078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:50.998+0000 7f9486c00640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9460076320 0x7f9460078830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9474000c00 tx=0x7f947402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:50.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.001+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f946c060620 con 0x7f9480154c20 2024-05-09T00:13:51.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.614+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9480073a50 con 0x7f9480154c20 2024-05-09T00:13:51.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.615+0000 7f947d600640 1 -- 172.21.15.114:0/1988953783 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4848 (secure 0 0 0) 0x7f946c064920 con 0x7f9480154c20 2024-05-09T00:13:51.613 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:51.614 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 30 2024-05-09T00:13:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.619+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9460076320 msgr2=0x7f9460078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.619+0000 7f9488200640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9460076320 0x7f9460078830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9474000c00 tx=0x7f947402e000 comp rx=0 tx=0).stop 2024-05-09T00:13:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.619+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 msgr2=0x7f94801ef650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.619+0000 7f9488200640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 0x7f94801ef650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f946c00e840 tx=0x7f946c00ed00 comp rx=0 tx=0).stop 2024-05-09T00:13:51.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.620+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 shutdown_connections 2024-05-09T00:13:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.620+0000 7f9488200640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9460076320 0x7f9460078830 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.621+0000 7f9488200640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9480157770 0x7f9480141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.622+0000 7f9488200640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9480154c20 0x7f94801ef650 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.622+0000 7f9488200640 1 --2- 172.21.15.114:0/1988953783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94800c5580 0x7f9480147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.622+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 >> 172.21.15.114:0/1988953783 conn(0x7f94800c95f0 msgr2=0x7f9480157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:51.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.626+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 shutdown_connections 2024-05-09T00:13:51.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:51.626+0000 7f9488200640 1 -- 172.21.15.114:0/1988953783 wait complete. 2024-05-09T00:13:51.679 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-05-09T00:13:52.397 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-05-09T00:13:52.397 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T00:13:52.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T00:13:52.414 INFO:tasks.ceph.mds.d:Started 2024-05-09T00:13:52.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:52.632 INFO:tasks.workunit.client.0.smithi114.stdout:fs setup took 106 secs 2024-05-09T00:13:52.856 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-09T00:13:52.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.959+0000 7fc942c00640 1 Processor -- start 2024-05-09T00:13:52.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.962+0000 7fc942c00640 1 -- start start 2024-05-09T00:13:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.968+0000 7fc942c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc93c0af460 0x7fc93c154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.969+0000 7fc93b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc93c0af460 0x7fc93c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.969+0000 7fc93be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc93c072500 0x7fc93c0c6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:38096/0 (socket says 172.21.15.114:38096) 2024-05-09T00:13:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.970+0000 7fc93b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc93c0af460 0x7fc93c154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46726/0 (socket says 172.21.15.114:46726) 2024-05-09T00:13:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.970+0000 7fc93be00640 1 -- 172.21.15.114:0/1996496928 learned_addr learned my addr 172.21.15.114:0/1996496928 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.970+0000 7fc942c00640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:52.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.972+0000 7fc941600640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:52.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.971+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c0c5950 con 0x7fc93c072500 2024-05-09T00:13:52.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.972+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc93c155190 con 0x7fc93c0af460 2024-05-09T00:13:52.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.972+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c0c5c30 con 0x7fc93c070650 2024-05-09T00:13:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.976+0000 7fc93aa00640 1 -- 172.21.15.114:0/1996496928 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680946336 0 0) 0x7fc93c0c5950 con 0x7fc93c072500 2024-05-09T00:13:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.976+0000 7fc93aa00640 1 -- 172.21.15.114:0/1996496928 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc924003520 con 0x7fc93c072500 2024-05-09T00:13:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.976+0000 7fc93b400640 1 -- 172.21.15.114:0/1996496928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 msgr2=0x7fc93c154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.976+0000 7fc93b400640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.976+0000 7fc93b400640 1 -- 172.21.15.114:0/1996496928 >> v1:172.21.15.153:6789/0 conn(0x7fc93c072500 legacy=0x7fc93c0c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.976+0000 7fc93b400640 1 -- 172.21.15.114:0/1996496928 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c0c4b00 con 0x7fc93c0af460 2024-05-09T00:13:52.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.980+0000 7fc93b400640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c154710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc92800d8a0 tx=0x7fc92802c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0699378651658b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:52.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.981+0000 7fc93aa00640 1 -- 172.21.15.114:0/1996496928 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928039070 con 0x7fc93c0af460 2024-05-09T00:13:52.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.981+0000 7fc93aa00640 1 -- 172.21.15.114:0/1996496928 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc928034640 con 0x7fc93c0af460 2024-05-09T00:13:52.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.981+0000 7fc93aa00640 1 -- 172.21.15.114:0/1996496928 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92800b040 con 0x7fc93c0af460 2024-05-09T00:13:52.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.984+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 msgr2=0x7fc93c154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:52.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.984+0000 7fc942c00640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c154710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc92800d8a0 tx=0x7fc92802c340 comp rx=0 tx=0).stop 2024-05-09T00:13:52.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.986+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 shutdown_connections 2024-05-09T00:13:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.986+0000 7fc942c00640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.986+0000 7fc942c00640 1 --2- 172.21.15.114:0/1996496928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c154710 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.986+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 >> 172.21.15.114:0/1996496928 conn(0x7fc93c0c95f0 msgr2=0x7fc93c0c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.986+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 shutdown_connections 2024-05-09T00:13:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:52.987+0000 7fc942c00640 1 -- 172.21.15.114:0/1996496928 wait complete. 2024-05-09T00:13:53.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.000+0000 7fc942c00640 1 Processor -- start 2024-05-09T00:13:53.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.000+0000 7fc942c00640 1 -- start start 2024-05-09T00:13:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.007+0000 7fc942c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c1f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:53.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.007+0000 7fc942c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c072500 0x7fc93c0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:53.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.007+0000 7fc942c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.008+0000 7fc941600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.008+0000 7fc941600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c14c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46732/0 (socket says 172.21.15.114:46732) 2024-05-09T00:13:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.008+0000 7fc93be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c1f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.008+0000 7fc93be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c1f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:32788/0 (socket says 172.21.15.114:32788) 2024-05-09T00:13:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.009+0000 7fc941600640 1 -- 172.21.15.114:0/1805891937 learned_addr learned my addr 172.21.15.114:0/1805891937 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.009+0000 7fc93b400640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c072500 0x7fc93c0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.009+0000 7fc942c00640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c157750 con 0x7fc93c0af460 2024-05-09T00:13:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.009+0000 7fc942c00640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1541a0 con 0x7fc93c072500 2024-05-09T00:13:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.009+0000 7fc942c00640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c073510 con 0x7fc93c070650 2024-05-09T00:13:53.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.011+0000 7fc941600640 1 -- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 msgr2=0x7fc93c1f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:53.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.011+0000 7fc941600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c1f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.011+0000 7fc941600640 1 -- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c072500 msgr2=0x7fc93c0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:53.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.011+0000 7fc941600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c072500 0x7fc93c0c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.011+0000 7fc941600640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c14eb10 con 0x7fc93c0af460 2024-05-09T00:13:53.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.012+0000 7fc93b400640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c072500 0x7fc93c0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:53.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.012+0000 7fc93be00640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:53.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.013+0000 7fc941600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c14c000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc934009cb0 tx=0x7fc93400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:53.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.014+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934018020 con 0x7fc93c0af460 2024-05-09T00:13:53.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.014+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934014480 con 0x7fc93c0af460 2024-05-09T00:13:53.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.014+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934014870 con 0x7fc93c0af460 2024-05-09T00:13:53.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.014+0000 7fc942c00640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c14aa60 con 0x7fc93c0af460 2024-05-09T00:13:53.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.015+0000 7fc942c00640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c14edb0 con 0x7fc93c0af460 2024-05-09T00:13:53.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.025+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc93401b020 con 0x7fc93c0af460 2024-05-09T00:13:53.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.027+0000 7fc92fe00640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc91c0763d0 0x7fc91c0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:53.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.028+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fc934098670 con 0x7fc93c0af460 2024-05-09T00:13:53.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.029+0000 7fc93be00640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc91c0763d0 0x7fc91c0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:53.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.033+0000 7fc93be00640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc91c0763d0 0x7fc91c0788e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc93000a410 tx=0x7fc93000a3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:53.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.039+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c073780 con 0x7fc93c0af460 2024-05-09T00:13:53.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.055+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc93c073780 con 0x7fc93c0af460 2024-05-09T00:13:53.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.654+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc93c077430 con 0x7fc93c0af460 2024-05-09T00:13:53.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.656+0000 7fc92fe00640 1 -- 172.21.15.114:0/1805891937 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5675 (secure 0 0 0) 0x7fc93c073780 con 0x7fc93c0af460 2024-05-09T00:13:53.658 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:53.658 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:53.658 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 31 2024-05-09T00:13:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.664+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc91c0763d0 msgr2=0x7fc91c0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.664+0000 7fc92d600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc91c0763d0 0x7fc91c0788e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc93000a410 tx=0x7fc93000a3a0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.664+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 msgr2=0x7fc93c14c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.664+0000 7fc92d600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c14c000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc934009cb0 tx=0x7fc93400c490 comp rx=0 tx=0).stop 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.665+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 shutdown_connections 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.665+0000 7fc92d600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc91c0763d0 0x7fc91c0788e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.665+0000 7fc92d600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc93c0af460 0x7fc93c14c000 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.665+0000 7fc92d600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c072500 0x7fc93c0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.665+0000 7fc92d600640 1 --2- 172.21.15.114:0/1805891937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c070650 0x7fc93c1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.665+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 >> 172.21.15.114:0/1805891937 conn(0x7fc93c0c95f0 msgr2=0x7fc93c075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.666+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 shutdown_connections 2024-05-09T00:13:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:53.666+0000 7fc92d600640 1 -- 172.21.15.114:0/1805891937 wait complete. 2024-05-09T00:13:53.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:53.719 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-09T00:13:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.214+0000 7fa3d3400640 1 Processor -- start 2024-05-09T00:13:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.214+0000 7fa3d3400640 1 -- start start 2024-05-09T00:13:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.215+0000 7fa3d3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa3cc15c360 0x7fa3cc0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.215+0000 7fa3d3400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0c8a50 con 0x7fa3cc159170 2024-05-09T00:13:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.216+0000 7fa3d3400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0c8d30 con 0x7fa3cc0b2dd0 2024-05-09T00:13:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.216+0000 7fa3d3400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa3cc15c770 con 0x7fa3cc15c360 2024-05-09T00:13:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.216+0000 7fa3d0a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa3cc159170 0x7fa3cc0cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48698/0 (socket says 172.21.15.114:48698) 2024-05-09T00:13:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.216+0000 7fa3d0a00640 1 -- 172.21.15.114:0/4280681838 learned_addr learned my addr 172.21.15.114:0/4280681838 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:13:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.216+0000 7fa3d1400640 1 --2- 172.21.15.114:0/4280681838 >> v2:172.21.15.153:3300/0 conn(0x7fa3cc15c360 0x7fa3cc0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491289484 0 0) 0x7fa3cc0c8a50 con 0x7fa3cc159170 2024-05-09T00:13:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b4003520 con 0x7fa3cc159170 2024-05-09T00:13:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3448964875 0 0) 0x7fa3b4003520 con 0x7fa3cc159170 2024-05-09T00:13:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 >> v2:172.21.15.153:3300/0 conn(0x7fa3cc15c360 msgr2=0x7fa3cc0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 --2- 172.21.15.114:0/4280681838 >> v2:172.21.15.153:3300/0 conn(0x7fa3cc15c360 0x7fa3cc0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 >> v1:172.21.15.153:6789/0 conn(0x7fa3cc0b2dd0 legacy=0x7fa3cc0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc0cbad0 con 0x7fa3cc159170 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.217+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fa3bc0016f0 con 0x7fa3cc159170 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 >> v1:172.21.15.114:6789/0 conn(0x7fa3cc159170 legacy=0x7fa3cc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3b4003aa0 0x7fa3b4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3b4004800 0x7fa3b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3b40053f0 0x7fa3b400bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc15c770 con 0x7fa3b40053f0 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b400c390 con 0x7fa3b4003aa0 2024-05-09T00:13:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b400c590 con 0x7fa3b4004800 2024-05-09T00:13:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3d1400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3b40053f0 0x7fa3b400bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.218+0000 7fa3d0a00640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3b4003aa0 0x7fa3b4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.219+0000 7fa3d1400640 1 -- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3b4004800 msgr2=0x7fa3b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.219+0000 7fa3d1400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3b4004800 0x7fa3b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.219+0000 7fa3d1400640 1 -- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3b4003aa0 msgr2=0x7fa3b4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.219+0000 7fa3d1400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3b4003aa0 0x7fa3b4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.219+0000 7fa3d1400640 1 -- 172.21.15.114:0/4280681838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4003520 con 0x7fa3b40053f0 2024-05-09T00:13:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.220+0000 7fa3d1400640 1 -- 172.21.15.114:0/4280681838 reap_dead start 2024-05-09T00:13:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.220+0000 7fa3d1400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3b40053f0 0x7fa3b400bab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400e3a0 tx=0x7fa3b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d35fb90b1565af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.221+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4009c10 con 0x7fa3b40053f0 2024-05-09T00:13:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.221+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c402c690 con 0x7fa3b40053f0 2024-05-09T00:13:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.221+0000 7fa3cb400640 1 -- 172.21.15.114:0/4280681838 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c402ca80 con 0x7fa3b40053f0 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.222+0000 7fa3d3400640 1 -- 172.21.15.114:0/4280681838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3b40053f0 msgr2=0x7fa3b400bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.222+0000 7fa3d3400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3b40053f0 0x7fa3b400bab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400e3a0 tx=0x7fa3b4005830 comp rx=0 tx=0).stop 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.222+0000 7fa3d3400640 1 -- 172.21.15.114:0/4280681838 shutdown_connections 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.222+0000 7fa3d3400640 1 --2- 172.21.15.114:0/4280681838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3b40053f0 0x7fa3b400bab0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.222+0000 7fa3d3400640 1 -- 172.21.15.114:0/4280681838 >> 172.21.15.114:0/4280681838 conn(0x7fa3cc0af930 msgr2=0x7fa3cc0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.223+0000 7fa3d3400640 1 -- 172.21.15.114:0/4280681838 shutdown_connections 2024-05-09T00:13:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.223+0000 7fa3d3400640 1 -- 172.21.15.114:0/4280681838 wait complete. 2024-05-09T00:13:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.225+0000 7fa3d3400640 1 Processor -- start 2024-05-09T00:13:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.225+0000 7fa3d3400640 1 -- start start 2024-05-09T00:13:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.227+0000 7fa3d3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3cc150aa0 0x7fa3cc0ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.227+0000 7fa3d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 0x7fa3cc1ee350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.227+0000 7fa3d3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3cc0c6310 0x7fa3cc0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.227+0000 7fa3d3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc0c9fb0 con 0x7fa3cc1edf40 2024-05-09T00:13:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.227+0000 7fa3d3400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc0c9e30 con 0x7fa3cc0c6310 2024-05-09T00:13:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.227+0000 7fa3d3400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3cc159170 con 0x7fa3cc150aa0 2024-05-09T00:13:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.228+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 0x7fa3cc1ee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.228+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 0x7fa3cc1ee350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46748/0 (socket says 172.21.15.114:46748) 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.228+0000 7fa3cbe00640 1 -- 172.21.15.114:0/797950062 learned_addr learned my addr 172.21.15.114:0/797950062 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.228+0000 7fa3d1400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3cc0c6310 0x7fa3cc0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.229+0000 7fa3d0a00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3cc150aa0 0x7fa3cc0ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.229+0000 7fa3cbe00640 1 -- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3cc150aa0 msgr2=0x7fa3cc0ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.229+0000 7fa3cbe00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3cc150aa0 0x7fa3cc0ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.229+0000 7fa3cbe00640 1 -- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3cc0c6310 msgr2=0x7fa3cc0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.229+0000 7fa3cbe00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3cc0c6310 0x7fa3cc0c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.229+0000 7fa3cbe00640 1 -- 172.21.15.114:0/797950062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc150440 con 0x7fa3cc1edf40 2024-05-09T00:13:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.230+0000 7fa3cbe00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 0x7fa3cc1ee350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c460 tx=0x7fa3c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.231+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00052d0 con 0x7fa3cc1edf40 2024-05-09T00:13:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.231+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c0005470 con 0x7fa3cc1edf40 2024-05-09T00:13:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.231+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0012870 con 0x7fa3cc1edf40 2024-05-09T00:13:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.231+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc0c74c0 con 0x7fa3cc1edf40 2024-05-09T00:13:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.232+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3cc0c6c60 con 0x7fa3cc1edf40 2024-05-09T00:13:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.233+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc14ef60 con 0x7fa3cc1edf40 2024-05-09T00:13:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.235+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3c0012a10 con 0x7fa3cc1edf40 2024-05-09T00:13:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.238+0000 7fa3c8c00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa3b0076320 0x7fa3b0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.238+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fa3c0097520 con 0x7fa3cc1edf40 2024-05-09T00:13:54.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.241+0000 7fa3d0a00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa3b0076320 0x7fa3b0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.244+0000 7fa3d0a00640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa3b0076320 0x7fa3b0078830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc001160 tx=0x7fa3bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:54.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.244+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa3c0060ad0 con 0x7fa3cc1edf40 2024-05-09T00:13:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.832+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3cc077430 con 0x7fa3cc1edf40 2024-05-09T00:13:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.834+0000 7fa3c8c00640 1 -- 172.21.15.114:0/797950062 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7fa3c00603d0 con 0x7fa3cc1edf40 2024-05-09T00:13:54.833 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:54.833 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:54.833 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:13:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.840+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa3b0076320 msgr2=0x7fa3b0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.840+0000 7fa3d3400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa3b0076320 0x7fa3b0078830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc001160 tx=0x7fa3bc009040 comp rx=0 tx=0).stop 2024-05-09T00:13:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.840+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 msgr2=0x7fa3cc1ee350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.840+0000 7fa3d3400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 0x7fa3cc1ee350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c460 tx=0x7fa3c000c920 comp rx=0 tx=0).stop 2024-05-09T00:13:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.841+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 shutdown_connections 2024-05-09T00:13:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.841+0000 7fa3d3400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa3b0076320 0x7fa3b0078830 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.841+0000 7fa3d3400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3cc0c6310 0x7fa3cc0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.841+0000 7fa3d3400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3cc1edf40 0x7fa3cc1ee350 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.841+0000 7fa3d3400640 1 --2- 172.21.15.114:0/797950062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3cc150aa0 0x7fa3cc0ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.841+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 >> 172.21.15.114:0/797950062 conn(0x7fa3cc0af930 msgr2=0x7fa3cc0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:54.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.842+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 shutdown_connections 2024-05-09T00:13:54.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:54.842+0000 7fa3d3400640 1 -- 172.21.15.114:0/797950062 wait complete. 2024-05-09T00:13:54.902 INFO:tasks.mds_thrash.fs.[b]:mds.b reported in up:standby state 2024-05-09T00:13:54.902 INFO:tasks.mds_thrash.fs.[b]:waiting for 54 secs before thrashing 2024-05-09T00:13:55.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:56.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.301+0000 7fbb86000640 1 Processor -- start 2024-05-09T00:13:56.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.301+0000 7fbb86000640 1 -- start start 2024-05-09T00:13:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.307+0000 7fbb86000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb80165490 0x7fbb801678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.307+0000 7fbb86000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb800701f0 con 0x7fbb8006e610 2024-05-09T00:13:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.307+0000 7fbb86000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb800c54b0 con 0x7fbb800c48b0 2024-05-09T00:13:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.307+0000 7fbb86000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbb800c4cc0 con 0x7fbb80165490 2024-05-09T00:13:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.308+0000 7fbb85600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb80165490 0x7fbb801678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.308+0000 7fbb85600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb80165490 0x7fbb801678b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:60058/0 (socket says 172.21.15.114:60058) 2024-05-09T00:13:56.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.308+0000 7fbb85600640 1 -- 172.21.15.114:0/2091592751 learned_addr learned my addr 172.21.15.114:0/2091592751 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.310+0000 7fbb85600640 1 -- 172.21.15.114:0/2091592751 >> v1:172.21.15.153:6789/0 conn(0x7fbb800c48b0 legacy=0x7fbb80071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.310+0000 7fbb85600640 1 -- 172.21.15.114:0/2091592751 >> v1:172.21.15.114:6789/0 conn(0x7fbb8006e610 legacy=0x7fbb800c5e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.310+0000 7fbb85600640 1 -- 172.21.15.114:0/2091592751 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb800c5790 con 0x7fbb80165490 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.313+0000 7fbb85600640 1 --2- 172.21.15.114:0/2091592751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 0x7fbb801678b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009870 tx=0x7fbb6c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d379e26100167c73 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.316+0000 7fbb7f400640 1 -- 172.21.15.114:0/2091592751 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c037070 con 0x7fbb80165490 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.316+0000 7fbb7f400640 1 -- 172.21.15.114:0/2091592751 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6c032440 con 0x7fbb80165490 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.316+0000 7fbb7f400640 1 -- 172.21.15.114:0/2091592751 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c032810 con 0x7fbb80165490 2024-05-09T00:13:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.318+0000 7fbb86000640 1 -- 172.21.15.114:0/2091592751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 msgr2=0x7fbb801678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.319+0000 7fbb86000640 1 --2- 172.21.15.114:0/2091592751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 0x7fbb801678b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009870 tx=0x7fbb6c02a130 comp rx=0 tx=0).stop 2024-05-09T00:13:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.319+0000 7fbb86000640 1 -- 172.21.15.114:0/2091592751 shutdown_connections 2024-05-09T00:13:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.319+0000 7fbb86000640 1 --2- 172.21.15.114:0/2091592751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 0x7fbb801678b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.319+0000 7fbb86000640 1 -- 172.21.15.114:0/2091592751 >> 172.21.15.114:0/2091592751 conn(0x7fbb800c92e0 msgr2=0x7fbb800c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.321+0000 7fbb86000640 1 -- 172.21.15.114:0/2091592751 shutdown_connections 2024-05-09T00:13:56.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.322+0000 7fbb86000640 1 -- 172.21.15.114:0/2091592751 wait complete. 2024-05-09T00:13:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.331+0000 7fbb86000640 1 Processor -- start 2024-05-09T00:13:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.331+0000 7fbb86000640 1 -- start start 2024-05-09T00:13:56.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.338+0000 7fbb86000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 0x7fbb80072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.338+0000 7fbb86000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb800c48b0 0x7fbb80153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.338+0000 7fbb86000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 0x7fbb801542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.339+0000 7fbb86000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8006fb00 con 0x7fbb800c48b0 2024-05-09T00:13:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.339+0000 7fbb86000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800704d0 con 0x7fbb80165490 2024-05-09T00:13:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.339+0000 7fbb86000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbb800c8c20 con 0x7fbb8006e610 2024-05-09T00:13:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.339+0000 7fbb84c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 0x7fbb80072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.339+0000 7fbb84c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 0x7fbb80072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:32826/0 (socket says 172.21.15.114:32826) 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.339+0000 7fbb84c00640 1 -- 172.21.15.114:0/495883303 learned_addr learned my addr 172.21.15.114:0/495883303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.340+0000 7fbb84c00640 1 -- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 msgr2=0x7fbb801542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.340+0000 7fbb84c00640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 0x7fbb801542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.340+0000 7fbb84c00640 1 -- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb800c48b0 msgr2=0x7fbb80153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.340+0000 7fbb84c00640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb800c48b0 0x7fbb80153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.340+0000 7fbb84c00640 1 -- 172.21.15.114:0/495883303 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb80164b70 con 0x7fbb8006e610 2024-05-09T00:13:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.341+0000 7fbb84c00640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 0x7fbb80072b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800b9b0 tx=0x7fbb7800be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.344+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78019070 con 0x7fbb8006e610 2024-05-09T00:13:56.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.344+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb801f6390 con 0x7fbb8006e610 2024-05-09T00:13:56.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.344+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb801572d0 con 0x7fbb8006e610 2024-05-09T00:13:56.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.344+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7800cba0 con 0x7fbb8006e610 2024-05-09T00:13:56.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.344+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78014440 con 0x7fbb8006e610 2024-05-09T00:13:56.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.346+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb80078350 con 0x7fbb8006e610 2024-05-09T00:13:56.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.350+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb7801c070 con 0x7fbb8006e610 2024-05-09T00:13:56.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.352+0000 7fbb7cc00640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbb600763d0 0x7fbb600788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.353+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fbb78097ef0 con 0x7fbb8006e610 2024-05-09T00:13:56.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.354+0000 7fbb7fe00640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbb600763d0 0x7fbb600788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.356+0000 7fbb7fe00640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbb600763d0 0x7fbb600788e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb80155080 tx=0x7fbb70007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:56.363+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbb7803c070 con 0x7fbb8006e610 2024-05-09T00:13:57.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.007+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb80156da0 con 0x7fbb8006e610 2024-05-09T00:13:57.011 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:13:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:13:57.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.011+0000 7fbb7cc00640 1 -- 172.21.15.114:0/495883303 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7fbb78060cc0 con 0x7fbb8006e610 2024-05-09T00:13:57.011 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:13:57.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.016+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbb600763d0 msgr2=0x7fbb600788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.017+0000 7fbb86000640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbb600763d0 0x7fbb600788e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb80155080 tx=0x7fbb70007970 comp rx=0 tx=0).stop 2024-05-09T00:13:57.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.018+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 msgr2=0x7fbb80072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.018+0000 7fbb86000640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 0x7fbb80072b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800b9b0 tx=0x7fbb7800be70 comp rx=0 tx=0).stop 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.018+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 shutdown_connections 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.018+0000 7fbb86000640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbb600763d0 0x7fbb600788e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.018+0000 7fbb86000640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb80165490 0x7fbb801542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.019+0000 7fbb86000640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb800c48b0 0x7fbb80153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.019+0000 7fbb86000640 1 --2- 172.21.15.114:0/495883303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb8006e610 0x7fbb80072b40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.019+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 >> 172.21.15.114:0/495883303 conn(0x7fbb800c92e0 msgr2=0x7fbb80071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.019+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 shutdown_connections 2024-05-09T00:13:57.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:13:57.019+0000 7fbb86000640 1 -- 172.21.15.114:0/495883303 wait complete. 2024-05-09T00:13:57.073 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-05-09T00:13:57.073 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before thrashing 2024-05-09T00:14:00.074 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:00.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.566+0000 7f0fa9e00640 1 Processor -- start 2024-05-09T00:14:00.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.567+0000 7f0fa9e00640 1 -- start start 2024-05-09T00:14:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.570+0000 7f0fa9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0fa41586e0 0x7f0fa40c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.570+0000 7f0fa9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fa40af300 0x7f0fa406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.570+0000 7f0fa9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa406f8e0 0x7f0fa4154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.570+0000 7f0fa9e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa40c54c0 con 0x7f0fa40af300 2024-05-09T00:14:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.570+0000 7f0fa9e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa4073bc0 con 0x7f0fa41586e0 2024-05-09T00:14:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.570+0000 7f0fa9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa4158c30 con 0x7f0fa406f8e0 2024-05-09T00:14:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.571+0000 7f0fa2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0fa41586e0 0x7f0fa40c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.571+0000 7f0fa3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa406f8e0 0x7f0fa4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.571+0000 7f0fa2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0fa41586e0 0x7f0fa40c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:38524/0 (socket says 172.21.15.114:38524) 2024-05-09T00:14:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.571+0000 7f0fa2a00640 1 -- 172.21.15.114:0/2558038593 learned_addr learned my addr 172.21.15.114:0/2558038593 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:00.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.572+0000 7f0fa2000640 1 --2- 172.21.15.114:0/2558038593 >> v2:172.21.15.114:3300/0 conn(0x7f0fa40af300 0x7f0fa406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.573+0000 7f0fa2000640 1 -- 172.21.15.114:0/2558038593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa406f8e0 msgr2=0x7f0fa4154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:00.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.573+0000 7f0fa2000640 1 --2- 172.21.15.114:0/2558038593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa406f8e0 0x7f0fa4154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.573+0000 7f0fa2000640 1 -- 172.21.15.114:0/2558038593 >> v2:172.21.15.153:3300/0 conn(0x7f0fa41586e0 msgr2=0x7f0fa40c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:00.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.573+0000 7f0fa2000640 1 --2- 172.21.15.114:0/2558038593 >> v2:172.21.15.153:3300/0 conn(0x7f0fa41586e0 0x7f0fa40c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.573+0000 7f0fa2000640 1 -- 172.21.15.114:0/2558038593 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa4073600 con 0x7f0fa40af300 2024-05-09T00:14:00.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.576+0000 7f0fa2000640 1 --2- 172.21.15.114:0/2558038593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa40af300 0x7f0fa406f3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4071290 tx=0x7f0f9002a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c4e81bd7b3d24a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:00.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.576+0000 7f0fa1600640 1 -- 172.21.15.114:0/2558038593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90037070 con 0x7f0fa40af300 2024-05-09T00:14:00.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.577+0000 7f0fa1600640 1 -- 172.21.15.114:0/2558038593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f9002ade0 con 0x7f0fa40af300 2024-05-09T00:14:00.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.578+0000 7f0fa1600640 1 -- 172.21.15.114:0/2558038593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90037070 con 0x7f0fa40af300 2024-05-09T00:14:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.579+0000 7f0fa9e00640 1 -- 172.21.15.114:0/2558038593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa40af300 msgr2=0x7f0fa406f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.579+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/2558038593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa40af300 0x7f0fa406f3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4071290 tx=0x7f0f9002a090 comp rx=0 tx=0).stop 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.579+0000 7f0fa9e00640 1 -- 172.21.15.114:0/2558038593 shutdown_connections 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.581+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/2558038593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa406f8e0 0x7f0fa4154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.581+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/2558038593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa40af300 0x7f0fa406f3a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.581+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/2558038593 >> v2:172.21.15.153:3300/0 conn(0x7f0fa41586e0 0x7f0fa40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.581+0000 7f0fa9e00640 1 -- 172.21.15.114:0/2558038593 >> 172.21.15.114:0/2558038593 conn(0x7f0fa406c680 msgr2=0x7f0fa406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.581+0000 7f0fa9e00640 1 -- 172.21.15.114:0/2558038593 shutdown_connections 2024-05-09T00:14:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.582+0000 7f0fa9e00640 1 -- 172.21.15.114:0/2558038593 wait complete. 2024-05-09T00:14:00.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.585+0000 7f0fa9e00640 1 Processor -- start 2024-05-09T00:14:00.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.586+0000 7f0fa9e00640 1 -- start start 2024-05-09T00:14:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.588+0000 7f0fa9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 0x7f0fa41427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.589+0000 7f0fa2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 0x7f0fa41427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.589+0000 7f0fa2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 0x7f0fa41427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51994/0 (socket says 172.21.15.114:51994) 2024-05-09T00:14:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.590+0000 7f0fa2a00640 1 -- 172.21.15.114:0/1444440362 learned_addr learned my addr 172.21.15.114:0/1444440362 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.590+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fa40af300 0x7f0fa4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.590+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa41586e0 0x7f0fa40c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.590+0000 7f0fa2000640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fa40af300 0x7f0fa4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.591+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa40c6820 con 0x7f0fa406f8e0 2024-05-09T00:14:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.591+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa40c66a0 con 0x7f0fa40af300 2024-05-09T00:14:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.591+0000 7f0fa3400640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa41586e0 0x7f0fa40c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.591+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa4151f70 con 0x7f0fa41586e0 2024-05-09T00:14:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.592+0000 7f0fa2a00640 1 -- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa41586e0 msgr2=0x7f0fa40c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.592+0000 7f0fa2a00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa41586e0 0x7f0fa40c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.592+0000 7f0fa2a00640 1 -- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fa40af300 msgr2=0x7f0fa4152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.592+0000 7f0fa2a00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fa40af300 0x7f0fa4152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.592+0000 7f0fa2a00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa413da30 con 0x7f0fa406f8e0 2024-05-09T00:14:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.593+0000 7f0fa2a00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 0x7f0fa41427e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400d800 tx=0x7f0f9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.594+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94018020 con 0x7f0fa406f8e0 2024-05-09T00:14:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.594+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa41539b0 con 0x7f0fa406f8e0 2024-05-09T00:14:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.594+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa4166580 con 0x7f0fa406f8e0 2024-05-09T00:14:00.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.595+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f940096a0 con 0x7f0fa406f8e0 2024-05-09T00:14:00.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.595+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94009a90 con 0x7f0fa406f8e0 2024-05-09T00:14:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.599+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c005290 con 0x7f0fa406f8e0 2024-05-09T00:14:00.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.601+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f9401b020 con 0x7f0fa406f8e0 2024-05-09T00:14:00.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.607+0000 7f0f9b400640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f84076300 0x7f0f84078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.612+0000 7f0fa2000640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f84076300 0x7f0f84078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.612+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f0f940980e0 con 0x7f0fa406f8e0 2024-05-09T00:14:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.613+0000 7f0fa2000640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f84076300 0x7f0f84078810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f90034000 tx=0x7f0f9002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:00.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:00.619+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f94022020 con 0x7f0fa406f8e0 2024-05-09T00:14:00.876 INFO:tasks.workunit.client.0.smithi114.stdout:Syncing()...8 sec 2024-05-09T00:14:00.880 INFO:tasks.workunit.client.0.smithi114.stdout:Starting Actual Benchmark At: Thu May 9 00:14:00 2024 2024-05-09T00:14:00.880 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:14:01.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.205+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f7c005580 con 0x7f0fa406f8e0 2024-05-09T00:14:01.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.210+0000 7f0f9b400640 1 -- 172.21.15.114:0/1444440362 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7f0fa41539b0 con 0x7f0fa406f8e0 2024-05-09T00:14:01.209 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:01.209 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f84076300 msgr2=0x7f0f84078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f84076300 0x7f0f84078810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f90034000 tx=0x7f0f9002e000 comp rx=0 tx=0).stop 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 msgr2=0x7f0fa41427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 0x7f0fa41427e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400d800 tx=0x7f0f9400dcc0 comp rx=0 tx=0).stop 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 shutdown_connections 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f84076300 0x7f0f84078810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fa41586e0 0x7f0fa40c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fa40af300 0x7f0fa4152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 --2- 172.21.15.114:0/1444440362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fa406f8e0 0x7f0fa41427e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:01.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.215+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 >> 172.21.15.114:0/1444440362 conn(0x7f0fa406c680 msgr2=0x7f0fa40acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:01.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.216+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 shutdown_connections 2024-05-09T00:14:01.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:01.216+0000 7f0fa9e00640 1 -- 172.21.15.114:0/1444440362 wait complete. 2024-05-09T00:14:01.277 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-05-09T00:14:01.277 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T00:14:01.277 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:14:03.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-09T00:14:07.379 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T00:14:07.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.791+0000 7fed36e00640 1 Processor -- start 2024-05-09T00:14:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.791+0000 7fed36e00640 1 -- start start 2024-05-09T00:14:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed36e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30072d50 0x7fed300c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed36e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed30072890 0x7fed30159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed36e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed300c4ca0 con 0x7fed30160600 2024-05-09T00:14:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed36e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fed30160170 con 0x7fed30072890 2024-05-09T00:14:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed36e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fed3015a190 con 0x7fed30072d50 2024-05-09T00:14:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed34e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fed30160600 0x7fed300c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:59116/0 (socket says 172.21.15.114:59116) 2024-05-09T00:14:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.796+0000 7fed34e00640 1 -- 172.21.15.114:0/1518282021 learned_addr learned my addr 172.21.15.114:0/1518282021 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:14:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.799+0000 7fed2fe00640 1 --2- 172.21.15.114:0/1518282021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30072d50 0x7fed300c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.799+0000 7fed2fe00640 1 -- 172.21.15.114:0/1518282021 >> v2:172.21.15.153:3300/0 conn(0x7fed30072890 msgr2=0x7fed30159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.799+0000 7fed2fe00640 1 --2- 172.21.15.114:0/1518282021 >> v2:172.21.15.153:3300/0 conn(0x7fed30072890 0x7fed30159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.799+0000 7fed2fe00640 1 -- 172.21.15.114:0/1518282021 >> v1:172.21.15.153:6789/0 conn(0x7fed30160600 legacy=0x7fed300c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.800+0000 7fed2fe00640 1 -- 172.21.15.114:0/1518282021 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3015fe20 con 0x7fed30072d50 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.801+0000 7fed2fe00640 1 --2- 172.21.15.114:0/1518282021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30072d50 0x7fed300c4760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed28009d90 tx=0x7fed2802a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daa5455d4648564b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.802+0000 7fed2ea00640 1 -- 172.21.15.114:0/1518282021 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28007740 con 0x7fed30072d50 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.802+0000 7fed2ea00640 1 -- 172.21.15.114:0/1518282021 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280078e0 con 0x7fed30072d50 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.802+0000 7fed2ea00640 1 -- 172.21.15.114:0/1518282021 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28007cb0 con 0x7fed30072d50 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.803+0000 7fed36e00640 1 -- 172.21.15.114:0/1518282021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30072d50 msgr2=0x7fed300c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.803+0000 7fed36e00640 1 --2- 172.21.15.114:0/1518282021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30072d50 0x7fed300c4760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed28009d90 tx=0x7fed2802a540 comp rx=0 tx=0).stop 2024-05-09T00:14:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.805+0000 7fed36e00640 1 -- 172.21.15.114:0/1518282021 shutdown_connections 2024-05-09T00:14:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.805+0000 7fed36e00640 1 --2- 172.21.15.114:0/1518282021 >> v2:172.21.15.153:3300/0 conn(0x7fed30072890 0x7fed30159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.805+0000 7fed36e00640 1 --2- 172.21.15.114:0/1518282021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30072d50 0x7fed300c4760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.805+0000 7fed36e00640 1 -- 172.21.15.114:0/1518282021 >> 172.21.15.114:0/1518282021 conn(0x7fed3006c680 msgr2=0x7fed3006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.805+0000 7fed36e00640 1 -- 172.21.15.114:0/1518282021 shutdown_connections 2024-05-09T00:14:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.805+0000 7fed36e00640 1 -- 172.21.15.114:0/1518282021 wait complete. 2024-05-09T00:14:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.809+0000 7fed36e00640 1 Processor -- start 2024-05-09T00:14:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.809+0000 7fed36e00640 1 -- start start 2024-05-09T00:14:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed36e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed30072890 0x7fed300c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed36e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 0x7fed301f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed36e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30160600 0x7fed30150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed36e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fed300c42e0 con 0x7fed30072d50 2024-05-09T00:14:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed36e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed3015d490 con 0x7fed30072890 2024-05-09T00:14:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed36e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fed300c6760 con 0x7fed30160600 2024-05-09T00:14:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.812+0000 7fed2f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 0x7fed301f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed30072890 0x7fed300c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 0x7fed301f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57516/0 (socket says 172.21.15.114:57516) 2024-05-09T00:14:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 -- 172.21.15.114:0/1895378933 learned_addr learned my addr 172.21.15.114:0/1895378933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed34e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30160600 0x7fed30150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 -- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30160600 msgr2=0x7fed30150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30160600 0x7fed30150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 -- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed30072890 msgr2=0x7fed300c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed30072890 0x7fed300c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.813+0000 7fed2f400640 1 -- 172.21.15.114:0/1895378933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30159550 con 0x7fed30072d50 2024-05-09T00:14:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.814+0000 7fed2f400640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 0x7fed301f2a80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed2000b3c0 tx=0x7fed2000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.814+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20015020 con 0x7fed30072d50 2024-05-09T00:14:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.814+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed20011830 con 0x7fed30072d50 2024-05-09T00:14:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.814+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20015020 con 0x7fed30072d50 2024-05-09T00:14:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.815+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3015e0f0 con 0x7fed30072d50 2024-05-09T00:14:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.815+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3015d6d0 con 0x7fed30072d50 2024-05-09T00:14:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.818+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed20018020 con 0x7fed30072d50 2024-05-09T00:14:07.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.820+0000 7fed27e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fed100766d0 0x7fed10078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:07.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.820+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fed20011630 con 0x7fed30072d50 2024-05-09T00:14:07.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.822+0000 7fed2fe00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fed100766d0 0x7fed10078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:07.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.823+0000 7fed2fe00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fed100766d0 0x7fed10078be0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed28034000 tx=0x7fed2802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:07.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.824+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed30077430 con 0x7fed30072d50 2024-05-09T00:14:07.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:07.838+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fed2001f020 con 0x7fed30072d50 2024-05-09T00:14:08.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.374+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed300c4540 con 0x7fed30072d50 2024-05-09T00:14:08.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.382+0000 7fed27e00640 1 -- 172.21.15.114:0/1895378933 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7fed200607d0 con 0x7fed30072d50 2024-05-09T00:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:08.385 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:14:08.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.386+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fed100766d0 msgr2=0x7fed10078be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:08.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.386+0000 7fed36e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fed100766d0 0x7fed10078be0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed28034000 tx=0x7fed2802f000 comp rx=0 tx=0).stop 2024-05-09T00:14:08.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.387+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 msgr2=0x7fed301f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:08.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.387+0000 7fed36e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 0x7fed301f2a80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed2000b3c0 tx=0x7fed2000b880 comp rx=0 tx=0).stop 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 shutdown_connections 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fed100766d0 0x7fed10078be0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed30160600 0x7fed30150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed30072d50 0x7fed301f2a80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 --2- 172.21.15.114:0/1895378933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed30072890 0x7fed300c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 >> 172.21.15.114:0/1895378933 conn(0x7fed3006c680 msgr2=0x7fed3015b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 shutdown_connections 2024-05-09T00:14:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:08.390+0000 7fed36e00640 1 -- 172.21.15.114:0/1895378933 wait complete. 2024-05-09T00:14:08.448 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:14:10.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-09T00:14:10.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:10.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.936+0000 7f314a200640 1 Processor -- start 2024-05-09T00:14:10.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.936+0000 7f314a200640 1 -- start start 2024-05-09T00:14:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f314a200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31440c85a0 0x7f31441556c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f314a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 0x7f3144158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f314a200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f31440cc540 0x7f31440cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f314a200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3144158110 con 0x7f31440cc540 2024-05-09T00:14:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f314a200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3144158f40 con 0x7f31440c85a0 2024-05-09T00:14:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f314a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31440cbca0 con 0x7f31441585f0 2024-05-09T00:14:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f3143e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 0x7f3144158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f3143e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 0x7f3144158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45938/0 (socket says 172.21.15.114:45938) 2024-05-09T00:14:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.939+0000 7f3143e00640 1 -- 172.21.15.114:0/3651140810 learned_addr learned my addr 172.21.15.114:0/3651140810 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.940+0000 7f3149800640 1 --2- 172.21.15.114:0/3651140810 >> v2:172.21.15.114:3300/0 conn(0x7f31440cc540 0x7f31440cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.940+0000 7f3143e00640 1 -- 172.21.15.114:0/3651140810 >> v2:172.21.15.153:3300/0 conn(0x7f31440c85a0 msgr2=0x7f31441556c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:14:10.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.940+0000 7f3143e00640 1 --2- 172.21.15.114:0/3651140810 >> v2:172.21.15.153:3300/0 conn(0x7f31440c85a0 0x7f31441556c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.940+0000 7f3143e00640 1 -- 172.21.15.114:0/3651140810 >> v2:172.21.15.114:3300/0 conn(0x7f31440cc540 msgr2=0x7f31440cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.940+0000 7f3143e00640 1 --2- 172.21.15.114:0/3651140810 >> v2:172.21.15.114:3300/0 conn(0x7f31440cc540 0x7f31440cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.940+0000 7f3143e00640 1 -- 172.21.15.114:0/3651140810 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31440cbf80 con 0x7f31441585f0 2024-05-09T00:14:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.942+0000 7f3143e00640 1 --2- 172.21.15.114:0/3651140810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 0x7f3144158a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31440afa40 tx=0x7f313002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d695dd6cb7a4351c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.945+0000 7f3143400640 1 -- 172.21.15.114:0/3651140810 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130037070 con 0x7f31441585f0 2024-05-09T00:14:10.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.946+0000 7f3143400640 1 -- 172.21.15.114:0/3651140810 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130032440 con 0x7f31441585f0 2024-05-09T00:14:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.946+0000 7f3143400640 1 -- 172.21.15.114:0/3651140810 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130032810 con 0x7f31441585f0 2024-05-09T00:14:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.947+0000 7f314a200640 1 -- 172.21.15.114:0/3651140810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 msgr2=0x7f3144158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.947+0000 7f314a200640 1 --2- 172.21.15.114:0/3651140810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 0x7f3144158a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31440afa40 tx=0x7f313002a160 comp rx=0 tx=0).stop 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 -- 172.21.15.114:0/3651140810 shutdown_connections 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 --2- 172.21.15.114:0/3651140810 >> v2:172.21.15.114:3300/0 conn(0x7f31440cc540 0x7f31440cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 --2- 172.21.15.114:0/3651140810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31441585f0 0x7f3144158a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 --2- 172.21.15.114:0/3651140810 >> v2:172.21.15.153:3300/0 conn(0x7f31440c85a0 0x7f31441556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 -- 172.21.15.114:0/3651140810 >> 172.21.15.114:0/3651140810 conn(0x7f3144069000 msgr2=0x7f31440af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 -- 172.21.15.114:0/3651140810 shutdown_connections 2024-05-09T00:14:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.952+0000 7f314a200640 1 -- 172.21.15.114:0/3651140810 wait complete. 2024-05-09T00:14:10.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.956+0000 7f314a200640 1 Processor -- start 2024-05-09T00:14:10.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.957+0000 7f314a200640 1 -- start start 2024-05-09T00:14:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f314a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31440c85a0 0x7f31440c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f314a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440cc540 0x7f31440c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f314a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31441585f0 0x7f3144153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f314a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f314415b770 con 0x7f31440cc540 2024-05-09T00:14:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f314a200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f314415b5f0 con 0x7f31441585f0 2024-05-09T00:14:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f314a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31440ca610 con 0x7f31440c85a0 2024-05-09T00:14:10.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.959+0000 7f3148e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31440c85a0 0x7f31440c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.960+0000 7f3148e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31440c85a0 0x7f31440c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45950/0 (socket says 172.21.15.114:45950) 2024-05-09T00:14:10.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.960+0000 7f3148e00640 1 -- 172.21.15.114:0/2355925522 learned_addr learned my addr 172.21.15.114:0/2355925522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.960+0000 7f3143e00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440cc540 0x7f31440c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.960+0000 7f3149800640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31441585f0 0x7f3144153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.961+0000 7f3143e00640 1 -- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31440c85a0 msgr2=0x7f31440c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.961+0000 7f3143e00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31440c85a0 0x7f31440c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.961+0000 7f3143e00640 1 -- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31441585f0 msgr2=0x7f3144153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.961+0000 7f3143e00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31441585f0 0x7f3144153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.961+0000 7f3143e00640 1 -- 172.21.15.114:0/2355925522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31441ee590 con 0x7f31440cc540 2024-05-09T00:14:10.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.963+0000 7f3143e00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440cc540 0x7f31440c5180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3130031000 tx=0x7f31300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.964+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130041020 con 0x7f31440cc540 2024-05-09T00:14:10.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.964+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130030970 con 0x7f31440cc540 2024-05-09T00:14:10.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.964+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130037040 con 0x7f31440cc540 2024-05-09T00:14:10.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.964+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31441ee850 con 0x7f31440cc540 2024-05-09T00:14:10.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.965+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31440c4980 con 0x7f31440cc540 2024-05-09T00:14:10.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.969+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3130044020 con 0x7f31440cc540 2024-05-09T00:14:10.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.972+0000 7f3140c00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3124076350 0x7f3124078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.972+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f31300b7f40 con 0x7f31440cc540 2024-05-09T00:14:10.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.974+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3144078350 con 0x7f31440cc540 2024-05-09T00:14:10.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.977+0000 7f3148e00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3124076350 0x7f3124078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.980+0000 7f3148e00640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3124076350 0x7f3124078860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f31380099a0 tx=0x7f31380090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:10.991+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f313004b070 con 0x7f31440cc540 2024-05-09T00:14:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.489+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31440cb610 con 0x7f31440cc540 2024-05-09T00:14:11.488 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.490+0000 7f3140c00640 1 -- 172.21.15.114:0/2355925522 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7f3130098980 con 0x7f31440cc540 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3124076350 msgr2=0x7f3124078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3124076350 0x7f3124078860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f31380099a0 tx=0x7f31380090e0 comp rx=0 tx=0).stop 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440cc540 msgr2=0x7f31440c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440cc540 0x7f31440c5180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3130031000 tx=0x7f31300046c0 comp rx=0 tx=0).stop 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 shutdown_connections 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3124076350 0x7f3124078860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31441585f0 0x7f3144153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440cc540 0x7f31440c5180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 --2- 172.21.15.114:0/2355925522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31440c85a0 0x7f31440c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 >> 172.21.15.114:0/2355925522 conn(0x7f3144069000 msgr2=0x7f3144159330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 shutdown_connections 2024-05-09T00:14:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:11.493+0000 7f314a200640 1 -- 172.21.15.114:0/2355925522 wait complete. 2024-05-09T00:14:11.675 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:14:13.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:14:13.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:14:13.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:14.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.150+0000 7fceeea00640 1 Processor -- start 2024-05-09T00:14:14.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.152+0000 7fceeea00640 1 -- start start 2024-05-09T00:14:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.155+0000 7fceeea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcee00466a0 0x7fcee00d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.156+0000 7fceeea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcee00d4590 0x7fcee00da240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.156+0000 7fceed600640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcee0007750 0x7fcee0006d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:59130/0 (socket says 172.21.15.114:59130) 2024-05-09T00:14:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.156+0000 7fceed600640 1 -- 172.21.15.114:0/2521930012 learned_addr learned my addr 172.21.15.114:0/2521930012 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:14:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.157+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee0046d90 con 0x7fcee0007750 2024-05-09T00:14:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.157+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcee000bd70 con 0x7fcee00d4590 2024-05-09T00:14:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.157+0000 7fceecc00640 1 --2- 172.21.15.114:0/2521930012 >> v2:172.21.15.153:3300/0 conn(0x7fcee00466a0 0x7fcee00d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.157+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcee00473a0 con 0x7fcee00466a0 2024-05-09T00:14:14.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.157+0000 7fcee7e00640 1 -- 172.21.15.114:0/2521930012 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944111476 0 0) 0x7fcee0046d90 con 0x7fcee0007750 2024-05-09T00:14:14.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.158+0000 7fceee000640 1 --2- 172.21.15.114:0/2521930012 >> v2:172.21.15.114:3300/0 conn(0x7fcee00d4590 0x7fcee00da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.158+0000 7fcee7e00640 1 -- 172.21.15.114:0/2521930012 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fced0003520 con 0x7fcee0007750 2024-05-09T00:14:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.158+0000 7fceecc00640 1 -- 172.21.15.114:0/2521930012 >> v2:172.21.15.114:3300/0 conn(0x7fcee00d4590 msgr2=0x7fcee00da240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.159+0000 7fceecc00640 1 --2- 172.21.15.114:0/2521930012 >> v2:172.21.15.114:3300/0 conn(0x7fcee00d4590 0x7fcee00da240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.159+0000 7fceecc00640 1 -- 172.21.15.114:0/2521930012 >> v1:172.21.15.153:6789/0 conn(0x7fcee0007750 legacy=0x7fcee0006d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.159+0000 7fceecc00640 1 -- 172.21.15.114:0/2521930012 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee000ba90 con 0x7fcee00466a0 2024-05-09T00:14:14.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.160+0000 7fceee000640 1 --2- 172.21.15.114:0/2521930012 >> v2:172.21.15.114:3300/0 conn(0x7fcee00d4590 0x7fcee00da240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:14:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.164+0000 7fceecc00640 1 --2- 172.21.15.114:0/2521930012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee00d4050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcee00494a0 tx=0x7fced402b340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d90d0c506d7ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.165+0000 7fcee7e00640 1 -- 172.21.15.114:0/2521930012 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4038070 con 0x7fcee00466a0 2024-05-09T00:14:14.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.165+0000 7fcee7e00640 1 -- 172.21.15.114:0/2521930012 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced402bdd0 con 0x7fcee00466a0 2024-05-09T00:14:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.168+0000 7fcee7e00640 1 -- 172.21.15.114:0/2521930012 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc001710 con 0x7fcee00466a0 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 msgr2=0x7fcee00d4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 --2- 172.21.15.114:0/2521930012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee00d4050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcee00494a0 tx=0x7fced402b340 comp rx=0 tx=0).stop 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 shutdown_connections 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 --2- 172.21.15.114:0/2521930012 >> v2:172.21.15.114:3300/0 conn(0x7fcee00d4590 0x7fcee00da240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 --2- 172.21.15.114:0/2521930012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee00d4050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 >> 172.21.15.114:0/2521930012 conn(0x7fcee0006090 msgr2=0x7fcee00064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 shutdown_connections 2024-05-09T00:14:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.170+0000 7fceeea00640 1 -- 172.21.15.114:0/2521930012 wait complete. 2024-05-09T00:14:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.175+0000 7fceeea00640 1 Processor -- start 2024-05-09T00:14:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.176+0000 7fceeea00640 1 -- start start 2024-05-09T00:14:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.181+0000 7fceeea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee0040650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.181+0000 7fceeea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 0x7fcee0180780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.181+0000 7fceeea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee0040b90 0x7fcee0180cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceeea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcee003f240 con 0x7fcee0040b90 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceeea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcee00d49a0 con 0x7fcee00466a0 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceeea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcee000b3f0 con 0x7fcee00d4590 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceecc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 0x7fcee0180780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceecc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 0x7fcee0180780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45966/0 (socket says 172.21.15.114:45966) 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceed600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee0040650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceed600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee0040650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:55348/0 (socket says 172.21.15.114:55348) 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceed600640 1 -- 172.21.15.114:0/4158611066 learned_addr learned my addr 172.21.15.114:0/4158611066 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.182+0000 7fceee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee0040b90 0x7fcee0180cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.183+0000 7fceee000640 1 -- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 msgr2=0x7fcee0180780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.183+0000 7fceee000640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 0x7fcee0180780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.183+0000 7fceee000640 1 -- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 msgr2=0x7fcee0040650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.183+0000 7fceee000640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee0040650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.183+0000 7fceee000640 1 -- 172.21.15.114:0/4158611066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee0045750 con 0x7fcee0040b90 2024-05-09T00:14:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.183+0000 7fceecc00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 0x7fcee0180780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.184+0000 7fceee000640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee0040b90 0x7fcee0180cc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcee8050d90 tx=0x7fcee80777a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.185+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee809c070 con 0x7fcee0040b90 2024-05-09T00:14:14.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.185+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee003f760 con 0x7fcee0040b90 2024-05-09T00:14:14.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.186+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee0040130 con 0x7fcee0040b90 2024-05-09T00:14:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.186+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee808e530 con 0x7fcee0040b90 2024-05-09T00:14:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.188+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee808e940 con 0x7fcee0040b90 2024-05-09T00:14:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.189+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec4005290 con 0x7fcee0040b90 2024-05-09T00:14:14.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.192+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcee808eae0 con 0x7fcee0040b90 2024-05-09T00:14:14.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.193+0000 7fcee5600640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcec8076350 0x7fcec8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:14.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.193+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7fcee81147d0 con 0x7fcee0040b90 2024-05-09T00:14:14.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.194+0000 7fceed600640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcec8076350 0x7fcec8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.196+0000 7fceed600640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcec8076350 0x7fcec8078860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcedc001720 tx=0x7fcedc001670 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.204+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcee80dd620 con 0x7fcee0040b90 2024-05-09T00:14:14.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.708+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcec4005850 con 0x7fcee0040b90 2024-05-09T00:14:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.710+0000 7fcee5600640 1 -- 172.21.15.114:0/4158611066 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7fcee80e1920 con 0x7fcee0040b90 2024-05-09T00:14:14.709 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:14.709 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:14:14.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.714+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcec8076350 msgr2=0x7fcec8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.714+0000 7fceeea00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcec8076350 0x7fcec8078860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcedc001720 tx=0x7fcedc001670 comp rx=0 tx=0).stop 2024-05-09T00:14:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee0040b90 msgr2=0x7fcee0180cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee0040b90 0x7fcee0180cc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcee8050d90 tx=0x7fcee80777a0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 shutdown_connections 2024-05-09T00:14:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcec8076350 0x7fcec8078860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee0040b90 0x7fcee0180cc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcee00d4590 0x7fcee0180780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 --2- 172.21.15.114:0/4158611066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee00466a0 0x7fcee0040650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.717+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 >> 172.21.15.114:0/4158611066 conn(0x7fcee0006090 msgr2=0x7fcee00d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.718+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 shutdown_connections 2024-05-09T00:14:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:14.718+0000 7fceeea00640 1 -- 172.21.15.114:0/4158611066 wait complete. 2024-05-09T00:14:14.768 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:14:16.769 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.283+0000 7f0680a00640 1 Processor -- start 2024-05-09T00:14:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.283+0000 7f0680a00640 1 -- start start 2024-05-09T00:14:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.286+0000 7f0680a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c072d50 0x7f067c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.286+0000 7f0680a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f067c072890 0x7f067c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.286+0000 7f0680a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f067c160600 0x7f067c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.286+0000 7f0680a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f067c160170 con 0x7f067c160600 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.286+0000 7f067a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f067c160600 0x7f067c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f067c160600 0x7f067c0c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57570/0 (socket says 172.21.15.114:57570) 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 -- 172.21.15.114:0/664115139 learned_addr learned my addr 172.21.15.114:0/664115139 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f067c0c4ca0 con 0x7f067c072890 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f067c15a190 con 0x7f067c072d50 2024-05-09T00:14:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f0679400640 1 --2- 172.21.15.114:0/664115139 >> v2:172.21.15.153:3300/0 conn(0x7f067c072890 0x7f067c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f0679e00640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c072d50 0x7f067c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 -- 172.21.15.114:0/664115139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c072d50 msgr2=0x7f067c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c072d50 0x7f067c0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 -- 172.21.15.114:0/664115139 >> v2:172.21.15.153:3300/0 conn(0x7f067c072890 msgr2=0x7f067c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 --2- 172.21.15.114:0/664115139 >> v2:172.21.15.153:3300/0 conn(0x7f067c072890 0x7f067c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f067a800640 1 -- 172.21.15.114:0/664115139 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c15fe20 con 0x7f067c160600 2024-05-09T00:14:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.287+0000 7f0679e00640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c072d50 0x7f067c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:17.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.292+0000 7f067a800640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c160600 0x7f067c0c6050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f067c0703b0 tx=0x7f067402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d390ef5dd265b4ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:17.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.294+0000 7f0678a00640 1 -- 172.21.15.114:0/664115139 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674036070 con 0x7f067c160600 2024-05-09T00:14:17.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.294+0000 7f0678a00640 1 -- 172.21.15.114:0/664115139 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067402ae50 con 0x7f067c160600 2024-05-09T00:14:17.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.294+0000 7f0678a00640 1 -- 172.21.15.114:0/664115139 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674031860 con 0x7f067c160600 2024-05-09T00:14:17.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c160600 msgr2=0x7f067c0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:17.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c160600 0x7f067c0c6050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f067c0703b0 tx=0x7f067402a630 comp rx=0 tx=0).stop 2024-05-09T00:14:17.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 shutdown_connections 2024-05-09T00:14:17.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c160600 0x7f067c0c6050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 --2- 172.21.15.114:0/664115139 >> v2:172.21.15.153:3300/0 conn(0x7f067c072890 0x7f067c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 --2- 172.21.15.114:0/664115139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c072d50 0x7f067c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.295+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 >> 172.21.15.114:0/664115139 conn(0x7f067c06c680 msgr2=0x7f067c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:17.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.296+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 shutdown_connections 2024-05-09T00:14:17.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.296+0000 7f0680a00640 1 -- 172.21.15.114:0/664115139 wait complete. 2024-05-09T00:14:17.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.300+0000 7f0680a00640 1 Processor -- start 2024-05-09T00:14:17.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.300+0000 7f0680a00640 1 -- start start 2024-05-09T00:14:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.306+0000 7f0680a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c072890 0x7f067c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.306+0000 7f0680a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 0x7f067c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.306+0000 7f0680a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c160600 0x7f067c154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.306+0000 7f0680a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f067c0c42e0 con 0x7f067c072890 2024-05-09T00:14:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.306+0000 7f0680a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f067c15d490 con 0x7f067c072d50 2024-05-09T00:14:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.306+0000 7f0680a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f067c160a10 con 0x7f067c160600 2024-05-09T00:14:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.307+0000 7f0679400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 0x7f067c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.307+0000 7f0679400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 0x7f067c1547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:55376/0 (socket says 172.21.15.114:55376) 2024-05-09T00:14:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.307+0000 7f0679400640 1 -- 172.21.15.114:0/1719420721 learned_addr learned my addr 172.21.15.114:0/1719420721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.307+0000 7f067a800640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c160600 0x7f067c154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.307+0000 7f0679400640 1 -- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c160600 msgr2=0x7f067c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:17.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.308+0000 7f0679400640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c160600 0x7f067c154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.308+0000 7f0679400640 1 -- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c072890 msgr2=0x7f067c15e6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:14:17.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.308+0000 7f0679e00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c072890 0x7f067c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.308+0000 7f0679400640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c072890 0x7f067c15e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.308+0000 7f0679400640 1 -- 172.21.15.114:0/1719420721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c1e6730 con 0x7f067c072d50 2024-05-09T00:14:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.309+0000 7f0679400640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 0x7f067c1547d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f066c00e840 tx=0x7f066c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.310+0000 7f0679e00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c072890 0x7f067c15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.311+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c017070 con 0x7f067c072d50 2024-05-09T00:14:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.311+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c00c730 con 0x7f067c072d50 2024-05-09T00:14:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.311+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c00cb20 con 0x7f067c072d50 2024-05-09T00:14:17.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.311+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067c1e6a10 con 0x7f067c072d50 2024-05-09T00:14:17.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.312+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067c1e5d10 con 0x7f067c072d50 2024-05-09T00:14:17.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.313+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067c077430 con 0x7f067c072d50 2024-05-09T00:14:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.316+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f066c01a070 con 0x7f067c072d50 2024-05-09T00:14:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.317+0000 7f0672000640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f065c076320 0x7f065c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:17.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.317+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7010+0+0 (secure 0 0 0) 0x7f066c05d3d0 con 0x7f067c072d50 2024-05-09T00:14:17.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.320+0000 7f0679e00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f065c076320 0x7f065c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:17.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.324+0000 7f0679e00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f065c076320 0x7f065c078830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0668006fd0 tx=0x7f0668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.338+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f066c060de0 con 0x7f067c072d50 2024-05-09T00:14:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.948+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f067c0c4540 con 0x7f067c072d50 2024-05-09T00:14:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.951+0000 7f0672000640 1 -- 172.21.15.114:0/1719420721 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6503 (secure 0 0 0) 0x7f066c0650e0 con 0x7f067c072d50 2024-05-09T00:14:17.949 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:17.949 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:13:45.657394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":80,"addr":"172.21.15.114:6837/2960717153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2960717153},{"type":"v1","addr":"172.21.15.114:6837","nonce":2960717153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4226,"qdb_cluster":[4226]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:17.949 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-05-09T00:14:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.956+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f065c076320 msgr2=0x7f065c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.956+0000 7f0680a00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f065c076320 0x7f065c078830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0668006fd0 tx=0x7f0668008040 comp rx=0 tx=0).stop 2024-05-09T00:14:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.956+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 msgr2=0x7f067c1547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.956+0000 7f0680a00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 0x7f067c1547d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f066c00e840 tx=0x7f066c00ed00 comp rx=0 tx=0).stop 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.957+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 shutdown_connections 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.957+0000 7f0680a00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f065c076320 0x7f065c078830 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0668006fd0 tx=0x7f0668008040 comp rx=0 tx=0).stop 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.957+0000 7f0680a00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f067c160600 0x7f067c154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.957+0000 7f0680a00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f067c072d50 0x7f067c1547d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.957+0000 7f0680a00640 1 --2- 172.21.15.114:0/1719420721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067c072890 0x7f067c15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.957+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 >> 172.21.15.114:0/1719420721 conn(0x7f067c06c680 msgr2=0x7f067c0c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.958+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 shutdown_connections 2024-05-09T00:14:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:17.958+0000 7f0680a00640 1 -- 172.21.15.114:0/1719420721 wait complete. 2024-05-09T00:14:18.020 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:14:20.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:20.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.460+0000 7fa29e800640 1 Processor -- start 2024-05-09T00:14:20.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.460+0000 7fa29e800640 1 -- start start 2024-05-09T00:14:20.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.463+0000 7fa29e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa2980c8f40 0x7fa298159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.463+0000 7fa29e800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa29815c630 0x7fa29815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.463+0000 7fa29e800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa29815fcc0 con 0x7fa298070770 2024-05-09T00:14:20.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.463+0000 7fa29e800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa29815a0e0 con 0x7fa2980c8f40 2024-05-09T00:14:20.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.463+0000 7fa29e800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa29815ff60 con 0x7fa29815c630 2024-05-09T00:14:20.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.466+0000 7fa296a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa298070770 0x7fa2980c64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38596/0 (socket says 172.21.15.114:38596) 2024-05-09T00:14:20.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.466+0000 7fa296a00640 1 -- 172.21.15.114:0/187304748 learned_addr learned my addr 172.21.15.114:0/187304748 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:14:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.467+0000 7fa297400640 1 --2- 172.21.15.114:0/187304748 >> v2:172.21.15.114:3300/0 conn(0x7fa2980c8f40 0x7fa298159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.468+0000 7fa297e00640 1 --2- 172.21.15.114:0/187304748 >> v2:172.21.15.153:3300/0 conn(0x7fa29815c630 0x7fa29815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.469+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128910875 0 0) 0x7fa29815fcc0 con 0x7fa298070770 2024-05-09T00:14:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.469+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa27c003520 con 0x7fa298070770 2024-05-09T00:14:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.470+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4094351451 0 0) 0x7fa27c003520 con 0x7fa298070770 2024-05-09T00:14:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.470+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 >> v2:172.21.15.153:3300/0 conn(0x7fa29815c630 msgr2=0x7fa29815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.470+0000 7fa296000640 1 --2- 172.21.15.114:0/187304748 >> v2:172.21.15.153:3300/0 conn(0x7fa29815c630 0x7fa29815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.470+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 >> v2:172.21.15.114:3300/0 conn(0x7fa2980c8f40 msgr2=0x7fa298159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:20.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 --2- 172.21.15.114:0/187304748 >> v2:172.21.15.114:3300/0 conn(0x7fa2980c8f40 0x7fa298159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa298160240 con 0x7fa298070770 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fa2800016f0 con 0x7fa298070770 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 >> v1:172.21.15.114:6789/0 conn(0x7fa298070770 legacy=0x7fa2980c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa27c003a50 0x7fa27c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa27c004800 0x7fa27c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c005310 0x7fa27c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa29815ff60 con 0x7fa27c004800 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c00c2a0 con 0x7fa27c005310 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c00c4a0 con 0x7fa27c003a50 2024-05-09T00:14:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.475+0000 7fa297400640 1 --2- 172.21.15.114:0/187304748 >> v2:172.21.15.114:3300/0 conn(0x7fa2980c8f40 0x7fa298159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:20.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.477+0000 7fa297400640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa27c003a50 0x7fa27c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.477+0000 7fa296a00640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa27c004800 0x7fa27c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.477+0000 7fa297e00640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c005310 0x7fa27c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.479+0000 7fa297400640 1 -- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c005310 msgr2=0x7fa27c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:20.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.479+0000 7fa297400640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c005310 0x7fa27c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.479+0000 7fa297400640 1 -- 172.21.15.114:0/187304748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa27c004800 msgr2=0x7fa27c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.479+0000 7fa297400640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa27c004800 0x7fa27c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.479+0000 7fa297400640 1 -- 172.21.15.114:0/187304748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa298160240 con 0x7fa27c003a50 2024-05-09T00:14:20.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.484+0000 7fa296a00640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa27c004800 0x7fa27c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:14:20.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.485+0000 7fa297e00640 1 -- 172.21.15.114:0/187304748 reap_dead start 2024-05-09T00:14:20.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.487+0000 7fa297400640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa27c003a50 0x7fa27c003ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2880073b0 tx=0x7fa27c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9813239fc0c593c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.490+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288032070 con 0x7fa27c003a50 2024-05-09T00:14:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.491+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa288003b90 con 0x7fa27c003a50 2024-05-09T00:14:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.491+0000 7fa296000640 1 -- 172.21.15.114:0/187304748 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288009c80 con 0x7fa27c003a50 2024-05-09T00:14:20.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.493+0000 7fa29e800640 1 -- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa27c003a50 msgr2=0x7fa27c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:20.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.493+0000 7fa29e800640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa27c003a50 0x7fa27c003ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2880073b0 tx=0x7fa27c005830 comp rx=0 tx=0).stop 2024-05-09T00:14:20.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.494+0000 7fa29e800640 1 -- 172.21.15.114:0/187304748 shutdown_connections 2024-05-09T00:14:20.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.494+0000 7fa29e800640 1 --2- 172.21.15.114:0/187304748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa27c003a50 0x7fa27c003ec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.494+0000 7fa29e800640 1 -- 172.21.15.114:0/187304748 >> 172.21.15.114:0/187304748 conn(0x7fa2980c9d40 msgr2=0x7fa2980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:20.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.494+0000 7fa29e800640 1 -- 172.21.15.114:0/187304748 shutdown_connections 2024-05-09T00:14:20.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.494+0000 7fa29e800640 1 -- 172.21.15.114:0/187304748 wait complete. 2024-05-09T00:14:20.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.501+0000 7fa29e800640 1 Processor -- start 2024-05-09T00:14:20.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.501+0000 7fa29e800640 1 -- start start 2024-05-09T00:14:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.503+0000 7fa29e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 0x7fa2980abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.507+0000 7fa29e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2981584b0 0x7fa298157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.508+0000 7fa297400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 0x7fa2980abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.508+0000 7fa297400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 0x7fa2980abad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:45372/0 (socket says 172.21.15.114:45372) 2024-05-09T00:14:20.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.508+0000 7fa296a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2981584b0 0x7fa298157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.509+0000 7fa296a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2981584b0 0x7fa298157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42794/0 (socket says 172.21.15.114:42794) 2024-05-09T00:14:20.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.509+0000 7fa297400640 1 -- 172.21.15.114:0/4043121149 learned_addr learned my addr 172.21.15.114:0/4043121149 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:20.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.509+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2981e9270 0x7fa2981e9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.511+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa298070b80 con 0x7fa2981584b0 2024-05-09T00:14:20.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.511+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa298160800 con 0x7fa27c003a50 2024-05-09T00:14:20.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.511+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa298159ba0 con 0x7fa2981e9270 2024-05-09T00:14:20.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.513+0000 7fa297e00640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2981e9270 0x7fa2981e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.514+0000 7fa297400640 1 -- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2981e9270 msgr2=0x7fa2981e9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:20.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.514+0000 7fa297400640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2981e9270 0x7fa2981e9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.514+0000 7fa297400640 1 -- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2981584b0 msgr2=0x7fa298157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:20.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.514+0000 7fa297400640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2981584b0 0x7fa298157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:20.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.515+0000 7fa297400640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980ac010 con 0x7fa27c003a50 2024-05-09T00:14:20.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.516+0000 7fa297400640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 0x7fa2980abad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa28802b130 tx=0x7fa288004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:20.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.518+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288046070 con 0x7fa27c003a50 2024-05-09T00:14:20.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.519+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa288003990 con 0x7fa27c003a50 2024-05-09T00:14:20.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.519+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288046070 con 0x7fa27c003a50 2024-05-09T00:14:20.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.521+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2980c4330 con 0x7fa27c003a50 2024-05-09T00:14:20.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.521+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2981f5a30 con 0x7fa27c003a50 2024-05-09T00:14:20.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.526+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2980ad420 con 0x7fa27c003a50 2024-05-09T00:14:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.527+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa288035070 con 0x7fa27c003a50 2024-05-09T00:14:20.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.529+0000 7fa28f400640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa2740764d0 0x7fa2740789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.531+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7fa2880b7aa0 con 0x7fa27c003a50 2024-05-09T00:14:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.531+0000 7fa296a00640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa2740764d0 0x7fa2740789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:20.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.534+0000 7fa296a00640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa2740764d0 0x7fa2740789e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa280001160 tx=0x7fa280007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:20.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:20.549+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2980ad420 con 0x7fa27c003a50 2024-05-09T00:14:21.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.045+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa298077430 con 0x7fa27c003a50 2024-05-09T00:14:21.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.048+0000 7fa28f400640 1 -- 172.21.15.114:0/4043121149 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5667 (secure 0 0 0) 0x7fa288080730 con 0x7fa27c003a50 2024-05-09T00:14:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:21.049 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:19.929064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:21.051 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 33 2024-05-09T00:14:21.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.052+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa2740764d0 msgr2=0x7fa2740789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:21.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.053+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa2740764d0 0x7fa2740789e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa280001160 tx=0x7fa280007970 comp rx=0 tx=0).stop 2024-05-09T00:14:21.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.053+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 msgr2=0x7fa2980abad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:21.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.053+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 0x7fa2980abad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa28802b130 tx=0x7fa288004ab0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.055+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 shutdown_connections 2024-05-09T00:14:21.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.055+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa2740764d0 0x7fa2740789e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.055+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2981e9270 0x7fa2981e9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.055+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2981584b0 0x7fa298157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.055+0000 7fa29e800640 1 --2- 172.21.15.114:0/4043121149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c003a50 0x7fa2980abad0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.055+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 >> 172.21.15.114:0/4043121149 conn(0x7fa2980c9d40 msgr2=0x7fa2980aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:21.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.056+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 shutdown_connections 2024-05-09T00:14:21.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.056+0000 7fa29e800640 1 -- 172.21.15.114:0/4043121149 wait complete. 2024-05-09T00:14:21.098 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-05-09T00:14:21.098 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T00:14:21.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:21.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.703+0000 7f55c1e00640 1 Processor -- start 2024-05-09T00:14:21.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.703+0000 7f55c1e00640 1 -- start start 2024-05-09T00:14:21.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.706+0000 7f55c1e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc06e240 0x7f55bc06fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.706+0000 7f55c1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55bc15eee0 0x7f55bc0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.706+0000 7f55c1e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55bc0c52f0 0x7f55bc165390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.706+0000 7f55c1e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f55bc074480 con 0x7f55bc15eee0 2024-05-09T00:14:21.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.706+0000 7f55c1e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f55bc164f00 con 0x7f55bc0c52f0 2024-05-09T00:14:21.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.706+0000 7f55c1e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc073ec0 con 0x7f55bc06e240 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55bc15eee0 0x7f55bc0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55bc15eee0 0x7f55bc0c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42800/0 (socket says 172.21.15.114:42800) 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 -- 172.21.15.114:0/2311903735 learned_addr learned my addr 172.21.15.114:0/2311903735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55bb400640 1 --2- 172.21.15.114:0/2311903735 >> v2:172.21.15.153:3300/0 conn(0x7f55bc0c52f0 0x7f55bc165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 -- 172.21.15.114:0/2311903735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc06e240 msgr2=0x7f55bc06fe40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 --2- 172.21.15.114:0/2311903735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc06e240 0x7f55bc06fe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 -- 172.21.15.114:0/2311903735 >> v2:172.21.15.153:3300/0 conn(0x7f55bc0c52f0 msgr2=0x7f55bc165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:21.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 --2- 172.21.15.114:0/2311903735 >> v2:172.21.15.153:3300/0 conn(0x7f55bc0c52f0 0x7f55bc165390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.707+0000 7f55ba000640 1 -- 172.21.15.114:0/2311903735 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc0741a0 con 0x7f55bc15eee0 2024-05-09T00:14:21.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.709+0000 7f55ba000640 1 --2- 172.21.15.114:0/2311903735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc0c4db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0c6da0 tx=0x7f55a402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cb17c231e0ddd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:21.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.712+0000 7f55b9600640 1 -- 172.21.15.114:0/2311903735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4037070 con 0x7f55bc15eee0 2024-05-09T00:14:21.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.712+0000 7f55b9600640 1 -- 172.21.15.114:0/2311903735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a402ae50 con 0x7f55bc15eee0 2024-05-09T00:14:21.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.712+0000 7f55b9600640 1 -- 172.21.15.114:0/2311903735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4032660 con 0x7f55bc15eee0 2024-05-09T00:14:21.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.716+0000 7f55c1e00640 1 -- 172.21.15.114:0/2311903735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 msgr2=0x7f55bc0c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:21.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.716+0000 7f55c1e00640 1 --2- 172.21.15.114:0/2311903735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc0c4db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0c6da0 tx=0x7f55a402a100 comp rx=0 tx=0).stop 2024-05-09T00:14:21.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.718+0000 7f55c1e00640 1 -- 172.21.15.114:0/2311903735 shutdown_connections 2024-05-09T00:14:21.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.718+0000 7f55c1e00640 1 --2- 172.21.15.114:0/2311903735 >> v2:172.21.15.153:3300/0 conn(0x7f55bc0c52f0 0x7f55bc165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.718+0000 7f55c1e00640 1 --2- 172.21.15.114:0/2311903735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc0c4db0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.718+0000 7f55c1e00640 1 --2- 172.21.15.114:0/2311903735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc06e240 0x7f55bc06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.718+0000 7f55c1e00640 1 -- 172.21.15.114:0/2311903735 >> 172.21.15.114:0/2311903735 conn(0x7f55bc0c5ea0 msgr2=0x7f55bc0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:21.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.718+0000 7f55c1e00640 1 -- 172.21.15.114:0/2311903735 shutdown_connections 2024-05-09T00:14:21.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.722+0000 7f55c1e00640 1 -- 172.21.15.114:0/2311903735 wait complete. 2024-05-09T00:14:21.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.724+0000 7f55c1e00640 1 Processor -- start 2024-05-09T00:14:21.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.730+0000 7f55c1e00640 1 -- start start 2024-05-09T00:14:21.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.738+0000 7f55c1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc06e240 0x7f55bc150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.738+0000 7f55c1e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 0x7f55bc151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.738+0000 7f55c1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.738+0000 7f55c1e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc072290 con 0x7f55bc15eee0 2024-05-09T00:14:21.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.738+0000 7f55c1e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc072110 con 0x7f55bc06e240 2024-05-09T00:14:21.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.738+0000 7f55c1e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc0c38d0 con 0x7f55bc0c52f0 2024-05-09T00:14:21.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.741+0000 7f55ba000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 0x7f55bc151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.742+0000 7f55ba000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 0x7f55bc151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:40942/0 (socket says 172.21.15.114:40942) 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.742+0000 7f55ba000640 1 -- 172.21.15.114:0/503576085 learned_addr learned my addr 172.21.15.114:0/503576085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.742+0000 7f55baa00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc06e240 0x7f55bc150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.743+0000 7f55ba000640 1 -- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc06e240 msgr2=0x7f55bc150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.743+0000 7f55ba000640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc06e240 0x7f55bc150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.743+0000 7f55ba000640 1 -- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 msgr2=0x7f55bc152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.743+0000 7f55bb400640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.744+0000 7f55ba000640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:21.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.744+0000 7f55ba000640 1 -- 172.21.15.114:0/503576085 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc14fb10 con 0x7f55bc0c52f0 2024-05-09T00:14:21.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.744+0000 7f55bb400640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:21.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.746+0000 7f55ba000640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 0x7f55bc151380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009960 tx=0x7f55a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:21.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.748+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4041070 con 0x7f55bc0c52f0 2024-05-09T00:14:21.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.748+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a403c670 con 0x7f55bc0c52f0 2024-05-09T00:14:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.748+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4037040 con 0x7f55bc0c52f0 2024-05-09T00:14:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.749+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc14f870 con 0x7f55bc0c52f0 2024-05-09T00:14:21.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.749+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc08d240 con 0x7f55bc0c52f0 2024-05-09T00:14:21.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.753+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc078430 con 0x7f55bc0c52f0 2024-05-09T00:14:21.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.755+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55a4044070 con 0x7f55bc0c52f0 2024-05-09T00:14:21.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.762+0000 7f55b3400640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f55980763a0 0x7f55980788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:21.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.762+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f55a40b8380 con 0x7f55bc0c52f0 2024-05-09T00:14:21.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.764+0000 7f55baa00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f55980763a0 0x7f55980788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:21.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.766+0000 7f55baa00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f55980763a0 0x7f55980788b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f55bc073bd0 tx=0x7f55b40072d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:21.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:21.769+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55a404b030 con 0x7f55bc0c52f0 2024-05-09T00:14:22.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.221+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55bc0c50d0 con 0x7f55bc0c52f0 2024-05-09T00:14:22.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.224+0000 7f55b3400640 1 -- 172.21.15.114:0/503576085 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5667 (secure 0 0 0) 0x7f55a40817e0 con 0x7f55bc0c52f0 2024-05-09T00:14:22.223 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:22.223 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:19.929064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:22.224 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 33 2024-05-09T00:14:22.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f55980763a0 msgr2=0x7f55980788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f55980763a0 0x7f55980788b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f55bc073bd0 tx=0x7f55b40072d0 comp rx=0 tx=0).stop 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 msgr2=0x7f55bc151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 0x7f55bc151380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009960 tx=0x7f55a40046c0 comp rx=0 tx=0).stop 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 shutdown_connections 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f55980763a0 0x7f55980788b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc15eee0 0x7f55bc152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0c52f0 0x7f55bc151380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 --2- 172.21.15.114:0/503576085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc06e240 0x7f55bc150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.231+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 >> 172.21.15.114:0/503576085 conn(0x7f55bc0c5ea0 msgr2=0x7f55bc08db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:22.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.232+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 shutdown_connections 2024-05-09T00:14:22.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:22.232+0000 7f55c1e00640 1 -- 172.21.15.114:0/503576085 wait complete. 2024-05-09T00:14:22.294 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 33, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 33, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4819": { "addr": "172.21.15.153:6835/4100525107", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6834", "nonce": 4100525107, "type": "v2" }, { "addr": "172.21.15.153:6835", "nonce": 4100525107, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4819, "incarnation": 33, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:14:19.929064+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4819 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4914": { "addr": "172.21.15.114:6836/1891949153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 1891949153, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 1891949153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4914, "incarnation": 25, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:13:39.549912+0000", "qdb_cluster": [ 4914 ], "qdb_leader": 4914, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4914 } } } ], "standbys": [ { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 31, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:14:24.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:24.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.802+0000 7f8647200640 1 Processor -- start 2024-05-09T00:14:24.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.802+0000 7f8647200640 1 -- start start 2024-05-09T00:14:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.804+0000 7f8647200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8640158b10 0x7f86400af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.804+0000 7f8647200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864015b7f0 con 0x7f86400c8760 2024-05-09T00:14:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.804+0000 7f8647200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864015bad0 con 0x7f86400af570 2024-05-09T00:14:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.804+0000 7f8647200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f864015c5b0 con 0x7f8640158b10 2024-05-09T00:14:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.804+0000 7f863fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f86400c8760 0x7f8640155740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38600/0 (socket says 172.21.15.114:38600) 2024-05-09T00:14:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.804+0000 7f863fe00640 1 -- 172.21.15.114:0/2578798157 learned_addr learned my addr 172.21.15.114:0/2578798157 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:14:24.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.806+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270382828 0 0) 0x7f864015bad0 con 0x7f86400af570 2024-05-09T00:14:24.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.806+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8624003520 con 0x7f86400af570 2024-05-09T00:14:24.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.807+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489992859 0 0) 0x7f864015b7f0 con 0x7f86400c8760 2024-05-09T00:14:24.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.807+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f864015bad0 con 0x7f86400c8760 2024-05-09T00:14:24.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863f400640 1 --2- 172.21.15.114:0/2578798157 >> v2:172.21.15.114:3300/0 conn(0x7f8640158b10 0x7f86400af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3120604123 0 0) 0x7f8624003520 con 0x7f86400af570 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 >> v2:172.21.15.114:3300/0 conn(0x7f8640158b10 msgr2=0x7f86400af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 --2- 172.21.15.114:0/2578798157 >> v2:172.21.15.114:3300/0 conn(0x7f8640158b10 0x7f86400af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 >> v1:172.21.15.114:6789/0 conn(0x7f86400c8760 legacy=0x7f8640155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864015bdb0 con 0x7f86400af570 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f8638001a70 con 0x7f86400af570 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 >> v1:172.21.15.153:6789/0 conn(0x7f86400af570 legacy=0x7f86400cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8624003c30 0x7f8624004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8624004800 0x7f8624004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86240053f0 0x7f862400ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f864015c5b0 con 0x7f8624004800 2024-05-09T00:14:24.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f862400c360 con 0x7f86240053f0 2024-05-09T00:14:24.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.808+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f862400c560 con 0x7f8624003c30 2024-05-09T00:14:24.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.810+0000 7f8645200640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86240053f0 0x7f862400ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:24.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.811+0000 7f8645200640 1 -- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8624003c30 msgr2=0x7f8624004080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:14:24.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.811+0000 7f8645200640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8624003c30 0x7f8624004080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.811+0000 7f8645200640 1 -- 172.21.15.114:0/2578798157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8624004800 msgr2=0x7f8624004c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:14:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.811+0000 7f8645200640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8624004800 0x7f8624004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.811+0000 7f8645200640 1 -- 172.21.15.114:0/2578798157 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864015bdb0 con 0x7f86240053f0 2024-05-09T00:14:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.811+0000 7f863f400640 1 --2- 172.21.15.114:0/2578798157 >> v2:172.21.15.114:3300/0 conn(0x7f8640158b10 0x7f86400af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.812+0000 7f8645200640 1 -- 172.21.15.114:0/2578798157 reap_dead start 2024-05-09T00:14:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.813+0000 7f8645200640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86240053f0 0x7f862400ba80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86400c4570 tx=0x7f8624005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b7519677bd9fe4b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:24.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.813+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638032070 con 0x7f86240053f0 2024-05-09T00:14:24.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.814+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8638006d50 con 0x7f86240053f0 2024-05-09T00:14:24.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.814+0000 7f863ea00640 1 -- 172.21.15.114:0/2578798157 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863800c0e0 con 0x7f86240053f0 2024-05-09T00:14:24.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.817+0000 7f8647200640 1 -- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86240053f0 msgr2=0x7f862400ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:24.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.817+0000 7f8647200640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86240053f0 0x7f862400ba80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86400c4570 tx=0x7f8624005830 comp rx=0 tx=0).stop 2024-05-09T00:14:24.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.819+0000 7f8647200640 1 -- 172.21.15.114:0/2578798157 shutdown_connections 2024-05-09T00:14:24.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.819+0000 7f8647200640 1 --2- 172.21.15.114:0/2578798157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86240053f0 0x7f862400ba80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:24.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.819+0000 7f8647200640 1 -- 172.21.15.114:0/2578798157 >> 172.21.15.114:0/2578798157 conn(0x7f8640068ef0 msgr2=0x7f86400cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:24.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.821+0000 7f8647200640 1 -- 172.21.15.114:0/2578798157 shutdown_connections 2024-05-09T00:14:24.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.821+0000 7f8647200640 1 -- 172.21.15.114:0/2578798157 wait complete. 2024-05-09T00:14:24.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.831+0000 7f8647200640 1 Processor -- start 2024-05-09T00:14:24.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.832+0000 7f8647200640 1 -- start start 2024-05-09T00:14:24.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.836+0000 7f8647200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86401e3b70 0x7f86401e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.836+0000 7f8647200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86401e1440 0x7f864015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.836+0000 7f8647200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 0x7f8640154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.837+0000 7f8647200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86400cd1f0 con 0x7f8640154670 2024-05-09T00:14:24.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.837+0000 7f8645200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 0x7f8640154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:24.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.837+0000 7f8645200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 0x7f8640154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42822/0 (socket says 172.21.15.114:42822) 2024-05-09T00:14:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.837+0000 7f8645200640 1 -- 172.21.15.114:0/4213068825 learned_addr learned my addr 172.21.15.114:0/4213068825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.838+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86400cd070 con 0x7f86401e1440 2024-05-09T00:14:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.838+0000 7f863f400640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86401e1440 0x7f864015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.838+0000 7f863fe00640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86401e3b70 0x7f86401e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.838+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f86400af030 con 0x7f86401e3b70 2024-05-09T00:14:24.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.839+0000 7f8645200640 1 -- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86401e3b70 msgr2=0x7f86401e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:24.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.840+0000 7f8645200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86401e3b70 0x7f86401e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:24.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.840+0000 7f8645200640 1 -- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86401e1440 msgr2=0x7f864015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:24.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.840+0000 7f8645200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86401e1440 0x7f864015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:24.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.840+0000 7f8645200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86401e31c0 con 0x7f8640154670 2024-05-09T00:14:24.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.840+0000 7f863f400640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86401e1440 0x7f864015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:24.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.841+0000 7f863fe00640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86401e3b70 0x7f86401e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:24.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.841+0000 7f8645200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 0x7f8640154a80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f863800c580 tx=0x7f8638001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:24.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.842+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638032070 con 0x7f8640154670 2024-05-09T00:14:24.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.843+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8638006b50 con 0x7f8640154670 2024-05-09T00:14:24.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.843+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380054f0 con 0x7f8640154670 2024-05-09T00:14:24.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.844+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86400c67c0 con 0x7f8640154670 2024-05-09T00:14:24.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.851+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8638035070 con 0x7f8640154670 2024-05-09T00:14:24.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.851+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86401eeb30 con 0x7f8640154670 2024-05-09T00:14:24.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.853+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86400c7510 con 0x7f8640154670 2024-05-09T00:14:24.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.854+0000 7f8637e00640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8620076320 0x7f8620078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:24.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.855+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f863807c4a0 con 0x7f8640154670 2024-05-09T00:14:24.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.856+0000 7f863fe00640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8620076320 0x7f8620078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:24.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.858+0000 7f863fe00640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8620076320 0x7f8620078830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8630000f60 tx=0x7f8630009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:24.865+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f86400c7510 con 0x7f8640154670 2024-05-09T00:14:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.413+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8640078430 con 0x7f8640154670 2024-05-09T00:14:25.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.416+0000 7f8637e00640 1 -- 172.21.15.114:0/4213068825 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5668 (secure 0 0 0) 0x7f8638080910 con 0x7f8640154670 2024-05-09T00:14:25.418 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:25.418 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:24.428834+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 35 2024-05-09T00:14:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.422+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8620076320 msgr2=0x7f8620078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.422+0000 7f8647200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8620076320 0x7f8620078830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8630000f60 tx=0x7f8630009040 comp rx=0 tx=0).stop 2024-05-09T00:14:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.422+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 msgr2=0x7f8640154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.422+0000 7f8647200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 0x7f8640154a80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f863800c580 tx=0x7f8638001c10 comp rx=0 tx=0).stop 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 shutdown_connections 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8620076320 0x7f8620078830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8640154670 0x7f8640154a80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86401e1440 0x7f864015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 --2- 172.21.15.114:0/4213068825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86401e3b70 0x7f86401e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 >> 172.21.15.114:0/4213068825 conn(0x7f8640068ef0 msgr2=0x7f86400cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 shutdown_connections 2024-05-09T00:14:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:25.423+0000 7f8647200640 1 -- 172.21.15.114:0/4213068825 wait complete. 2024-05-09T00:14:25.484 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:14:27.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:27.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.922+0000 7f2e67e00640 1 Processor -- start 2024-05-09T00:14:27.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.923+0000 7f2e67e00640 1 -- start start 2024-05-09T00:14:27.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.925+0000 7f2e67e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2e680c4080 0x7f2e6808ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.925+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e680cb790 0x7f2e681589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.925+0000 7f2e67e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e680c8a50 con 0x7f2e6806e630 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.925+0000 7f2e67e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6806dec0 con 0x7f2e680c4080 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.925+0000 7f2e67e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6806e1a0 con 0x7f2e680cb790 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.925+0000 7f2e66a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2e680c4080 0x7f2e6808ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.926+0000 7f2e66a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2e680c4080 0x7f2e6808ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42600/0 (socket says 172.21.15.114:42600) 2024-05-09T00:14:27.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.926+0000 7f2e66a00640 1 -- 172.21.15.114:0/3049710180 learned_addr learned my addr 172.21.15.114:0/3049710180 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:27.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.926+0000 7f2e5fe00640 1 --2- 172.21.15.114:0/3049710180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e680cb790 0x7f2e681589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:27.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.926+0000 7f2e66a00640 1 -- 172.21.15.114:0/3049710180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e680cb790 msgr2=0x7f2e681589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:27.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.927+0000 7f2e66a00640 1 --2- 172.21.15.114:0/3049710180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e680cb790 0x7f2e681589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:27.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.927+0000 7f2e66a00640 1 -- 172.21.15.114:0/3049710180 >> v1:172.21.15.114:6789/0 conn(0x7f2e6806e630 legacy=0x7f2e6806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:27.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.927+0000 7f2e66a00640 1 -- 172.21.15.114:0/3049710180 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e680c8050 con 0x7f2e680c4080 2024-05-09T00:14:27.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.929+0000 7f2e66a00640 1 --2- 172.21.15.114:0/3049710180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6808ed30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009e50 tx=0x7f2e5802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9b20b566982a36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:27.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.930+0000 7f2e66000640 1 -- 172.21.15.114:0/3049710180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58036070 con 0x7f2e680c4080 2024-05-09T00:14:27.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.930+0000 7f2e66000640 1 -- 172.21.15.114:0/3049710180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58031600 con 0x7f2e680c4080 2024-05-09T00:14:27.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.930+0000 7f2e66000640 1 -- 172.21.15.114:0/3049710180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e580319d0 con 0x7f2e680c4080 2024-05-09T00:14:27.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.931+0000 7f2e67e00640 1 -- 172.21.15.114:0/3049710180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 msgr2=0x7f2e6808ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:27.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.931+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3049710180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6808ed30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009e50 tx=0x7f2e5802a710 comp rx=0 tx=0).stop 2024-05-09T00:14:27.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.932+0000 7f2e67e00640 1 -- 172.21.15.114:0/3049710180 shutdown_connections 2024-05-09T00:14:27.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.932+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3049710180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e680cb790 0x7f2e681589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:27.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.932+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3049710180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6808ed30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:27.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.932+0000 7f2e67e00640 1 -- 172.21.15.114:0/3049710180 >> 172.21.15.114:0/3049710180 conn(0x7f2e680cd8e0 msgr2=0x7f2e680cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:27.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.933+0000 7f2e67e00640 1 -- 172.21.15.114:0/3049710180 shutdown_connections 2024-05-09T00:14:27.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.933+0000 7f2e67e00640 1 -- 172.21.15.114:0/3049710180 wait complete. 2024-05-09T00:14:27.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.938+0000 7f2e67e00640 1 Processor -- start 2024-05-09T00:14:27.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.938+0000 7f2e67e00640 1 -- start start 2024-05-09T00:14:27.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.941+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6806e630 0x7f2e681ee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:27.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.941+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:27.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e66a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6806e630 0x7f2e681ee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:27.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e66a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6806e630 0x7f2e681ee7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45238/0 (socket says 172.21.15.114:45238) 2024-05-09T00:14:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e66a00640 1 -- 172.21.15.114:0/3970083596 learned_addr learned my addr 172.21.15.114:0/3970083596 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e680cb790 0x7f2e681eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6806d840 con 0x7f2e680c4080 2024-05-09T00:14:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6806d6c0 con 0x7f2e680cb790 2024-05-09T00:14:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.942+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6806ea40 con 0x7f2e6806e630 2024-05-09T00:14:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e5fe00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:27.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e67400640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e680cb790 0x7f2e681eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:27.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e5fe00640 1 -- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6806e630 msgr2=0x7f2e681ee7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:27.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e5fe00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6806e630 0x7f2e681ee7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:27.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e5fe00640 1 -- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e680cb790 msgr2=0x7f2e681eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:27.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e5fe00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e680cb790 0x7f2e681eb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:27.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.943+0000 7f2e5fe00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6814edd0 con 0x7f2e680c4080 2024-05-09T00:14:27.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.944+0000 7f2e5fe00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6815b3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000e8a0 tx=0x7f2e5000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:27.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.944+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50017070 con 0x7f2e680c4080 2024-05-09T00:14:27.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.944+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5000c940 con 0x7f2e680c4080 2024-05-09T00:14:27.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.944+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50009e60 con 0x7f2e680c4080 2024-05-09T00:14:27.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.944+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6814f0b0 con 0x7f2e680c4080 2024-05-09T00:14:27.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.944+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6815aeb0 con 0x7f2e680c4080 2024-05-09T00:14:27.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.948+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e40005290 con 0x7f2e680c4080 2024-05-09T00:14:27.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.948+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e5001a070 con 0x7f2e680c4080 2024-05-09T00:14:27.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.950+0000 7f2e5f400640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e440763d0 0x7f2e440788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:27.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.950+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f2e50097d10 con 0x7f2e680c4080 2024-05-09T00:14:27.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.951+0000 7f2e66a00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e440763d0 0x7f2e440788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:27.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.953+0000 7f2e66a00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e440763d0 0x7f2e440788e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e5802a750 tx=0x7f2e58009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:27.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:27.963+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e500610e0 con 0x7f2e680c4080 2024-05-09T00:14:28.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.455+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e40005580 con 0x7f2e680c4080 2024-05-09T00:14:28.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.456+0000 7f2e5f400640 1 -- 172.21.15.114:0/3970083596 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5675 (secure 0 0 0) 0x7f2e500609e0 con 0x7f2e680c4080 2024-05-09T00:14:28.454 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:28.454 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:28.454 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 36 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e440763d0 msgr2=0x7f2e440788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e440763d0 0x7f2e440788e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e5802a750 tx=0x7f2e58009000 comp rx=0 tx=0).stop 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 msgr2=0x7f2e6815b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6815b3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000e8a0 tx=0x7f2e5000ed60 comp rx=0 tx=0).stop 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 shutdown_connections 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2e440763d0 0x7f2e440788e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e680cb790 0x7f2e681eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e680c4080 0x7f2e6815b3d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 --2- 172.21.15.114:0/3970083596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6806e630 0x7f2e681ee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 >> 172.21.15.114:0/3970083596 conn(0x7f2e680cd8e0 msgr2=0x7f2e680adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 shutdown_connections 2024-05-09T00:14:28.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:28.460+0000 7f2e67e00640 1 -- 172.21.15.114:0/3970083596 wait complete. 2024-05-09T00:14:28.495 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=4226 2024-05-09T00:14:28.495 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.a 2024-05-09T00:14:28.820 INFO:tasks.ceph.mds.d.smithi153.stderr:2024-05-09T00:14:28.822+0000 7fd1f7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:14:31.496 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-05-09T00:14:31.496 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T00:14:31.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T00:14:31.509 INFO:tasks.ceph.mds.a:Started 2024-05-09T00:14:31.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:32.023 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-05-09T00:14:32.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.115+0000 7f633c800640 1 Processor -- start 2024-05-09T00:14:32.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.116+0000 7f633c800640 1 -- start start 2024-05-09T00:14:32.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.119+0000 7f633c800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6330035520 0x7f633004b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:32.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.120+0000 7f633c800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63300075a0 0x7f63300db220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:32.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.120+0000 7f633c800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633000e4a0 con 0x7f63300079b0 2024-05-09T00:14:32.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.121+0000 7f633c800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f633000f0b0 con 0x7f63300075a0 2024-05-09T00:14:32.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.121+0000 7f6339e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6330035520 0x7f633004b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:32.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.121+0000 7f6339e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6330035520 0x7f633004b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:55686/0 (socket says 172.21.15.114:55686) 2024-05-09T00:14:32.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.121+0000 7f6339e00640 1 -- 172.21.15.114:0/1069065386 learned_addr learned my addr 172.21.15.114:0/1069065386 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:32.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.121+0000 7f633c800640 1 -- 172.21.15.114:0/1069065386 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f633000e780 con 0x7f6330035520 2024-05-09T00:14:32.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.121+0000 7f6339400640 1 --2- 172.21.15.114:0/1069065386 >> v2:172.21.15.114:3300/0 conn(0x7f63300075a0 0x7f63300db220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:32.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.122+0000 7f6338a00640 1 -- 172.21.15.114:0/1069065386 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907876878 0 0) 0x7f633000e4a0 con 0x7f63300079b0 2024-05-09T00:14:32.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.122+0000 7f6338a00640 1 -- 172.21.15.114:0/1069065386 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f631c003520 con 0x7f63300079b0 2024-05-09T00:14:32.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.122+0000 7f6339400640 1 -- 172.21.15.114:0/1069065386 >> v2:172.21.15.153:3300/0 conn(0x7f6330035520 msgr2=0x7f633004b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.122+0000 7f6339400640 1 --2- 172.21.15.114:0/1069065386 >> v2:172.21.15.153:3300/0 conn(0x7f6330035520 0x7f633004b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.122+0000 7f6339400640 1 -- 172.21.15.114:0/1069065386 >> v1:172.21.15.114:6789/0 conn(0x7f63300079b0 legacy=0x7f633004ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.123+0000 7f6339400640 1 -- 172.21.15.114:0/1069065386 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633000ea60 con 0x7f63300075a0 2024-05-09T00:14:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.125+0000 7f6339400640 1 --2- 172.21.15.114:0/1069065386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63300075a0 0x7f63300db220 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6330050e50 tx=0x7f632402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c1140897118284 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:32.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.126+0000 7f6338a00640 1 -- 172.21.15.114:0/1069065386 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324037070 con 0x7f63300075a0 2024-05-09T00:14:32.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.126+0000 7f6338a00640 1 -- 172.21.15.114:0/1069065386 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632402adf0 con 0x7f63300075a0 2024-05-09T00:14:32.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.126+0000 7f6338a00640 1 -- 172.21.15.114:0/1069065386 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324032640 con 0x7f63300075a0 2024-05-09T00:14:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.128+0000 7f633c800640 1 -- 172.21.15.114:0/1069065386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63300075a0 msgr2=0x7f63300db220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.128+0000 7f633c800640 1 --2- 172.21.15.114:0/1069065386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63300075a0 0x7f63300db220 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6330050e50 tx=0x7f632402a0a0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.129+0000 7f633c800640 1 -- 172.21.15.114:0/1069065386 shutdown_connections 2024-05-09T00:14:32.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.129+0000 7f633c800640 1 --2- 172.21.15.114:0/1069065386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63300075a0 0x7f63300db220 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.129+0000 7f633c800640 1 --2- 172.21.15.114:0/1069065386 >> v2:172.21.15.153:3300/0 conn(0x7f6330035520 0x7f633004b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.129+0000 7f633c800640 1 -- 172.21.15.114:0/1069065386 >> 172.21.15.114:0/1069065386 conn(0x7f633004c820 msgr2=0x7f633004cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.129+0000 7f633c800640 1 -- 172.21.15.114:0/1069065386 shutdown_connections 2024-05-09T00:14:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.129+0000 7f633c800640 1 -- 172.21.15.114:0/1069065386 wait complete. 2024-05-09T00:14:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.137+0000 7f633c800640 1 Processor -- start 2024-05-09T00:14:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.137+0000 7f633c800640 1 -- start start 2024-05-09T00:14:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.140+0000 7f633c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 0x7f6330174e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.140+0000 7f633c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6330035520 0x7f63300d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:32.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.141+0000 7f6339e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 0x7f6330174e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:32.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.142+0000 7f6339e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 0x7f6330174e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45262/0 (socket says 172.21.15.114:45262) 2024-05-09T00:14:32.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.142+0000 7f6339e00640 1 -- 172.21.15.114:0/4037343009 learned_addr learned my addr 172.21.15.114:0/4037343009 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.142+0000 7f6339400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6330035520 0x7f63300d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.142+0000 7f633c800640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63300dbe80 0x7f63300dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.142+0000 7f633c800640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f63300db8e0 con 0x7f6330035520 2024-05-09T00:14:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.143+0000 7f633c800640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f63300db760 con 0x7f63300dbe80 2024-05-09T00:14:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.143+0000 7f633c800640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63300dba60 con 0x7f63300075a0 2024-05-09T00:14:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.143+0000 7f633a800640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63300dbe80 0x7f63300dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.144+0000 7f6339e00640 1 -- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63300dbe80 msgr2=0x7f63300dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.144+0000 7f6339e00640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63300dbe80 0x7f63300dd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.144+0000 7f6339e00640 1 -- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6330035520 msgr2=0x7f63300d5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.144+0000 7f6339e00640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6330035520 0x7f63300d5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.144+0000 7f6339e00640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63300de310 con 0x7f63300075a0 2024-05-09T00:14:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.146+0000 7f633a800640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63300dbe80 0x7f63300dd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:14:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.146+0000 7f6339e00640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 0x7f6330174e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f632800d830 tx=0x7f632800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.147+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328004030 con 0x7f63300075a0 2024-05-09T00:14:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.147+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63280041d0 con 0x7f63300075a0 2024-05-09T00:14:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.147+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63280096a0 con 0x7f63300075a0 2024-05-09T00:14:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.148+0000 7f633c800640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63300dea60 con 0x7f63300075a0 2024-05-09T00:14:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.148+0000 7f633c800640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6330174370 con 0x7f63300075a0 2024-05-09T00:14:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.151+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630c005290 con 0x7f63300075a0 2024-05-09T00:14:32.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.160+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6328009840 con 0x7f63300075a0 2024-05-09T00:14:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.164+0000 7f632e000640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63180763d0 0x7f63180788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.165+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f6328097cc0 con 0x7f63300075a0 2024-05-09T00:14:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.166+0000 7f6339400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63180763d0 0x7f63180788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.173+0000 7f6339400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63180763d0 0x7f63180788e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6324034000 tx=0x7f632402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.178+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6328060ad0 con 0x7f63300075a0 2024-05-09T00:14:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.814+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f630c005580 con 0x7f63300075a0 2024-05-09T00:14:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.817+0000 7f632e000640 1 -- 172.21.15.114:0/4037343009 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7f6328064dd0 con 0x7f63300075a0 2024-05-09T00:14:32.815 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:32.815 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:14:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.823+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63180763d0 msgr2=0x7f63180788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.824+0000 7f6323400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63180763d0 0x7f63180788e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6324034000 tx=0x7f632402e000 comp rx=0 tx=0).stop 2024-05-09T00:14:32.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.824+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 msgr2=0x7f6330174e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:32.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.824+0000 7f6323400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 0x7f6330174e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f632800d830 tx=0x7f632800dcf0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.825+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 shutdown_connections 2024-05-09T00:14:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.825+0000 7f6323400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63180763d0 0x7f63180788e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.826+0000 7f6323400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63300dbe80 0x7f63300dd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.826+0000 7f6323400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6330035520 0x7f63300d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.826+0000 7f6323400640 1 --2- 172.21.15.114:0/4037343009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63300075a0 0x7f6330174e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:32.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.826+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 >> 172.21.15.114:0/4037343009 conn(0x7f633004c820 msgr2=0x7f6330034930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:32.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.826+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 shutdown_connections 2024-05-09T00:14:32.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:32.827+0000 7f6323400640 1 -- 172.21.15.114:0/4037343009 wait complete. 2024-05-09T00:14:32.865 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-05-09T00:14:32.865 INFO:tasks.mds_thrash.fs.[a]:waiting for 56 secs before thrashing 2024-05-09T00:14:43.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:14:43.815 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:14:48.903 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:49.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.412+0000 7f4303200640 1 Processor -- start 2024-05-09T00:14:49.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.415+0000 7f4303200640 1 -- start start 2024-05-09T00:14:49.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.418+0000 7f4303200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0aebf0 0x7f42fc0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:49.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.419+0000 7f4301400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f42fc0c5180 0x7f42fc154080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:59358/0 (socket says 172.21.15.114:59358) 2024-05-09T00:14:49.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.419+0000 7f4303200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc0c59a0 con 0x7f42fc0c5590 2024-05-09T00:14:49.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.419+0000 7f4303200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc1581b0 con 0x7f42fc0c5180 2024-05-09T00:14:49.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.419+0000 7f4303200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc158490 con 0x7f42fc0aebf0 2024-05-09T00:14:49.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.419+0000 7f4301400640 1 -- 172.21.15.114:0/3784098719 learned_addr learned my addr 172.21.15.114:0/3784098719 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:14:49.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.422+0000 7f4301e00640 1 --2- 172.21.15.114:0/3784098719 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0aebf0 0x7f42fc0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.423+0000 7f4301e00640 1 -- 172.21.15.114:0/3784098719 >> v1:172.21.15.153:6789/0 conn(0x7f42fc0c5180 legacy=0x7f42fc154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.426+0000 7f4300a00640 1 -- 172.21.15.114:0/3784098719 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850016433 0 0) 0x7f42fc0c59a0 con 0x7f42fc0c5590 2024-05-09T00:14:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.428+0000 7f4301e00640 1 -- 172.21.15.114:0/3784098719 >> v1:172.21.15.114:6789/0 conn(0x7f42fc0c5590 legacy=0x7f42fc154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.428+0000 7f4301e00640 1 -- 172.21.15.114:0/3784098719 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc06e240 con 0x7f42fc0aebf0 2024-05-09T00:14:49.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.432+0000 7f4301e00640 1 --2- 172.21.15.114:0/3784098719 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0aebf0 0x7f42fc0ae490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42f800bfd0 tx=0x7f42f802c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e917cd9e8f35ead server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:49.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.433+0000 7f4300a00640 1 -- 172.21.15.114:0/3784098719 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f803a070 con 0x7f42fc0aebf0 2024-05-09T00:14:49.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.433+0000 7f4300a00640 1 -- 172.21.15.114:0/3784098719 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8032480 con 0x7f42fc0aebf0 2024-05-09T00:14:49.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.434+0000 7f4300a00640 1 -- 172.21.15.114:0/3784098719 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f803a070 con 0x7f42fc0aebf0 2024-05-09T00:14:49.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.439+0000 7f4303200640 1 -- 172.21.15.114:0/3784098719 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0aebf0 msgr2=0x7f42fc0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:49.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.439+0000 7f4303200640 1 --2- 172.21.15.114:0/3784098719 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0aebf0 0x7f42fc0ae490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42f800bfd0 tx=0x7f42f802c780 comp rx=0 tx=0).stop 2024-05-09T00:14:49.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.444+0000 7f4303200640 1 -- 172.21.15.114:0/3784098719 shutdown_connections 2024-05-09T00:14:49.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.444+0000 7f4303200640 1 --2- 172.21.15.114:0/3784098719 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0aebf0 0x7f42fc0ae490 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:49.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.445+0000 7f4303200640 1 -- 172.21.15.114:0/3784098719 >> 172.21.15.114:0/3784098719 conn(0x7f42fc0c5ea0 msgr2=0x7f42fc0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:49.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.448+0000 7f4303200640 1 -- 172.21.15.114:0/3784098719 shutdown_connections 2024-05-09T00:14:49.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.448+0000 7f4303200640 1 -- 172.21.15.114:0/3784098719 wait complete. 2024-05-09T00:14:49.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.461+0000 7f4303200640 1 Processor -- start 2024-05-09T00:14:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.462+0000 7f4303200640 1 -- start start 2024-05-09T00:14:49.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.475+0000 7f4303200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42fc0aebf0 0x7f42fc153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:49.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.476+0000 7f4303200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 0x7f42fc1faef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:49.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.478+0000 7f4303200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42fc0c5590 0x7f42fc1f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:49.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.478+0000 7f4301e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42fc0aebf0 0x7f42fc153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:49.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.478+0000 7f4301e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42fc0aebf0 0x7f42fc153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:33296/0 (socket says 172.21.15.114:33296) 2024-05-09T00:14:49.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.479+0000 7f4301400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 0x7f42fc1faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.479+0000 7f4301400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 0x7f42fc1faef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:56160/0 (socket says 172.21.15.114:56160) 2024-05-09T00:14:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.479+0000 7f4301e00640 1 -- 172.21.15.114:0/1595505038 learned_addr learned my addr 172.21.15.114:0/1595505038 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.479+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0742d0 con 0x7f42fc0c5590 2024-05-09T00:14:49.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.481+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc06e800 con 0x7f42fc0aebf0 2024-05-09T00:14:49.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.482+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc074450 con 0x7f42fc0c5180 2024-05-09T00:14:49.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.482+0000 7f4302800640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42fc0c5590 0x7f42fc1f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:49.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.484+0000 7f4301400640 1 -- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42fc0aebf0 msgr2=0x7f42fc153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:49.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.484+0000 7f4301400640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42fc0aebf0 0x7f42fc153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:49.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.484+0000 7f4301400640 1 -- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42fc0c5590 msgr2=0x7f42fc1f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:49.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.484+0000 7f4301400640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42fc0c5590 0x7f42fc1f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:49.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.484+0000 7f4301400640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc1225c0 con 0x7f42fc0c5180 2024-05-09T00:14:49.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.485+0000 7f4302800640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42fc0c5590 0x7f42fc1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.487+0000 7f4301400640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 0x7f42fc1faef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c430 tx=0x7f42ec00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:49.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.487+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0074e0 con 0x7f42fc0c5180 2024-05-09T00:14:49.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.488+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ec0047e0 con 0x7f42fc0c5180 2024-05-09T00:14:49.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.488+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004bd0 con 0x7f42fc0c5180 2024-05-09T00:14:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.490+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc1ff1d0 con 0x7f42fc0c5180 2024-05-09T00:14:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.490+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc0c0b60 con 0x7f42fc0c5180 2024-05-09T00:14:49.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.496+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42fc0ac600 con 0x7f42fc0c5180 2024-05-09T00:14:49.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.499+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42ec011070 con 0x7f42fc0c5180 2024-05-09T00:14:49.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.503+0000 7f42f6000640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f42e0076320 0x7f42e0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:49.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.503+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f42ec097730 con 0x7f42fc0c5180 2024-05-09T00:14:49.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.504+0000 7f4301e00640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f42e0076320 0x7f42e0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:49.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.506+0000 7f4301e00640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f42e0076320 0x7f42e0078830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f42f8038040 tx=0x7f42f8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:49.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:49.517+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42fc0ac600 con 0x7f42fc0c5180 2024-05-09T00:14:50.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.203+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42fc1fef40 con 0x7f42fc0c5180 2024-05-09T00:14:50.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.206+0000 7f42f6000640 1 -- 172.21.15.114:0/1595505038 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7f42ec060c00 con 0x7f42fc0c5180 2024-05-09T00:14:50.205 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:50.205 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:14:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.210+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f42e0076320 msgr2=0x7f42e0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.210+0000 7f4303200640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f42e0076320 0x7f42e0078830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f42f8038040 tx=0x7f42f8030000 comp rx=0 tx=0).stop 2024-05-09T00:14:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.210+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 msgr2=0x7f42fc1faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.210+0000 7f4303200640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 0x7f42fc1faef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c430 tx=0x7f42ec00c8f0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.211+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 shutdown_connections 2024-05-09T00:14:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.211+0000 7f4303200640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f42e0076320 0x7f42e0078830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.211+0000 7f4303200640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42fc0c5590 0x7f42fc1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.211+0000 7f4303200640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42fc0c5180 0x7f42fc1faef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.211+0000 7f4303200640 1 --2- 172.21.15.114:0/1595505038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42fc0aebf0 0x7f42fc153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.211+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 >> 172.21.15.114:0/1595505038 conn(0x7f42fc0c5ea0 msgr2=0x7f42fc0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.214+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 shutdown_connections 2024-05-09T00:14:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.215+0000 7f4303200640 1 -- 172.21.15.114:0/1595505038 wait complete. 2024-05-09T00:14:50.268 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-05-09T00:14:50.269 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T00:14:50.269 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:14:50.338 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T00:14:50.339 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:50.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.843+0000 7f40f3200640 1 Processor -- start 2024-05-09T00:14:50.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.843+0000 7f40f3200640 1 -- start start 2024-05-09T00:14:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.845+0000 7f40f3200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f40f40c5df0 0x7f40f4150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.845+0000 7f40f3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c75a0 0x7f40f40c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.846+0000 7f40f3200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f4072850 con 0x7f40f4071380 2024-05-09T00:14:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.846+0000 7f40f3200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f40f4072b30 con 0x7f40f40c5df0 2024-05-09T00:14:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.846+0000 7f40f3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f40f4156d90 con 0x7f40f40c75a0 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.847+0000 7f40f1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f40f40c5df0 0x7f40f4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.847+0000 7f40f1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f40f40c5df0 0x7f40f4150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54358/0 (socket says 172.21.15.114:54358) 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.847+0000 7f40f1e00640 1 -- 172.21.15.114:0/104615152 learned_addr learned my addr 172.21.15.114:0/104615152 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.848+0000 7f40f1400640 1 --2- 172.21.15.114:0/104615152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c75a0 0x7f40f40c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.850+0000 7f40f0a00640 1 -- 172.21.15.114:0/104615152 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117707119 0 0) 0x7f40f4072850 con 0x7f40f4071380 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.850+0000 7f40f1e00640 1 -- 172.21.15.114:0/104615152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c75a0 msgr2=0x7f40f40c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.850+0000 7f40f1e00640 1 --2- 172.21.15.114:0/104615152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c75a0 0x7f40f40c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.850+0000 7f40f1e00640 1 -- 172.21.15.114:0/104615152 >> v1:172.21.15.153:6789/0 conn(0x7f40f4071380 legacy=0x7f40f4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:50.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.850+0000 7f40f1e00640 1 -- 172.21.15.114:0/104615152 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f4156a80 con 0x7f40f40c5df0 2024-05-09T00:14:50.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.855+0000 7f40f1e00640 1 --2- 172.21.15.114:0/104615152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c5df0 0x7f40f4150380 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009e50 tx=0x7f40ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3902323f1a5980fc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:50.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.857+0000 7f40f0a00640 1 -- 172.21.15.114:0/104615152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ec036070 con 0x7f40f40c5df0 2024-05-09T00:14:50.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.857+0000 7f40f0a00640 1 -- 172.21.15.114:0/104615152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ec031600 con 0x7f40f40c5df0 2024-05-09T00:14:50.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.857+0000 7f40f0a00640 1 -- 172.21.15.114:0/104615152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ec036070 con 0x7f40f40c5df0 2024-05-09T00:14:50.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.860+0000 7f40f3200640 1 -- 172.21.15.114:0/104615152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c5df0 msgr2=0x7f40f4150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.861+0000 7f40f3200640 1 --2- 172.21.15.114:0/104615152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c5df0 0x7f40f4150380 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009e50 tx=0x7f40ec02a730 comp rx=0 tx=0).stop 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.861+0000 7f40f3200640 1 -- 172.21.15.114:0/104615152 shutdown_connections 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.861+0000 7f40f3200640 1 --2- 172.21.15.114:0/104615152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c75a0 0x7f40f40c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.861+0000 7f40f3200640 1 --2- 172.21.15.114:0/104615152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c5df0 0x7f40f4150380 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.861+0000 7f40f3200640 1 -- 172.21.15.114:0/104615152 >> 172.21.15.114:0/104615152 conn(0x7f40f40cb3f0 msgr2=0x7f40f40cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.862+0000 7f40f3200640 1 -- 172.21.15.114:0/104615152 shutdown_connections 2024-05-09T00:14:50.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.862+0000 7f40f3200640 1 -- 172.21.15.114:0/104615152 wait complete. 2024-05-09T00:14:50.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.866+0000 7f40f3200640 1 Processor -- start 2024-05-09T00:14:50.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.867+0000 7f40f3200640 1 -- start start 2024-05-09T00:14:50.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.870+0000 7f40f3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f4071380 0x7f40f41e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:50.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.870+0000 7f40f3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 0x7f40f40c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:50.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.870+0000 7f40f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c75a0 0x7f40f414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.871+0000 7f40f3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f40f4071ea0 con 0x7f40f40c75a0 2024-05-09T00:14:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.871+0000 7f40f3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40f40c7ef0 con 0x7f40f4071380 2024-05-09T00:14:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.871+0000 7f40f3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f40f41e06e0 con 0x7f40f40c5df0 2024-05-09T00:14:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.871+0000 7f40f1400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 0x7f40f40c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.871+0000 7f40f1400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 0x7f40f40c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:56182/0 (socket says 172.21.15.114:56182) 2024-05-09T00:14:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.871+0000 7f40f1400640 1 -- 172.21.15.114:0/1885140730 learned_addr learned my addr 172.21.15.114:0/1885140730 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.872+0000 7f40f1400640 1 -- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f4071380 msgr2=0x7f40f41e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.872+0000 7f40f1400640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f4071380 0x7f40f41e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.872+0000 7f40f1400640 1 -- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c75a0 msgr2=0x7f40f414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.875+0000 7f40f2800640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c75a0 0x7f40f414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.875+0000 7f40f1400640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c75a0 0x7f40f414ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.876+0000 7f40f1400640 1 -- 172.21.15.114:0/1885140730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f40c3ca0 con 0x7f40f40c5df0 2024-05-09T00:14:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.876+0000 7f40f2800640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c75a0 0x7f40f414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.877+0000 7f40f1400640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 0x7f40f40c4d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40e400e8a0 tx=0x7f40e400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.878+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4017070 con 0x7f40f40c5df0 2024-05-09T00:14:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.878+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e400c940 con 0x7f40f40c5df0 2024-05-09T00:14:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.878+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e400cd30 con 0x7f40f40c5df0 2024-05-09T00:14:50.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.880+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f40c3f80 con 0x7f40f40c5df0 2024-05-09T00:14:50.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.880+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f40c4540 con 0x7f40f40c5df0 2024-05-09T00:14:50.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.882+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f41ecb60 con 0x7f40f40c5df0 2024-05-09T00:14:50.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.886+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f40e401a070 con 0x7f40f40c5df0 2024-05-09T00:14:50.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.889+0000 7f40ea000640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f40d007a7b0 0x7f40d007ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:50.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.889+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f40e40985b0 con 0x7f40f40c5df0 2024-05-09T00:14:50.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.891+0000 7f40f1e00640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f40d007a7b0 0x7f40d007ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:50.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.893+0000 7f40f1e00640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f40d007a7b0 0x7f40d007ccc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f40ec033000 tx=0x7f40ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:50.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:50.903+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f40e4061a10 con 0x7f40f40c5df0 2024-05-09T00:14:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.391+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40f4078430 con 0x7f40f40c5df0 2024-05-09T00:14:51.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.393+0000 7f40ea000640 1 -- 172.21.15.114:0/1885140730 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7f40e4061310 con 0x7f40f40c5df0 2024-05-09T00:14:51.392 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:51.392 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:51.392 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:14:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.397+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f40d007a7b0 msgr2=0x7f40d007ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.397+0000 7f40f3200640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f40d007a7b0 0x7f40d007ccc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f40ec033000 tx=0x7f40ec02e000 comp rx=0 tx=0).stop 2024-05-09T00:14:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 msgr2=0x7f40f40c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 0x7f40f40c4d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40e400e8a0 tx=0x7f40e400eca0 comp rx=0 tx=0).stop 2024-05-09T00:14:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 shutdown_connections 2024-05-09T00:14:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f40d007a7b0 0x7f40d007ccc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40f40c75a0 0x7f40f414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40f40c5df0 0x7f40f40c4d40 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40e400e8a0 tx=0x7f40e400eca0 comp rx=0 tx=0).stop 2024-05-09T00:14:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 --2- 172.21.15.114:0/1885140730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f4071380 0x7f40f41e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.398+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 >> 172.21.15.114:0/1885140730 conn(0x7f40f40cb3f0 msgr2=0x7f40f4071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:51.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.401+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 shutdown_connections 2024-05-09T00:14:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:51.402+0000 7f40f3200640 1 -- 172.21.15.114:0/1885140730 wait complete. 2024-05-09T00:14:51.478 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:14:53.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:53.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.949+0000 7f466ee00640 1 Processor -- start 2024-05-09T00:14:53.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.949+0000 7f466ee00640 1 -- start start 2024-05-09T00:14:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.953+0000 7f466ee00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46680733b0 0x7f4668154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.953+0000 7f466ee00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4668072150 con 0x7f46680af0f0 2024-05-09T00:14:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.953+0000 7f466ee00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4668159310 con 0x7f46680acda0 2024-05-09T00:14:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.953+0000 7f466ee00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4668158490 con 0x7f46680733b0 2024-05-09T00:14:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.955+0000 7f466ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f46680af0f0 0x7f46680725d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37906/0 (socket says 172.21.15.114:37906) 2024-05-09T00:14:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.955+0000 7f466ce00640 1 -- 172.21.15.114:0/3839654570 learned_addr learned my addr 172.21.15.114:0/3839654570 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:14:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.955+0000 7f4667400640 1 --2- 172.21.15.114:0/3839654570 >> v2:172.21.15.153:3300/0 conn(0x7f46680733b0 0x7f4668154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996282835 0 0) 0x7f4668072150 con 0x7f46680af0f0 2024-05-09T00:14:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4650003520 con 0x7f46680af0f0 2024-05-09T00:14:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4097509219 0 0) 0x7f4650003520 con 0x7f46680af0f0 2024-05-09T00:14:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 >> v2:172.21.15.153:3300/0 conn(0x7f46680733b0 msgr2=0x7f4668154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 --2- 172.21.15.114:0/3839654570 >> v2:172.21.15.153:3300/0 conn(0x7f46680733b0 0x7f4668154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 >> v1:172.21.15.153:6789/0 conn(0x7f46680acda0 legacy=0x7f4668158c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4668073e90 con 0x7f46680af0f0 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f4660001a80 con 0x7f46680af0f0 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 >> v1:172.21.15.114:6789/0 conn(0x7f46680af0f0 legacy=0x7f46680725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4650003a10 0x7f4650003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4650004800 0x7f4650004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f465000bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4668158490 con 0x7f4650003a10 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f465000c440 con 0x7f4650004800 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.956+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f465000c640 con 0x7f46500099b0 2024-05-09T00:14:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.957+0000 7f466ce00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f465000bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:53.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.958+0000 7f4667e00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4650003a10 0x7f4650003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.960+0000 7f466ce00640 1 -- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4650004800 msgr2=0x7f4650004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.960+0000 7f466ce00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4650004800 0x7f4650004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.960+0000 7f466ce00640 1 -- 172.21.15.114:0/3839654570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4650003a10 msgr2=0x7f4650003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.960+0000 7f466ce00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4650003a10 0x7f4650003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.960+0000 7f466ce00640 1 -- 172.21.15.114:0/3839654570 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4668073e90 con 0x7f46500099b0 2024-05-09T00:14:53.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.961+0000 7f466ce00640 1 -- 172.21.15.114:0/3839654570 reap_dead start 2024-05-09T00:14:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.962+0000 7f466ce00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f465000bdd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46680c6f60 tx=0x7f4650005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bdb2d90f5d76fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.964+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466000c7a0 con 0x7f46500099b0 2024-05-09T00:14:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.965+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660035630 con 0x7f46500099b0 2024-05-09T00:14:53.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.966+0000 7f466ee00640 1 -- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 msgr2=0x7f465000bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:53.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.967+0000 7f4666a00640 1 -- 172.21.15.114:0/3839654570 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466000c7a0 con 0x7f46500099b0 2024-05-09T00:14:53.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.967+0000 7f466ee00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f465000bdd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46680c6f60 tx=0x7f4650005830 comp rx=0 tx=0).stop 2024-05-09T00:14:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.968+0000 7f466ee00640 1 -- 172.21.15.114:0/3839654570 shutdown_connections 2024-05-09T00:14:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.968+0000 7f466ee00640 1 --2- 172.21.15.114:0/3839654570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f465000bdd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.968+0000 7f466ee00640 1 -- 172.21.15.114:0/3839654570 >> 172.21.15.114:0/3839654570 conn(0x7f46680c5ea0 msgr2=0x7f46680c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.968+0000 7f466ee00640 1 -- 172.21.15.114:0/3839654570 shutdown_connections 2024-05-09T00:14:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.968+0000 7f466ee00640 1 -- 172.21.15.114:0/3839654570 wait complete. 2024-05-09T00:14:53.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.974+0000 7f466ee00640 1 Processor -- start 2024-05-09T00:14:53.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.974+0000 7f466ee00640 1 -- start start 2024-05-09T00:14:53.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.976+0000 7f466ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f4668152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.977+0000 7f466ee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4668150f00 0x7f46681f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.977+0000 7f466ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46681f6540 0x7f4668150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:53.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.977+0000 7f466ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46681586e0 con 0x7f46681f6540 2024-05-09T00:14:53.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.977+0000 7f466ee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4668074450 con 0x7f4668150f00 2024-05-09T00:14:53.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.977+0000 7f466ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f46680af500 con 0x7f46500099b0 2024-05-09T00:14:53.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.978+0000 7f4667400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4668150f00 0x7f46681f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:53.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.979+0000 7f4667400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4668150f00 0x7f46681f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:33320/0 (socket says 172.21.15.114:33320) 2024-05-09T00:14:53.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.979+0000 7f4667400640 1 -- 172.21.15.114:0/891673654 learned_addr learned my addr 172.21.15.114:0/891673654 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:53.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.979+0000 7f4667e00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f4668152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:53.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.979+0000 7f466ce00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46681f6540 0x7f4668150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:53.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.981+0000 7f466ce00640 1 -- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 msgr2=0x7f4668152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:53.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.981+0000 7f466ce00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f4668152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:53.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.981+0000 7f466ce00640 1 -- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4668150f00 msgr2=0x7f46681f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.981+0000 7f466ce00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4668150f00 0x7f46681f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.981+0000 7f466ce00640 1 -- 172.21.15.114:0/891673654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466806f4b0 con 0x7f46681f6540 2024-05-09T00:14:53.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.983+0000 7f466ce00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46681f6540 0x7f4668150240 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4668071f80 tx=0x7f4660001e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:53.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.984+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466002de60 con 0x7f46681f6540 2024-05-09T00:14:53.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.985+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46680c3790 con 0x7f46681f6540 2024-05-09T00:14:53.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.985+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46680be840 con 0x7f46681f6540 2024-05-09T00:14:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.986+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660004b90 con 0x7f46681f6540 2024-05-09T00:14:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.986+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466002de60 con 0x7f46681f6540 2024-05-09T00:14:53.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.993+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46680c91c0 con 0x7f46681f6540 2024-05-09T00:14:53.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:53.997+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4660044060 con 0x7f46681f6540 2024-05-09T00:14:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.012+0000 7f465be00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46480764d0 0x7f46480789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.012+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f46600b7690 con 0x7f46681f6540 2024-05-09T00:14:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.013+0000 7f4667e00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46480764d0 0x7f46480789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:54.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.021+0000 7f4667e00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46480764d0 0x7f46480789e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f465c006fd0 tx=0x7f465c006f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:54.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.024+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f46680c91c0 con 0x7f46681f6540 2024-05-09T00:14:54.582 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:54.583 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:14:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.576+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46680af740 con 0x7f46681f6540 2024-05-09T00:14:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.579+0000 7f465be00640 1 -- 172.21.15.114:0/891673654 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7f46680af740 con 0x7f46681f6540 2024-05-09T00:14:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.586+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46480764d0 msgr2=0x7f46480789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.586+0000 7f466ee00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46480764d0 0x7f46480789e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f465c006fd0 tx=0x7f465c006f00 comp rx=0 tx=0).stop 2024-05-09T00:14:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46681f6540 msgr2=0x7f4668150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46681f6540 0x7f4668150240 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4668071f80 tx=0x7f4660001e00 comp rx=0 tx=0).stop 2024-05-09T00:14:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 shutdown_connections 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f46480764d0 0x7f46480789e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46681f6540 0x7f4668150240 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4668150f00 0x7f46681f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 --2- 172.21.15.114:0/891673654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500099b0 0x7f4668152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.587+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 >> 172.21.15.114:0/891673654 conn(0x7f46680c5ea0 msgr2=0x7f46680725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.588+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 shutdown_connections 2024-05-09T00:14:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:54.588+0000 7f466ee00640 1 -- 172.21.15.114:0/891673654 wait complete. 2024-05-09T00:14:54.646 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:14:56.648 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:57.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.188+0000 7fcb99400640 1 Processor -- start 2024-05-09T00:14:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.188+0000 7fcb99400640 1 -- start start 2024-05-09T00:14:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.191+0000 7fcb99400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb94072d50 0x7fcb940c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.191+0000 7fcb99400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb94072890 0x7fcb94159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.191+0000 7fcb99400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb940c4ca0 con 0x7fcb94160600 2024-05-09T00:14:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.191+0000 7fcb99400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcb94160170 con 0x7fcb94072d50 2024-05-09T00:14:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.191+0000 7fcb99400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9415a190 con 0x7fcb94072890 2024-05-09T00:14:57.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.193+0000 7fcb91e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb94072890 0x7fcb94159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:57.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.193+0000 7fcb91e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb94072890 0x7fcb94159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:33334/0 (socket says 172.21.15.114:33334) 2024-05-09T00:14:57.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.193+0000 7fcb91e00640 1 -- 172.21.15.114:0/3860702544 learned_addr learned my addr 172.21.15.114:0/3860702544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:57.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.193+0000 7fcb92800640 1 --2- 172.21.15.114:0/3860702544 >> v2:172.21.15.114:3300/0 conn(0x7fcb94072d50 0x7fcb940c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:57.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.193+0000 7fcb91e00640 1 -- 172.21.15.114:0/3860702544 >> v2:172.21.15.114:3300/0 conn(0x7fcb94072d50 msgr2=0x7fcb940c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:57.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.193+0000 7fcb91e00640 1 --2- 172.21.15.114:0/3860702544 >> v2:172.21.15.114:3300/0 conn(0x7fcb94072d50 0x7fcb940c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.194+0000 7fcb91e00640 1 -- 172.21.15.114:0/3860702544 >> v1:172.21.15.153:6789/0 conn(0x7fcb94160600 legacy=0x7fcb940c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:57.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.194+0000 7fcb91e00640 1 -- 172.21.15.114:0/3860702544 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9415fe20 con 0x7fcb94072890 2024-05-09T00:14:57.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.194+0000 7fcb92800640 1 --2- 172.21.15.114:0/3860702544 >> v2:172.21.15.114:3300/0 conn(0x7fcb94072d50 0x7fcb940c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:57.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.196+0000 7fcb91e00640 1 --2- 172.21.15.114:0/3860702544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94072890 0x7fcb94159c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcb940c4270 tx=0x7fcb8402a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b569defa9db76b2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:57.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.197+0000 7fcb91400640 1 -- 172.21.15.114:0/3860702544 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84037070 con 0x7fcb94072890 2024-05-09T00:14:57.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.197+0000 7fcb91400640 1 -- 172.21.15.114:0/3860702544 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb84032440 con 0x7fcb94072890 2024-05-09T00:14:57.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.197+0000 7fcb91400640 1 -- 172.21.15.114:0/3860702544 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84032810 con 0x7fcb94072890 2024-05-09T00:14:57.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.199+0000 7fcb99400640 1 -- 172.21.15.114:0/3860702544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94072890 msgr2=0x7fcb94159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:57.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.199+0000 7fcb99400640 1 --2- 172.21.15.114:0/3860702544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94072890 0x7fcb94159c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcb940c4270 tx=0x7fcb8402a1f0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.200+0000 7fcb99400640 1 -- 172.21.15.114:0/3860702544 shutdown_connections 2024-05-09T00:14:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.200+0000 7fcb99400640 1 --2- 172.21.15.114:0/3860702544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94072890 0x7fcb94159c50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.200+0000 7fcb99400640 1 --2- 172.21.15.114:0/3860702544 >> v2:172.21.15.114:3300/0 conn(0x7fcb94072d50 0x7fcb940c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.200+0000 7fcb99400640 1 -- 172.21.15.114:0/3860702544 >> 172.21.15.114:0/3860702544 conn(0x7fcb9406c680 msgr2=0x7fcb9406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:57.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.201+0000 7fcb99400640 1 -- 172.21.15.114:0/3860702544 shutdown_connections 2024-05-09T00:14:57.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.204+0000 7fcb99400640 1 -- 172.21.15.114:0/3860702544 wait complete. 2024-05-09T00:14:57.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.206+0000 7fcb99400640 1 Processor -- start 2024-05-09T00:14:57.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.207+0000 7fcb99400640 1 -- start start 2024-05-09T00:14:57.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.209+0000 7fcb99400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 0x7fcb940ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:57.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.210+0000 7fcb92800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 0x7fcb940ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:57.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.210+0000 7fcb92800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 0x7fcb940ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54392/0 (socket says 172.21.15.114:54392) 2024-05-09T00:14:57.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.210+0000 7fcb92800640 1 -- 172.21.15.114:0/2940049406 learned_addr learned my addr 172.21.15.114:0/2940049406 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:14:57.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.210+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb94072d50 0x7fcb941423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:57.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.211+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94160600 0x7fcb94149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:57.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.211+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcb940c42e0 con 0x7fcb94072890 2024-05-09T00:14:57.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.211+0000 7fcb91e00640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb94072d50 0x7fcb941423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:57.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.211+0000 7fcb93200640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94160600 0x7fcb94149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:57.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.212+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9415d490 con 0x7fcb94160600 2024-05-09T00:14:57.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.212+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb940c6760 con 0x7fcb94072d50 2024-05-09T00:14:57.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.214+0000 7fcb92800640 1 -- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb94072d50 msgr2=0x7fcb941423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:57.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.214+0000 7fcb92800640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb94072d50 0x7fcb941423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.214+0000 7fcb92800640 1 -- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94160600 msgr2=0x7fcb94149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:57.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.214+0000 7fcb92800640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94160600 0x7fcb94149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.214+0000 7fcb92800640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb940acdb0 con 0x7fcb94072890 2024-05-09T00:14:57.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.215+0000 7fcb91e00640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb94072d50 0x7fcb941423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:14:57.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.216+0000 7fcb93200640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94160600 0x7fcb94149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:14:57.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.217+0000 7fcb92800640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 0x7fcb940ad8a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00c7f0 tx=0x7fcb7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:57.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.218+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c015070 con 0x7fcb94072890 2024-05-09T00:14:57.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.218+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c007820 con 0x7fcb94072890 2024-05-09T00:14:57.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.218+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c007c10 con 0x7fcb94072890 2024-05-09T00:14:57.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.218+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb94144290 con 0x7fcb94072890 2024-05-09T00:14:57.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.218+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb94144e90 con 0x7fcb94072890 2024-05-09T00:14:57.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.219+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb940c5650 con 0x7fcb94072890 2024-05-09T00:14:57.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.226+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb7c018070 con 0x7fcb94072890 2024-05-09T00:14:57.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.228+0000 7fcb8aa00640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb700763a0 0x7fcb700788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:57.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.228+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7fcb7c098020 con 0x7fcb94072890 2024-05-09T00:14:57.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.232+0000 7fcb91e00640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb700763a0 0x7fcb700788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:57.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.233+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcb940c5650 con 0x7fcb94072890 2024-05-09T00:14:57.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.238+0000 7fcb91e00640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb700763a0 0x7fcb700788b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcb84034000 tx=0x7fcb8402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:57.865 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:14:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:14:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.863+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb94077430 con 0x7fcb94072890 2024-05-09T00:14:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.864+0000 7fcb8aa00640 1 -- 172.21.15.114:0/2940049406 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7fcb94144290 con 0x7fcb94072890 2024-05-09T00:14:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:14:57.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.877+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb700763a0 msgr2=0x7fcb700788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:57.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.877+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb700763a0 0x7fcb700788b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcb84034000 tx=0x7fcb8402e000 comp rx=0 tx=0).stop 2024-05-09T00:14:57.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.877+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 msgr2=0x7fcb940ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:57.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.877+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 0x7fcb940ad8a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00c7f0 tx=0x7fcb7c00ccb0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.880+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 shutdown_connections 2024-05-09T00:14:57.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.880+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb700763a0 0x7fcb700788b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.880+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94160600 0x7fcb94149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.880+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb94072d50 0x7fcb941423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.880+0000 7fcb99400640 1 --2- 172.21.15.114:0/2940049406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb94072890 0x7fcb940ad8a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:57.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.880+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 >> 172.21.15.114:0/2940049406 conn(0x7fcb9406c680 msgr2=0x7fcb9415ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:57.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.883+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 shutdown_connections 2024-05-09T00:14:57.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:14:57.883+0000 7fcb99400640 1 -- 172.21.15.114:0/2940049406 wait complete. 2024-05-09T00:14:57.950 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:14:59.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:00.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.478+0000 7ff603a00640 1 Processor -- start 2024-05-09T00:15:00.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.478+0000 7ff603a00640 1 -- start start 2024-05-09T00:15:00.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.481+0000 7ff603a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5fc0c4300 0x7ff5fc072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff603a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5fc16d8e0 0x7ff5fc16fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff5fbe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff5fc0c49c0 0x7ff5fc165760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35274/0 (socket says 172.21.15.114:35274) 2024-05-09T00:15:00.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff5fbe00640 1 -- 172.21.15.114:0/3327335803 learned_addr learned my addr 172.21.15.114:0/3327335803 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:15:00.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc169050 con 0x7ff5fc0c49c0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff5fc0c6980 con 0x7ff5fc0c4300 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff5fc08dd90 con 0x7ff5fc16d8e0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.482+0000 7ff601a00640 1 --2- 172.21.15.114:0/3327335803 >> v2:172.21.15.153:3300/0 conn(0x7ff5fc16d8e0 0x7ff5fc16fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.483+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770479515 0 0) 0x7ff5fc169050 con 0x7ff5fc0c49c0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff601000640 1 --2- 172.21.15.114:0/3327335803 >> v2:172.21.15.114:3300/0 conn(0x7ff5fc0c4300 0x7ff5fc072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e0003520 con 0x7ff5fc0c49c0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 868275463 0 0) 0x7ff5e0003520 con 0x7ff5fc0c49c0 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 >> v2:172.21.15.153:3300/0 conn(0x7ff5fc16d8e0 msgr2=0x7ff5fc16fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 --2- 172.21.15.114:0/3327335803 >> v2:172.21.15.153:3300/0 conn(0x7ff5fc16d8e0 0x7ff5fc16fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 >> v2:172.21.15.114:3300/0 conn(0x7ff5fc0c4300 msgr2=0x7ff5fc072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 --2- 172.21.15.114:0/3327335803 >> v2:172.21.15.114:3300/0 conn(0x7ff5fc0c4300 0x7ff5fc072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.484+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc169330 con 0x7ff5fc0c49c0 2024-05-09T00:15:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7ff5ec0016f0 con 0x7ff5fc0c49c0 2024-05-09T00:15:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 >> v1:172.21.15.114:6789/0 conn(0x7ff5fc0c49c0 legacy=0x7ff5fc165760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e0003b20 0x7ff5e0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5e0004800 0x7ff5e0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e00099b0 0x7ff5e000bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc0c6980 con 0x7ff5e00099b0 2024-05-09T00:15:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc08dd90 con 0x7ff5e0004800 2024-05-09T00:15:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e000c470 con 0x7ff5e0003b20 2024-05-09T00:15:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.485+0000 7ff601a00640 1 --2- 172.21.15.114:0/3327335803 >> v2:172.21.15.153:3300/0 conn(0x7ff5fc16d8e0 0x7ff5fc16fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.486+0000 7ff601000640 1 --2- 172.21.15.114:0/3327335803 >> v2:172.21.15.114:3300/0 conn(0x7ff5fc0c4300 0x7ff5fc072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.486+0000 7ff601a00640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e00099b0 0x7ff5e000bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.489+0000 7ff601a00640 1 -- 172.21.15.114:0/3327335803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e0003b20 msgr2=0x7ff5e0003f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:15:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.489+0000 7ff601a00640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e0003b20 0x7ff5e0003f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.489+0000 7ff601a00640 1 -- 172.21.15.114:0/3327335803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5e0004800 msgr2=0x7ff5e0004c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:15:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.489+0000 7ff601a00640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5e0004800 0x7ff5e0004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.489+0000 7ff601a00640 1 -- 172.21.15.114:0/3327335803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e0003520 con 0x7ff5e00099b0 2024-05-09T00:15:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.492+0000 7ff601a00640 1 -- 172.21.15.114:0/3327335803 reap_dead start 2024-05-09T00:15:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.492+0000 7ff601a00640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e00099b0 0x7ff5e000bdd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40073e0 tx=0x7ff5e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb38f91b45f4e847 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.499+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4009c70 con 0x7ff5e00099b0 2024-05-09T00:15:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.499+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f402c670 con 0x7ff5e00099b0 2024-05-09T00:15:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.499+0000 7ff5fb400640 1 -- 172.21.15.114:0/3327335803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f402ca40 con 0x7ff5e00099b0 2024-05-09T00:15:00.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.501+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e00099b0 msgr2=0x7ff5e000bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.501+0000 7ff603a00640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e00099b0 0x7ff5e000bdd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40073e0 tx=0x7ff5e0005830 comp rx=0 tx=0).stop 2024-05-09T00:15:00.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.502+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 shutdown_connections 2024-05-09T00:15:00.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.502+0000 7ff603a00640 1 --2- 172.21.15.114:0/3327335803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e00099b0 0x7ff5e000bdd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.502+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 >> 172.21.15.114:0/3327335803 conn(0x7ff5fc06c680 msgr2=0x7ff5fc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.505+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 shutdown_connections 2024-05-09T00:15:00.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.506+0000 7ff603a00640 1 -- 172.21.15.114:0/3327335803 wait complete. 2024-05-09T00:15:00.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.514+0000 7ff603a00640 1 Processor -- start 2024-05-09T00:15:00.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.514+0000 7ff603a00640 1 -- start start 2024-05-09T00:15:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.522+0000 7ff603a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e00099b0 0x7ff5fc0c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.522+0000 7ff603a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5fc0aeb40 0x7ff5fc0bed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.522+0000 7ff603a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5fc0bf2b0 0x7ff5fc202750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.523+0000 7ff603a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc072930 con 0x7ff5fc0bf2b0 2024-05-09T00:15:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.523+0000 7ff603a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1652d0 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.523+0000 7ff603a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc072d70 con 0x7ff5e00099b0 2024-05-09T00:15:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.523+0000 7ff601a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5fc0bf2b0 0x7ff5fc202750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.524+0000 7ff601a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5fc0bf2b0 0x7ff5fc202750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55760/0 (socket says 172.21.15.114:55760) 2024-05-09T00:15:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.524+0000 7ff601a00640 1 -- 172.21.15.114:0/955144507 learned_addr learned my addr 172.21.15.114:0/955144507 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.523+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5fc0aeb40 0x7ff5fc0bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.527+0000 7ff5fbe00640 1 -- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e00099b0 msgr2=0x7ff5fc0c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.527+0000 7ff5fbe00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e00099b0 0x7ff5fc0c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.527+0000 7ff5fbe00640 1 -- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5fc0bf2b0 msgr2=0x7ff5fc202750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.527+0000 7ff5fbe00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5fc0bf2b0 0x7ff5fc202750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.527+0000 7ff5fbe00640 1 -- 172.21.15.114:0/955144507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc16b3c0 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.529+0000 7ff5fbe00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5fc0aeb40 0x7ff5fc0bed70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c730 tx=0x7ff5ec00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.532+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec004da0 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.532+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc16b6a0 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.532+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec00a640 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.532+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00aa30 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.534+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc0c0760 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.535+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc077430 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.539+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff5ec011070 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.541+0000 7ff5f8c00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff5dc0763d0 0x7ff5dc0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.541+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7ff5ec098030 con 0x7ff5fc0aeb40 2024-05-09T00:15:00.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.549+0000 7ff601000640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff5dc0763d0 0x7ff5dc0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.551+0000 7ff601000640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff5dc0763d0 0x7ff5dc0788e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800a860 tx=0x7ff5e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:00.552+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5ec0614c0 con 0x7ff5fc0aeb40 2024-05-09T00:15:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.141+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5fc0c47a0 con 0x7ff5fc0aeb40 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.148+0000 7ff5f8c00640 1 -- 172.21.15.114:0/955144507 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7ff5ec060dc0 con 0x7ff5fc0aeb40 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:15:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.156+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff5dc0763d0 msgr2=0x7ff5dc0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.156+0000 7ff603a00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff5dc0763d0 0x7ff5dc0788e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800a860 tx=0x7ff5e8008040 comp rx=0 tx=0).stop 2024-05-09T00:15:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.156+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5fc0aeb40 msgr2=0x7ff5fc0bed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.156+0000 7ff603a00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5fc0aeb40 0x7ff5fc0bed70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c730 tx=0x7ff5ec00cbf0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 shutdown_connections 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff5dc0763d0 0x7ff5dc0788e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5fc0bf2b0 0x7ff5fc202750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5fc0aeb40 0x7ff5fc0bed70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 --2- 172.21.15.114:0/955144507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5e00099b0 0x7ff5fc0c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 >> 172.21.15.114:0/955144507 conn(0x7ff5fc06c680 msgr2=0x7ff5fc0c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.160+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 shutdown_connections 2024-05-09T00:15:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:01.161+0000 7ff603a00640 1 -- 172.21.15.114:0/955144507 wait complete. 2024-05-09T00:15:01.236 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:15:03.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.892+0000 7f7e17e00640 1 Processor -- start 2024-05-09T00:15:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.892+0000 7f7e17e00640 1 -- start start 2024-05-09T00:15:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.905+0000 7f7e17e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7e1004f540 0x7f7e100e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.905+0000 7f7e17e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7e10050cb0 0x7f7e100e1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.905+0000 7f7e17e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e100527d0 con 0x7f7e100510c0 2024-05-09T00:15:03.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.906+0000 7f7e17e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7e10053100 con 0x7f7e1004f540 2024-05-09T00:15:03.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.910+0000 7f7e16000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7e10050cb0 0x7f7e100e1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.910+0000 7f7e16a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7e1004f540 0x7f7e100e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.910+0000 7f7e16a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7e1004f540 0x7f7e100e2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55770/0 (socket says 172.21.15.114:55770) 2024-05-09T00:15:03.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.910+0000 7f7e16a00640 1 -- 172.21.15.114:0/234582794 learned_addr learned my addr 172.21.15.114:0/234582794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:03.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.910+0000 7f7e17e00640 1 -- 172.21.15.114:0/234582794 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7e10052ab0 con 0x7f7e10050cb0 2024-05-09T00:15:03.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.912+0000 7f7e16a00640 1 -- 172.21.15.114:0/234582794 >> v2:172.21.15.153:3300/0 conn(0x7f7e10050cb0 msgr2=0x7f7e100e1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:03.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.912+0000 7f7e16a00640 1 --2- 172.21.15.114:0/234582794 >> v2:172.21.15.153:3300/0 conn(0x7f7e10050cb0 0x7f7e100e1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.912+0000 7f7e16a00640 1 -- 172.21.15.114:0/234582794 >> v1:172.21.15.114:6789/0 conn(0x7f7e100510c0 legacy=0x7f7e10053590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.912+0000 7f7e16a00640 1 -- 172.21.15.114:0/234582794 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e10052d90 con 0x7f7e1004f540 2024-05-09T00:15:03.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.920+0000 7f7e16a00640 1 --2- 172.21.15.114:0/234582794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e100e2f90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7e1004ed70 tx=0x7f7e0802a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34871153cce9b776 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.920+0000 7f7e15600640 1 -- 172.21.15.114:0/234582794 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08036070 con 0x7f7e1004f540 2024-05-09T00:15:03.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.922+0000 7f7e15600640 1 -- 172.21.15.114:0/234582794 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08031600 con 0x7f7e1004f540 2024-05-09T00:15:03.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.923+0000 7f7e17e00640 1 -- 172.21.15.114:0/234582794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 msgr2=0x7f7e100e2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.923+0000 7f7e15600640 1 -- 172.21.15.114:0/234582794 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08036070 con 0x7f7e1004f540 2024-05-09T00:15:03.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.924+0000 7f7e17e00640 1 --2- 172.21.15.114:0/234582794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e100e2f90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7e1004ed70 tx=0x7f7e0802a510 comp rx=0 tx=0).stop 2024-05-09T00:15:03.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.925+0000 7f7e17e00640 1 -- 172.21.15.114:0/234582794 shutdown_connections 2024-05-09T00:15:03.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.925+0000 7f7e17e00640 1 --2- 172.21.15.114:0/234582794 >> v2:172.21.15.153:3300/0 conn(0x7f7e10050cb0 0x7f7e100e1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.925+0000 7f7e17e00640 1 --2- 172.21.15.114:0/234582794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e100e2f90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.925+0000 7f7e17e00640 1 -- 172.21.15.114:0/234582794 >> 172.21.15.114:0/234582794 conn(0x7f7e10035f90 msgr2=0x7f7e100363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.926+0000 7f7e17e00640 1 -- 172.21.15.114:0/234582794 shutdown_connections 2024-05-09T00:15:03.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.926+0000 7f7e17e00640 1 -- 172.21.15.114:0/234582794 wait complete. 2024-05-09T00:15:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.932+0000 7f7e17e00640 1 Processor -- start 2024-05-09T00:15:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.933+0000 7f7e17e00640 1 -- start start 2024-05-09T00:15:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.938+0000 7f7e17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e1004b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.938+0000 7f7e17e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 0x7f7e100e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.939+0000 7f7e16a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e1004b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.939+0000 7f7e16000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 0x7f7e100e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.939+0000 7f7e16000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 0x7f7e100e1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:52902/0 (socket says 172.21.15.114:52902) 2024-05-09T00:15:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.939+0000 7f7e16a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e1004b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55776/0 (socket says 172.21.15.114:55776) 2024-05-09T00:15:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.942+0000 7f7e16000640 1 -- 172.21.15.114:0/3954232968 learned_addr learned my addr 172.21.15.114:0/3954232968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.942+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e10169d50 0x7f7e100d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.942+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10053ca0 con 0x7f7e1004f540 2024-05-09T00:15:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.942+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10052320 con 0x7f7e10169d50 2024-05-09T00:15:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.942+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7e10053e20 con 0x7f7e10050cb0 2024-05-09T00:15:03.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.942+0000 7f7e17400640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e10169d50 0x7f7e100d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.943+0000 7f7e16000640 1 -- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e10169d50 msgr2=0x7f7e100d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.943+0000 7f7e16000640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e10169d50 0x7f7e100d9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.943+0000 7f7e16000640 1 -- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 msgr2=0x7f7e1004b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.943+0000 7f7e16000640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e1004b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.943+0000 7f7e16000640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e100e2070 con 0x7f7e10050cb0 2024-05-09T00:15:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.943+0000 7f7e16a00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e1004b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:03.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.945+0000 7f7e16000640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 0x7f7e100e1710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e8a0 tx=0x7f7e0400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.947+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04017070 con 0x7f7e10050cb0 2024-05-09T00:15:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.947+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e10169270 con 0x7f7e10050cb0 2024-05-09T00:15:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.947+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e10169830 con 0x7f7e10050cb0 2024-05-09T00:15:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.948+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0400c940 con 0x7f7e10050cb0 2024-05-09T00:15:03.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.948+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04017070 con 0x7f7e10050cb0 2024-05-09T00:15:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.953+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e0401a070 con 0x7f7e10050cb0 2024-05-09T00:15:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.955+0000 7f7e0f400640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7df80764d0 0x7f7df80789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.955+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7096+0+0 (secure 0 0 0) 0x7f7e04097bb0 con 0x7f7e10050cb0 2024-05-09T00:15:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.958+0000 7f7e16a00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7df80764d0 0x7f7df80789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.960+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df0005290 con 0x7f7e10050cb0 2024-05-09T00:15:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.961+0000 7f7e16a00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7df80764d0 0x7f7df80789e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e08033000 tx=0x7f7e08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:03.972+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7e04060940 con 0x7f7e10050cb0 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.569+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7df0005580 con 0x7f7e10050cb0 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.580+0000 7f7e0f400640 1 -- 172.21.15.114:0/3954232968 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6500 (secure 0 0 0) 0x7f7e04064c40 con 0x7f7e10050cb0 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4888,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:13:39.549912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.114:6836/1891949153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1891949153},{"type":"v1","addr":"172.21.15.114:6836","nonce":1891949153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4914,"qdb_cluster":[4914]},"id":2}]} 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.588+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7df80764d0 msgr2=0x7f7df80789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.588+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7df80764d0 0x7f7df80789e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e08033000 tx=0x7f7e08008030 comp rx=0 tx=0).stop 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.589+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 msgr2=0x7f7e100e1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.589+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 0x7f7e100e1710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e8a0 tx=0x7f7e0400ed60 comp rx=0 tx=0).stop 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.589+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 shutdown_connections 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.590+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7df80764d0 0x7f7df80789e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.590+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e10169d50 0x7f7e100d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.590+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e10050cb0 0x7f7e100e1710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.590+0000 7f7e17e00640 1 --2- 172.21.15.114:0/3954232968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1004f540 0x7f7e1004b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.590+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 >> 172.21.15.114:0/3954232968 conn(0x7f7e10035f90 msgr2=0x7f7e10006930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.591+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 shutdown_connections 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:04.591+0000 7f7e17e00640 1 -- 172.21.15.114:0/3954232968 wait complete. 2024-05-09T00:15:04.657 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:15:06.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.145+0000 7fb2c6400640 1 Processor -- start 2024-05-09T00:15:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.145+0000 7fb2c6400640 1 -- start start 2024-05-09T00:15:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.151+0000 7fb2c6400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2c00730f0 0x7fb2c0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.151+0000 7fb2c6400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c00c4880 con 0x7fb2c00c5bb0 2024-05-09T00:15:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.151+0000 7fb2c6400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c00c4b60 con 0x7fb2c006d1a0 2024-05-09T00:15:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.151+0000 7fb2c6400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c0073500 con 0x7fb2c00730f0 2024-05-09T00:15:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.152+0000 7fb2bea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb2c00c5bb0 0x7fb2c0151820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35290/0 (socket says 172.21.15.114:35290) 2024-05-09T00:15:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.152+0000 7fb2bea00640 1 -- 172.21.15.114:0/2500030534 learned_addr learned my addr 172.21.15.114:0/2500030534 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:15:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.153+0000 7fb2bfe00640 1 --2- 172.21.15.114:0/2500030534 >> v2:172.21.15.153:3300/0 conn(0x7fb2c00730f0 0x7fb2c0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.154+0000 7fb2be000640 1 -- 172.21.15.114:0/2500030534 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226555591 0 0) 0x7fb2c00c4880 con 0x7fb2c00c5bb0 2024-05-09T00:15:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.154+0000 7fb2be000640 1 -- 172.21.15.114:0/2500030534 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a4003520 con 0x7fb2c00c5bb0 2024-05-09T00:15:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.154+0000 7fb2bfe00640 1 -- 172.21.15.114:0/2500030534 >> v1:172.21.15.153:6789/0 conn(0x7fb2c006d1a0 legacy=0x7fb2c00c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.154+0000 7fb2bfe00640 1 -- 172.21.15.114:0/2500030534 >> v1:172.21.15.114:6789/0 conn(0x7fb2c00c5bb0 legacy=0x7fb2c0151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.154+0000 7fb2bfe00640 1 -- 172.21.15.114:0/2500030534 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c00c4e40 con 0x7fb2c00730f0 2024-05-09T00:15:07.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.162+0000 7fb2bfe00640 1 --2- 172.21.15.114:0/2500030534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00730f0 0x7fb2c0157c70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009d90 tx=0x7fb2b802a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bd6b5aa0b083800 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.162+0000 7fb2be000640 1 -- 172.21.15.114:0/2500030534 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8007740 con 0x7fb2c00730f0 2024-05-09T00:15:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.162+0000 7fb2be000640 1 -- 172.21.15.114:0/2500030534 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b80078e0 con 0x7fb2c00730f0 2024-05-09T00:15:07.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.162+0000 7fb2be000640 1 -- 172.21.15.114:0/2500030534 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8007740 con 0x7fb2c00730f0 2024-05-09T00:15:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.162+0000 7fb2c6400640 1 -- 172.21.15.114:0/2500030534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00730f0 msgr2=0x7fb2c0157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.167+0000 7fb2c6400640 1 --2- 172.21.15.114:0/2500030534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00730f0 0x7fb2c0157c70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009d90 tx=0x7fb2b802a4d0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.168+0000 7fb2c6400640 1 -- 172.21.15.114:0/2500030534 shutdown_connections 2024-05-09T00:15:07.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.168+0000 7fb2c6400640 1 --2- 172.21.15.114:0/2500030534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c00730f0 0x7fb2c0157c70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.168+0000 7fb2c6400640 1 -- 172.21.15.114:0/2500030534 >> 172.21.15.114:0/2500030534 conn(0x7fb2c006c680 msgr2=0x7fb2c006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:07.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.174+0000 7fb2c6400640 1 -- 172.21.15.114:0/2500030534 shutdown_connections 2024-05-09T00:15:07.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.174+0000 7fb2c6400640 1 -- 172.21.15.114:0/2500030534 wait complete. 2024-05-09T00:15:07.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.192+0000 7fb2c6400640 1 Processor -- start 2024-05-09T00:15:07.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.192+0000 7fb2c6400640 1 -- start start 2024-05-09T00:15:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.202+0000 7fb2c6400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 0x7fb2c0154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.205+0000 7fb2c6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2c00730f0 0x7fb2c00ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.205+0000 7fb2c6400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2c00c5bb0 0x7fb2c013bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.206+0000 7fb2c6400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c00af6c0 con 0x7fb2c00730f0 2024-05-09T00:15:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.207+0000 7fb2c6400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0073730 con 0x7fb2c006d1a0 2024-05-09T00:15:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.207+0000 7fb2bf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 0x7fb2c0154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.208+0000 7fb2bf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 0x7fb2c0154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:36752/0 (socket says 172.21.15.114:36752) 2024-05-09T00:15:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.208+0000 7fb2bf400640 1 -- 172.21.15.114:0/1828053448 learned_addr learned my addr 172.21.15.114:0/1828053448 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.209+0000 7fb2bfe00640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2c00c5bb0 0x7fb2c013bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.209+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c00af840 con 0x7fb2c00c5bb0 2024-05-09T00:15:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.210+0000 7fb2bf400640 1 -- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2c00c5bb0 msgr2=0x7fb2c013bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.211+0000 7fb2bf400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2c00c5bb0 0x7fb2c013bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.211+0000 7fb2bf400640 1 -- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2c00730f0 msgr2=0x7fb2c00ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.211+0000 7fb2bf400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2c00730f0 0x7fb2c00ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.211+0000 7fb2bf400640 1 -- 172.21.15.114:0/1828053448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c00c3050 con 0x7fb2c006d1a0 2024-05-09T00:15:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.213+0000 7fb2bf400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 0x7fb2c0154c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c550 tx=0x7fb2b000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.215+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0017070 con 0x7fb2c006d1a0 2024-05-09T00:15:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.215+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0005480 con 0x7fb2c006d1a0 2024-05-09T00:15:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.215+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00037f0 con 0x7fb2c006d1a0 2024-05-09T00:15:07.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.215+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c00ae6b0 con 0x7fb2c006d1a0 2024-05-09T00:15:07.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.218+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c014bd30 con 0x7fb2c006d1a0 2024-05-09T00:15:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.220+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c0077430 con 0x7fb2c006d1a0 2024-05-09T00:15:07.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.225+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2b001a070 con 0x7fb2c006d1a0 2024-05-09T00:15:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.227+0000 7fb2b7400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb2a00763a0 0x7fb2a00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.228+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7fb2b0097280 con 0x7fb2c006d1a0 2024-05-09T00:15:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.229+0000 7fb2bea00640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb2a00763a0 0x7fb2a00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:07.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.230+0000 7fb2bea00640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb2a00763a0 0x7fb2a00788b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac000c00 tx=0x7fb2ac0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:07.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.239+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2b003a020 con 0x7fb2c006d1a0 2024-05-09T00:15:07.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.833+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2c006ce10 con 0x7fb2c006d1a0 2024-05-09T00:15:07.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.837+0000 7fb2b7400640 1 -- 172.21.15.114:0/1828053448 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5664 (secure 0 0 0) 0x7fb2b0060040 con 0x7fb2c006d1a0 2024-05-09T00:15:07.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:07.835 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:04.943711+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:15:07.836 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-05-09T00:15:07.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.843+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb2a00763a0 msgr2=0x7fb2a00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.843+0000 7fb2c6400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb2a00763a0 0x7fb2a00788b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac000c00 tx=0x7fb2ac0079c0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.843+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 msgr2=0x7fb2c0154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.843+0000 7fb2c6400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 0x7fb2c0154c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c550 tx=0x7fb2b000ca10 comp rx=0 tx=0).stop 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 shutdown_connections 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb2a00763a0 0x7fb2a00788b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2c00c5bb0 0x7fb2c013bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2c00730f0 0x7fb2c00ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 --2- 172.21.15.114:0/1828053448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2c006d1a0 0x7fb2c0154c30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:07.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 >> 172.21.15.114:0/1828053448 conn(0x7fb2c006c680 msgr2=0x7fb2c01515f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:07.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 shutdown_connections 2024-05-09T00:15:07.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:07.845+0000 7fb2c6400640 1 -- 172.21.15.114:0/1828053448 wait complete. 2024-05-09T00:15:07.890 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-05-09T00:15:07.890 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T00:15:07.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.548+0000 7f91f6400640 1 Processor -- start 2024-05-09T00:15:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.548+0000 7f91f6400640 1 -- start start 2024-05-09T00:15:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.553+0000 7f91f6400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91f00cb840 0x7f91f00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.553+0000 7f91f6400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f00cd2b0 con 0x7f91f006dee0 2024-05-09T00:15:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.553+0000 7f91f6400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f00cc9c0 con 0x7f91f00c4020 2024-05-09T00:15:08.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.554+0000 7f91efe00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f91f00c4020 0x7f91f006cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:45322/0 (socket says 172.21.15.114:45322) 2024-05-09T00:15:08.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.554+0000 7f91efe00640 1 -- 172.21.15.114:0/111752658 learned_addr learned my addr 172.21.15.114:0/111752658 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:15:08.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.554+0000 7f91f5a00640 1 --2- 172.21.15.114:0/111752658 >> v2:172.21.15.153:3300/0 conn(0x7f91f00cb840 0x7f91f00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.554+0000 7f91f6400640 1 -- 172.21.15.114:0/111752658 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f91f008ee80 con 0x7f91f00cb840 2024-05-09T00:15:08.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.555+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536472791 0 0) 0x7f91f00cc9c0 con 0x7f91f00c4020 2024-05-09T00:15:08.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.555+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d8003520 con 0x7f91f00c4020 2024-05-09T00:15:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.555+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619707937 0 0) 0x7f91f00cd2b0 con 0x7f91f006dee0 2024-05-09T00:15:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.555+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d8003880 con 0x7f91f006dee0 2024-05-09T00:15:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.555+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3466346733 0 0) 0x7f91d8003520 con 0x7f91f00c4020 2024-05-09T00:15:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.555+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 >> v2:172.21.15.153:3300/0 conn(0x7f91f00cb840 msgr2=0x7f91f00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.556+0000 7f91ef400640 1 --2- 172.21.15.114:0/111752658 >> v2:172.21.15.153:3300/0 conn(0x7f91f00cb840 0x7f91f00c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.556+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 >> v1:172.21.15.114:6789/0 conn(0x7f91f006dee0 legacy=0x7f91f00c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.556+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f00ccfd0 con 0x7f91f00c4020 2024-05-09T00:15:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.556+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f91dc001650 con 0x7f91f00c4020 2024-05-09T00:15:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 >> v1:172.21.15.153:6789/0 conn(0x7f91f00c4020 legacy=0x7f91f006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91d8003e20 0x7f91d8004250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d8004910 0x7f91d8004de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91d800bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f91f008ee80 con 0x7f91d8004910 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91d800c550 con 0x7f91d80099b0 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.557+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91d800c750 con 0x7f91d8003e20 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.558+0000 7f91efe00640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d8004910 0x7f91d8004de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.558+0000 7f91f5000640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91d8003e20 0x7f91d8004250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.558+0000 7f91f5a00640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91d800bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.559+0000 7f91f5a00640 1 -- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91d8003e20 msgr2=0x7f91d8004250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.559+0000 7f91f5a00640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91d8003e20 0x7f91d8004250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.559+0000 7f91f5a00640 1 -- 172.21.15.114:0/111752658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d8004910 msgr2=0x7f91d8004de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.559+0000 7f91f5a00640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d8004910 0x7f91d8004de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.559+0000 7f91f5a00640 1 -- 172.21.15.114:0/111752658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d8003520 con 0x7f91d80099b0 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.560+0000 7f91f5a00640 1 -- 172.21.15.114:0/111752658 reap_dead start 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.561+0000 7f91f5a00640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91d800bdd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91e8007360 tx=0x7f91d8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a103538d4282d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.562+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8009be0 con 0x7f91d80099b0 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.562+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e8003b90 con 0x7f91d80099b0 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.562+0000 7f91ef400640 1 -- 172.21.15.114:0/111752658 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8004020 con 0x7f91d80099b0 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.563+0000 7f91f6400640 1 -- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 msgr2=0x7f91d800bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.563+0000 7f91f6400640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91d800bdd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91e8007360 tx=0x7f91d8005830 comp rx=0 tx=0).stop 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.564+0000 7f91f6400640 1 -- 172.21.15.114:0/111752658 shutdown_connections 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.564+0000 7f91f6400640 1 --2- 172.21.15.114:0/111752658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91d800bdd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.564+0000 7f91f6400640 1 -- 172.21.15.114:0/111752658 >> 172.21.15.114:0/111752658 conn(0x7f91f00ca140 msgr2=0x7f91f00ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.564+0000 7f91f6400640 1 -- 172.21.15.114:0/111752658 shutdown_connections 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.564+0000 7f91f6400640 1 -- 172.21.15.114:0/111752658 wait complete. 2024-05-09T00:15:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.574+0000 7f91f6400640 1 Processor -- start 2024-05-09T00:15:08.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.574+0000 7f91f6400640 1 -- start start 2024-05-09T00:15:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.579+0000 7f91f6400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91f0153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.579+0000 7f91f6400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91f00b2f70 0x7f91f0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.579+0000 7f91f6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f01544e0 0x7f91f00c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.579+0000 7f91f6400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f91f00c8bb0 con 0x7f91f01544e0 2024-05-09T00:15:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.579+0000 7f91f6400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91f00c8a30 con 0x7f91d80099b0 2024-05-09T00:15:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.579+0000 7f91f6400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91f0158ca0 con 0x7f91f00b2f70 2024-05-09T00:15:08.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.580+0000 7f91f5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91f0153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.580+0000 7f91f5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91f0153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:53618/0 (socket says 172.21.15.114:53618) 2024-05-09T00:15:08.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.580+0000 7f91f5000640 1 -- 172.21.15.114:0/2955398665 learned_addr learned my addr 172.21.15.114:0/2955398665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.580+0000 7f91efe00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91f00b2f70 0x7f91f0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.580+0000 7f91f5a00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f01544e0 0x7f91f00c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.581+0000 7f91efe00640 1 -- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 msgr2=0x7f91f0153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.581+0000 7f91efe00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91f0153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.581+0000 7f91efe00640 1 -- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f01544e0 msgr2=0x7f91f00c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.581+0000 7f91efe00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f01544e0 0x7f91f00c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.581+0000 7f91efe00640 1 -- 172.21.15.114:0/2955398665 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f01f58c0 con 0x7f91f00b2f70 2024-05-09T00:15:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.581+0000 7f91f5a00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f01544e0 0x7f91f00c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:15:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.582+0000 7f91efe00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91f00b2f70 0x7f91f0153fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91dc004e00 tx=0x7f91dc007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.583+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc007770 con 0x7f91f00b2f70 2024-05-09T00:15:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.583+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91dc018070 con 0x7f91f00b2f70 2024-05-09T00:15:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.583+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00f9f0 con 0x7f91f00b2f70 2024-05-09T00:15:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.583+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f01f5ba0 con 0x7f91f00b2f70 2024-05-09T00:15:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.583+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f01f6160 con 0x7f91f00b2f70 2024-05-09T00:15:08.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.584+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f0078430 con 0x7f91f00b2f70 2024-05-09T00:15:08.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.587+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91dc00fb90 con 0x7f91f00b2f70 2024-05-09T00:15:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.588+0000 7f91ecc00640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91d00763a0 0x7f91d00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.589+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f91dc097800 con 0x7f91f00b2f70 2024-05-09T00:15:08.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.593+0000 7f91f5000640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91d00763a0 0x7f91d00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:08.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.594+0000 7f91f5000640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91d00763a0 0x7f91d00788b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f91e4001360 tx=0x7f91e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:08.595+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91dc0605c0 con 0x7f91f00b2f70 2024-05-09T00:15:09.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.196+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91f0155800 con 0x7f91f00b2f70 2024-05-09T00:15:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.199+0000 7f91ecc00640 1 -- 172.21.15.114:0/2955398665 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5664 (secure 0 0 0) 0x7f91dc0648c0 con 0x7f91f00b2f70 2024-05-09T00:15:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:09.197 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:04.943711+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:15:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-05-09T00:15:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.206+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91d00763a0 msgr2=0x7f91d00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.206+0000 7f91f6400640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91d00763a0 0x7f91d00788b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f91e4001360 tx=0x7f91e4009040 comp rx=0 tx=0).stop 2024-05-09T00:15:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.206+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91f00b2f70 msgr2=0x7f91f0153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.206+0000 7f91f6400640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91f00b2f70 0x7f91f0153fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91dc004e00 tx=0x7f91dc007430 comp rx=0 tx=0).stop 2024-05-09T00:15:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.207+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 shutdown_connections 2024-05-09T00:15:09.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.207+0000 7f91f6400640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91d00763a0 0x7f91d00788b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:09.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.207+0000 7f91f6400640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f01544e0 0x7f91f00c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:09.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.207+0000 7f91f6400640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91f00b2f70 0x7f91f0153fa0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91dc004e00 tx=0x7f91dc007430 comp rx=0 tx=0).stop 2024-05-09T00:15:09.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.207+0000 7f91f6400640 1 --2- 172.21.15.114:0/2955398665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91d80099b0 0x7f91f0153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:09.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.207+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 >> 172.21.15.114:0/2955398665 conn(0x7f91f00ca140 msgr2=0x7f91f006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:09.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.211+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 shutdown_connections 2024-05-09T00:15:09.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:09.216+0000 7f91f6400640 1 -- 172.21.15.114:0/2955398665 wait complete. 2024-05-09T00:15:09.261 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 38, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 36, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4819": { "addr": "172.21.15.153:6835/4100525107", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6834", "nonce": 4100525107, "type": "v2" }, { "addr": "172.21.15.153:6835", "nonce": 4100525107, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4819, "incarnation": 33, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:14:26.367799+0000", "qdb_cluster": [ 4819 ], "qdb_leader": 4819, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4819 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 38, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4888": { "addr": "172.21.15.114:6837/372512194", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 372512194, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 372512194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4888, "incarnation": 38, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:15:04.943711+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4888 } } } ], "standbys": [ { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 31, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:15:11.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:11.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.758+0000 7fe0e2200640 1 Processor -- start 2024-05-09T00:15:11.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.758+0000 7fe0e2200640 1 -- start start 2024-05-09T00:15:11.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.761+0000 7fe0e2200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0dc1586e0 0x7fe0dc06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:11.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.762+0000 7fe0e2200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc0af300 0x7fe0dc06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.762+0000 7fe0db400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0dc1586e0 0x7fe0dc06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.763+0000 7fe0db400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0dc1586e0 0x7fe0dc06f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36152/0 (socket says 172.21.15.114:36152) 2024-05-09T00:15:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.763+0000 7fe0db400640 1 -- 172.21.15.114:0/3813449230 learned_addr learned my addr 172.21.15.114:0/3813449230 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.763+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc073bc0 con 0x7fe0dc154730 2024-05-09T00:15:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.763+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc0c54c0 con 0x7fe0dc1586e0 2024-05-09T00:15:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.763+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc158c30 con 0x7fe0dc0af300 2024-05-09T00:15:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.763+0000 7fe0daa00640 1 --2- 172.21.15.114:0/3813449230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc0af300 0x7fe0dc06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:11.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.766+0000 7fe0db400640 1 -- 172.21.15.114:0/3813449230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc0af300 msgr2=0x7fe0dc06f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:11.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.766+0000 7fe0db400640 1 --2- 172.21.15.114:0/3813449230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc0af300 0x7fe0dc06f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:11.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.766+0000 7fe0db400640 1 -- 172.21.15.114:0/3813449230 >> v1:172.21.15.153:6789/0 conn(0x7fe0dc154730 legacy=0x7fe0dc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:11.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.766+0000 7fe0db400640 1 -- 172.21.15.114:0/3813449230 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc073600 con 0x7fe0dc1586e0 2024-05-09T00:15:11.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.769+0000 7fe0db400640 1 --2- 172.21.15.114:0/3813449230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc1586e0 0x7fe0dc06f3a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009870 tx=0x7fe0cc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1d18b9ce10b348 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.773+0000 7fe0da000640 1 -- 172.21.15.114:0/3813449230 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc037070 con 0x7fe0dc1586e0 2024-05-09T00:15:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.773+0000 7fe0da000640 1 -- 172.21.15.114:0/3813449230 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc032440 con 0x7fe0dc1586e0 2024-05-09T00:15:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.773+0000 7fe0da000640 1 -- 172.21.15.114:0/3813449230 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc032810 con 0x7fe0dc1586e0 2024-05-09T00:15:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.774+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc1586e0 msgr2=0x7fe0dc06f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.774+0000 7fe0e2200640 1 --2- 172.21.15.114:0/3813449230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc1586e0 0x7fe0dc06f3a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009870 tx=0x7fe0cc02a1c0 comp rx=0 tx=0).stop 2024-05-09T00:15:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.776+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 shutdown_connections 2024-05-09T00:15:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.776+0000 7fe0e2200640 1 --2- 172.21.15.114:0/3813449230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc0af300 0x7fe0dc06f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.776+0000 7fe0e2200640 1 --2- 172.21.15.114:0/3813449230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc1586e0 0x7fe0dc06f3a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.776+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 >> 172.21.15.114:0/3813449230 conn(0x7fe0dc06c680 msgr2=0x7fe0dc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.777+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 shutdown_connections 2024-05-09T00:15:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.777+0000 7fe0e2200640 1 -- 172.21.15.114:0/3813449230 wait complete. 2024-05-09T00:15:11.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.781+0000 7fe0e2200640 1 Processor -- start 2024-05-09T00:15:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.782+0000 7fe0e2200640 1 -- start start 2024-05-09T00:15:11.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.785+0000 7fe0e2200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0dc0af300 0x7fe0dc0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.785+0000 7fe0e2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc154730 0x7fe0dc1e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.785+0000 7fe0e2200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc1586e0 0x7fe0dc1ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.785+0000 7fe0e2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc155250 con 0x7fe0dc154730 2024-05-09T00:15:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.785+0000 7fe0e2200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc06fe20 con 0x7fe0dc0af300 2024-05-09T00:15:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.785+0000 7fe0e2200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc151f70 con 0x7fe0dc1586e0 2024-05-09T00:15:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.789+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc1586e0 0x7fe0dc1ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.789+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc1586e0 0x7fe0dc1ee6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:59004/0 (socket says 172.21.15.114:59004) 2024-05-09T00:15:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.790+0000 7fe0db400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0dc0af300 0x7fe0dc0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.790+0000 7fe0db400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0dc0af300 0x7fe0dc0c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:53620/0 (socket says 172.21.15.114:53620) 2024-05-09T00:15:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.790+0000 7fe0db400640 1 -- 172.21.15.114:0/136813596 learned_addr learned my addr 172.21.15.114:0/136813596 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.789+0000 7fe0daa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc154730 0x7fe0dc1e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.792+0000 7fe0daa00640 1 -- 172.21.15.114:0/136813596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc1586e0 msgr2=0x7fe0dc1ee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.792+0000 7fe0daa00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc1586e0 0x7fe0dc1ee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.792+0000 7fe0daa00640 1 -- 172.21.15.114:0/136813596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0dc0af300 msgr2=0x7fe0dc0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.792+0000 7fe0daa00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0dc0af300 0x7fe0dc0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.792+0000 7fe0daa00640 1 -- 172.21.15.114:0/136813596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1f1be0 con 0x7fe0dc154730 2024-05-09T00:15:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.794+0000 7fe0daa00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc154730 0x7fe0dc1e52e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800e8a0 tx=0x7fe0c800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.795+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8017070 con 0x7fe0dc154730 2024-05-09T00:15:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.795+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c800c940 con 0x7fe0dc154730 2024-05-09T00:15:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.795+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8017070 con 0x7fe0dc154730 2024-05-09T00:15:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.797+0000 7fe0e2200640 1 -- 172.21.15.114:0/136813596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1f1ec0 con 0x7fe0dc154730 2024-05-09T00:15:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.801+0000 7fe0e2200640 1 -- 172.21.15.114:0/136813596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1f2480 con 0x7fe0dc154730 2024-05-09T00:15:11.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.804+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0c801a070 con 0x7fe0dc154730 2024-05-09T00:15:11.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.806+0000 7fe0d3400640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe0bc0764d0 0x7fe0bc0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.808+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc06a4c0 con 0x7fe0dc154730 2024-05-09T00:15:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.812+0000 7fe0db400640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe0bc0764d0 0x7fe0bc0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.812+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7fe0c805c010 con 0x7fe0dc154730 2024-05-09T00:15:11.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.814+0000 7fe0db400640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe0bc0764d0 0x7fe0bc0789e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc02a200 tx=0x7fe0cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:11.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:11.825+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe0dc06a4c0 con 0x7fe0dc154730 2024-05-09T00:15:12.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.432+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0dc077430 con 0x7fe0dc154730 2024-05-09T00:15:12.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.433+0000 7fe0d3400640 1 -- 172.21.15.114:0/136813596 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5665 (secure 0 0 0) 0x7fe0c805fa20 con 0x7fe0dc154730 2024-05-09T00:15:12.431 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:12.431 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:11.288319+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:15:12.432 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 40 2024-05-09T00:15:12.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.437+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe0bc0764d0 msgr2=0x7fe0bc0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:12.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.437+0000 7fe0d0c00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe0bc0764d0 0x7fe0bc0789e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc02a200 tx=0x7fe0cc02e000 comp rx=0 tx=0).stop 2024-05-09T00:15:12.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.437+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc154730 msgr2=0x7fe0dc1e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:12.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.437+0000 7fe0d0c00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc154730 0x7fe0dc1e52e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800e8a0 tx=0x7fe0c800ed60 comp rx=0 tx=0).stop 2024-05-09T00:15:12.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.440+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 shutdown_connections 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.440+0000 7fe0d0c00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe0bc0764d0 0x7fe0bc0789e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.440+0000 7fe0d0c00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0dc1586e0 0x7fe0dc1ee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.440+0000 7fe0d0c00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0dc154730 0x7fe0dc1e52e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.440+0000 7fe0d0c00640 1 --2- 172.21.15.114:0/136813596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0dc0af300 0x7fe0dc0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.440+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 >> 172.21.15.114:0/136813596 conn(0x7fe0dc06c680 msgr2=0x7fe0dc154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.441+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 shutdown_connections 2024-05-09T00:15:12.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:12.441+0000 7fe0d0c00640 1 -- 172.21.15.114:0/136813596 wait complete. 2024-05-09T00:15:12.487 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:15:13.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:15:14.008 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:15:14.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.005+0000 7f9270800640 1 Processor -- start 2024-05-09T00:15:15.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.006+0000 7f9270800640 1 -- start start 2024-05-09T00:15:15.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.008+0000 7f9270800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9268159170 0x7f92680b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.008+0000 7f926de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9268159170 0x7f92680b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.009+0000 7f9270800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92680c8a50 con 0x7f92680cc2d0 2024-05-09T00:15:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.009+0000 7f9270800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92680c8d30 con 0x7f926815c360 2024-05-09T00:15:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.009+0000 7f9270800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f926815c770 con 0x7f9268159170 2024-05-09T00:15:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.009+0000 7f926e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f92680cc2d0 0x7f92680cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42538/0 (socket says 172.21.15.114:42538) 2024-05-09T00:15:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.009+0000 7f926e800640 1 -- 172.21.15.114:0/3249269641 learned_addr learned my addr 172.21.15.114:0/3249269641 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:15:15.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.010+0000 7f926de00640 1 -- 172.21.15.114:0/3249269641 >> v1:172.21.15.153:6789/0 conn(0x7f926815c360 legacy=0x7f92680cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.010+0000 7f926ca00640 1 -- 172.21.15.114:0/3249269641 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035363663 0 0) 0x7f92680c8a50 con 0x7f92680cc2d0 2024-05-09T00:15:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.010+0000 7f926de00640 1 -- 172.21.15.114:0/3249269641 >> v1:172.21.15.114:6789/0 conn(0x7f92680cc2d0 legacy=0x7f92680cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.010+0000 7f926de00640 1 -- 172.21.15.114:0/3249269641 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92680cbad0 con 0x7f9268159170 2024-05-09T00:15:15.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.014+0000 7f926de00640 1 --2- 172.21.15.114:0/3249269641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159170 0x7f92680b2dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f925c0097a0 tx=0x7f925c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e544d6748372bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:15.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.015+0000 7f926ca00640 1 -- 172.21.15.114:0/3249269641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c037070 con 0x7f9268159170 2024-05-09T00:15:15.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.015+0000 7f926ca00640 1 -- 172.21.15.114:0/3249269641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c02adb0 con 0x7f9268159170 2024-05-09T00:15:15.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.015+0000 7f926ca00640 1 -- 172.21.15.114:0/3249269641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c032660 con 0x7f9268159170 2024-05-09T00:15:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.017+0000 7f9270800640 1 -- 172.21.15.114:0/3249269641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159170 msgr2=0x7f92680b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.017+0000 7f9270800640 1 --2- 172.21.15.114:0/3249269641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159170 0x7f92680b2dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f925c0097a0 tx=0x7f925c02a060 comp rx=0 tx=0).stop 2024-05-09T00:15:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.017+0000 7f9270800640 1 -- 172.21.15.114:0/3249269641 shutdown_connections 2024-05-09T00:15:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.017+0000 7f9270800640 1 --2- 172.21.15.114:0/3249269641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159170 0x7f92680b2dd0 secure :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f925c0097a0 tx=0x7f925c02a060 comp rx=0 tx=0).stop 2024-05-09T00:15:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.017+0000 7f9270800640 1 -- 172.21.15.114:0/3249269641 >> 172.21.15.114:0/3249269641 conn(0x7f92680af930 msgr2=0x7f92680cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.018+0000 7f9270800640 1 -- 172.21.15.114:0/3249269641 shutdown_connections 2024-05-09T00:15:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.019+0000 7f9270800640 1 -- 172.21.15.114:0/3249269641 wait complete. 2024-05-09T00:15:15.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.022+0000 7f9270800640 1 Processor -- start 2024-05-09T00:15:15.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.023+0000 7f9270800640 1 -- start start 2024-05-09T00:15:15.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f9270800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92680cc2d0 0x7f926815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f9270800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926815c360 0x7f9268157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f9270800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 0x7f926815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f9270800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92680ce530 con 0x7f9268159df0 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f9270800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92680c9e30 con 0x7f92680cc2d0 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f9270800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9268158530 con 0x7f926815c360 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f926e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 0x7f926815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f926e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 0x7f926815a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36176/0 (socket says 172.21.15.114:36176) 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.025+0000 7f926e800640 1 -- 172.21.15.114:0/3692660370 learned_addr learned my addr 172.21.15.114:0/3692660370 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.026+0000 7f926e800640 1 -- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926815c360 msgr2=0x7f9268157680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.026+0000 7f926e800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926815c360 0x7f9268157680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:15.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.026+0000 7f926e800640 1 -- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92680cc2d0 msgr2=0x7f926815b310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:15:15.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.028+0000 7f926de00640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92680cc2d0 0x7f926815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.028+0000 7f926e800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92680cc2d0 0x7f926815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.028+0000 7f926e800640 1 -- 172.21.15.114:0/3692660370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926815b850 con 0x7f9268159df0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.029+0000 7f926e800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 0x7f926815a200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9264002110 tx=0x7f9264014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.029+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264014da0 con 0x7f9268159df0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.029+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9264004b60 con 0x7f9268159df0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.029+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264012110 con 0x7f9268159df0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.029+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92681ee280 con 0x7f9268159df0 2024-05-09T00:15:15.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.030+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681595f0 con 0x7f9268159df0 2024-05-09T00:15:15.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.031+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92681586e0 con 0x7f9268159df0 2024-05-09T00:15:15.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.034+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92640122b0 con 0x7f9268159df0 2024-05-09T00:15:15.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.035+0000 7f9262000640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f924c0762d0 0x7f924c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:15.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.035+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f92640a0010 con 0x7f9268159df0 2024-05-09T00:15:15.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.039+0000 7f926de00640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f924c0762d0 0x7f924c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:15.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.041+0000 7f926de00640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f924c0762d0 0x7f924c0787e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f925c034000 tx=0x7f925c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:15.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.042+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f92681586e0 con 0x7f9268159df0 2024-05-09T00:15:15.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.633+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9268077430 con 0x7f9268159df0 2024-05-09T00:15:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.637+0000 7f9262000640 1 -- 172.21.15.114:0/3692660370 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5672 (secure 0 0 0) 0x7f92681586e0 con 0x7f9268159df0 2024-05-09T00:15:15.639 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:15.639 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 41 2024-05-09T00:15:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f924c0762d0 msgr2=0x7f924c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f924c0762d0 0x7f924c0787e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f925c034000 tx=0x7f925c02e000 comp rx=0 tx=0).stop 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 msgr2=0x7f926815a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 0x7f926815a200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9264002110 tx=0x7f9264014420 comp rx=0 tx=0).stop 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 shutdown_connections 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f924c0762d0 0x7f924c0787e0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f925c034000 tx=0x7f925c02e000 comp rx=0 tx=0).stop 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268159df0 0x7f926815a200 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f926815c360 0x7f9268157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 --2- 172.21.15.114:0/3692660370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92680cc2d0 0x7f926815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.644+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 >> 172.21.15.114:0/3692660370 conn(0x7f92680af930 msgr2=0x7f9268155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.645+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 shutdown_connections 2024-05-09T00:15:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:15.645+0000 7f9270800640 1 -- 172.21.15.114:0/3692660370 wait complete. 2024-05-09T00:15:15.708 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=4914 2024-05-09T00:15:15.708 INFO:tasks.mds_thrash.fs.[b]:waiting for 6 secs before reviving mds.c 2024-05-09T00:15:17.616 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-05-09T00:15:17.618+0000 7f45dc200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:15:21.709 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-05-09T00:15:21.709 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T00:15:21.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T00:15:21.715 INFO:tasks.ceph.mds.c:Started 2024-05-09T00:15:21.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:22.155 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-05-09T00:15:22.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.216+0000 7f6740000640 1 Processor -- start 2024-05-09T00:15:22.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.217+0000 7f6740000640 1 -- start start 2024-05-09T00:15:22.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.219+0000 7f6740000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072890 0x7f6738159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:22.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.219+0000 7f6740000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6738160600 0x7f67380c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:22.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.219+0000 7f6740000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673815a190 con 0x7f6738072d50 2024-05-09T00:15:22.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.219+0000 7f6740000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6738160170 con 0x7f6738160600 2024-05-09T00:15:22.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.219+0000 7f6740000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f673815fe20 con 0x7f6738072890 2024-05-09T00:15:22.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.222+0000 7f673e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6738160600 0x7f67380c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:22.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.222+0000 7f673e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6738160600 0x7f67380c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40950/0 (socket says 172.21.15.114:40950) 2024-05-09T00:15:22.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.222+0000 7f673e000640 1 -- 172.21.15.114:0/72167180 learned_addr learned my addr 172.21.15.114:0/72167180 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:22.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.223+0000 7f673e000640 1 -- 172.21.15.114:0/72167180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072890 msgr2=0x7f6738159c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:15:22.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.224+0000 7f673e000640 1 --2- 172.21.15.114:0/72167180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072890 0x7f6738159c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.224+0000 7f673e000640 1 -- 172.21.15.114:0/72167180 >> v1:172.21.15.153:6789/0 conn(0x7f6738072d50 legacy=0x7f67380c4760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:15:22.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.224+0000 7f673e000640 1 -- 172.21.15.114:0/72167180 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673815d1b0 con 0x7f6738160600 2024-05-09T00:15:22.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.229+0000 7f673e000640 1 --2- 172.21.15.114:0/72167180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738160600 0x7f67380c6050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f67380c7220 tx=0x7f673002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22783e38fe99ce22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:22.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.231+0000 7f6737e00640 1 -- 172.21.15.114:0/72167180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730036070 con 0x7f6738160600 2024-05-09T00:15:22.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.231+0000 7f6737e00640 1 -- 172.21.15.114:0/72167180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6730031600 con 0x7f6738160600 2024-05-09T00:15:22.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.231+0000 7f6737e00640 1 -- 172.21.15.114:0/72167180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67300319d0 con 0x7f6738160600 2024-05-09T00:15:22.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.238+0000 7f6740000640 1 -- 172.21.15.114:0/72167180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738160600 msgr2=0x7f67380c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:22.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.238+0000 7f6740000640 1 --2- 172.21.15.114:0/72167180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738160600 0x7f67380c6050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f67380c7220 tx=0x7f673002a5f0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.240+0000 7f6740000640 1 -- 172.21.15.114:0/72167180 shutdown_connections 2024-05-09T00:15:22.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.240+0000 7f6740000640 1 --2- 172.21.15.114:0/72167180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738160600 0x7f67380c6050 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.241+0000 7f6740000640 1 --2- 172.21.15.114:0/72167180 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072890 0x7f6738159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.241+0000 7f6740000640 1 -- 172.21.15.114:0/72167180 >> 172.21.15.114:0/72167180 conn(0x7f673806c680 msgr2=0x7f673806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:22.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.245+0000 7f6740000640 1 -- 172.21.15.114:0/72167180 shutdown_connections 2024-05-09T00:15:22.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.245+0000 7f6740000640 1 -- 172.21.15.114:0/72167180 wait complete. 2024-05-09T00:15:22.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.255+0000 7f6740000640 1 Processor -- start 2024-05-09T00:15:22.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.255+0000 7f6740000640 1 -- start start 2024-05-09T00:15:22.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.261+0000 7f6740000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738072890 0x7f67380c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:22.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.261+0000 7f6740000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072d50 0x7f67381f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:22.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.262+0000 7f6740000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738160600 0x7f6738152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.262+0000 7f6740000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6738160a10 con 0x7f6738072890 2024-05-09T00:15:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.262+0000 7f6740000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67380c42e0 con 0x7f6738160600 2024-05-09T00:15:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.262+0000 7f6740000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6738160b90 con 0x7f6738072d50 2024-05-09T00:15:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.264+0000 7f673d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738072890 0x7f67380c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.264+0000 7f673d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738072890 0x7f67380c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40954/0 (socket says 172.21.15.114:40954) 2024-05-09T00:15:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.264+0000 7f673d600640 1 -- 172.21.15.114:0/1160074181 learned_addr learned my addr 172.21.15.114:0/1160074181 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.264+0000 7f673e000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738160600 0x7f6738152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.265+0000 7f673cc00640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072d50 0x7f67381f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.266+0000 7f673e000640 1 -- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072d50 msgr2=0x7f67381f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.266+0000 7f673e000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072d50 0x7f67381f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.266+0000 7f673e000640 1 -- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738072890 msgr2=0x7f67380c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.266+0000 7f673e000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738072890 0x7f67380c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.266+0000 7f673e000640 1 -- 172.21.15.114:0/1160074181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381f6a60 con 0x7f6738160600 2024-05-09T00:15:22.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.268+0000 7f673e000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738160600 0x7f6738152490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6738070610 tx=0x7f6730004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:22.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.269+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730041020 con 0x7f6738160600 2024-05-09T00:15:22.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.269+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673815efa0 con 0x7f6738160600 2024-05-09T00:15:22.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.270+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6730007780 con 0x7f6738160600 2024-05-09T00:15:22.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.270+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730041020 con 0x7f6738160600 2024-05-09T00:15:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.273+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f673815f560 con 0x7f6738160600 2024-05-09T00:15:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.283+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6738077430 con 0x7f6738160600 2024-05-09T00:15:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.288+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6730044020 con 0x7f6738160600 2024-05-09T00:15:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.290+0000 7f6735600640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6718076500 0x7f6718078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.290+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f67300b8290 con 0x7f6738160600 2024-05-09T00:15:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.294+0000 7f673d600640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6718076500 0x7f6718078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:22.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.298+0000 7f673d600640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6718076500 0x7f6718078a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f672c009960 tx=0x7f672c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.307+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6730081620 con 0x7f6738160600 2024-05-09T00:15:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.930+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67380c6590 con 0x7f6738160600 2024-05-09T00:15:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.932+0000 7f6735600640 1 -- 172.21.15.114:0/1160074181 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5672 (secure 0 0 0) 0x7f6730080f20 con 0x7f6738160600 2024-05-09T00:15:22.930 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:22.933 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:22.934 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 41 2024-05-09T00:15:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6718076500 msgr2=0x7f6718078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6718076500 0x7f6718078a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f672c009960 tx=0x7f672c0090e0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738160600 msgr2=0x7f6738152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738160600 0x7f6738152490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6738070610 tx=0x7f6730004a40 comp rx=0 tx=0).stop 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 shutdown_connections 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6718076500 0x7f6718078a10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738160600 0x7f6738152490 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6738072d50 0x7f67381f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 --2- 172.21.15.114:0/1160074181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6738072890 0x7f67380c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 >> 172.21.15.114:0/1160074181 conn(0x7f673806c680 msgr2=0x7f67380c5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.938+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 shutdown_connections 2024-05-09T00:15:22.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:22.940+0000 7f6740000640 1 -- 172.21.15.114:0/1160074181 wait complete. 2024-05-09T00:15:23.002 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-05-09T00:15:25.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:25.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.516+0000 7f811c400640 1 Processor -- start 2024-05-09T00:15:25.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.517+0000 7f811c400640 1 -- start start 2024-05-09T00:15:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.520+0000 7f811c400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8114072500 0x7f81140c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.521+0000 7f811c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81140c5950 con 0x7f81140c65c0 2024-05-09T00:15:25.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.522+0000 7f811c400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81140c5c30 con 0x7f8114154e20 2024-05-09T00:15:25.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.522+0000 7f811c400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f81140c4b00 con 0x7f8114072500 2024-05-09T00:15:25.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.523+0000 7f811ae00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8114154e20 0x7f811415eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:46848/0 (socket says 172.21.15.114:46848) 2024-05-09T00:15:25.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.523+0000 7f8119a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8114072500 0x7f81140c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.523+0000 7f8119a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8114072500 0x7f81140c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40970/0 (socket says 172.21.15.114:40970) 2024-05-09T00:15:25.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.523+0000 7f8119a00640 1 -- 172.21.15.114:0/3036656540 learned_addr learned my addr 172.21.15.114:0/3036656540 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:25.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.525+0000 7f8119a00640 1 -- 172.21.15.114:0/3036656540 >> v1:172.21.15.153:6789/0 conn(0x7f8114154e20 legacy=0x7f811415eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.525+0000 7f8113e00640 1 -- 172.21.15.114:0/3036656540 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547825817 0 0) 0x7f81140c5c30 con 0x7f8114154e20 2024-05-09T00:15:25.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.526+0000 7f8119a00640 1 -- 172.21.15.114:0/3036656540 >> v1:172.21.15.114:6789/0 conn(0x7f81140c65c0 legacy=0x7f8114154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.526+0000 7f8119a00640 1 -- 172.21.15.114:0/3036656540 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81140c4de0 con 0x7f8114072500 2024-05-09T00:15:25.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.528+0000 7f8119a00640 1 --2- 172.21.15.114:0/3036656540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8114072500 0x7f81140c6080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8108009ad0 tx=0x7f810802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4c9a1fd706c128 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.530+0000 7f8113e00640 1 -- 172.21.15.114:0/3036656540 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108037070 con 0x7f8114072500 2024-05-09T00:15:25.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.530+0000 7f8113e00640 1 -- 172.21.15.114:0/3036656540 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810802adb0 con 0x7f8114072500 2024-05-09T00:15:25.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.530+0000 7f8113e00640 1 -- 172.21.15.114:0/3036656540 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108032660 con 0x7f8114072500 2024-05-09T00:15:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.532+0000 7f811c400640 1 -- 172.21.15.114:0/3036656540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8114072500 msgr2=0x7f81140c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.532+0000 7f811c400640 1 --2- 172.21.15.114:0/3036656540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8114072500 0x7f81140c6080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8108009ad0 tx=0x7f810802a330 comp rx=0 tx=0).stop 2024-05-09T00:15:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.533+0000 7f811c400640 1 -- 172.21.15.114:0/3036656540 shutdown_connections 2024-05-09T00:15:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.533+0000 7f811c400640 1 --2- 172.21.15.114:0/3036656540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8114072500 0x7f81140c6080 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.533+0000 7f811c400640 1 -- 172.21.15.114:0/3036656540 >> 172.21.15.114:0/3036656540 conn(0x7f81140c95f0 msgr2=0x7f81140c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.533+0000 7f811c400640 1 -- 172.21.15.114:0/3036656540 shutdown_connections 2024-05-09T00:15:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.534+0000 7f811c400640 1 -- 172.21.15.114:0/3036656540 wait complete. 2024-05-09T00:15:25.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.540+0000 7f811c400640 1 Processor -- start 2024-05-09T00:15:25.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.541+0000 7f811c400640 1 -- start start 2024-05-09T00:15:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.544+0000 7f811c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8114072500 0x7f81141f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.544+0000 7f811c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 0x7f8114151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.545+0000 7f8119000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 0x7f8114151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.545+0000 7f8119000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 0x7f8114151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40984/0 (socket says 172.21.15.114:40984) 2024-05-09T00:15:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.545+0000 7f8119000640 1 -- 172.21.15.114:0/4256352447 learned_addr learned my addr 172.21.15.114:0/4256352447 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.546+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8114154e20 0x7f81141e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.546+0000 7f8119a00640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8114072500 0x7f81141f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.546+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8114073510 con 0x7f81140c65c0 2024-05-09T00:15:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.546+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8114157750 con 0x7f8114154e20 2024-05-09T00:15:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.547+0000 7f811ae00640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8114154e20 0x7f81141e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.547+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81140c55a0 con 0x7f8114072500 2024-05-09T00:15:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.548+0000 7f8119a00640 1 -- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8114154e20 msgr2=0x7f81141e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.548+0000 7f8119a00640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8114154e20 0x7f81141e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.549+0000 7f8119a00640 1 -- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 msgr2=0x7f8114151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.549+0000 7f8119a00640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 0x7f8114151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.549+0000 7f8119a00640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8114155530 con 0x7f8114072500 2024-05-09T00:15:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.550+0000 7f8119000640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 0x7f8114151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:15:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.552+0000 7f8119a00640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8114072500 0x7f81141f31e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81140c5b60 tx=0x7f81080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.552+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108042020 con 0x7f8114072500 2024-05-09T00:15:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.552+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8108003d40 con 0x7f8114072500 2024-05-09T00:15:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.552+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108037040 con 0x7f8114072500 2024-05-09T00:15:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.554+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81141f2a20 con 0x7f8114072500 2024-05-09T00:15:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.558+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8114157040 con 0x7f8114072500 2024-05-09T00:15:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.559+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8114157fe0 con 0x7f8114072500 2024-05-09T00:15:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.563+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8108045020 con 0x7f8114072500 2024-05-09T00:15:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.566+0000 7f8111600640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80f40762d0 0x7f80f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.567+0000 7f8119000640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80f40762d0 0x7f80f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.566+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f81080b82a0 con 0x7f8114072500 2024-05-09T00:15:25.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.571+0000 7f8119000640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80f40762d0 0x7f80f40787e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f81140c9b70 tx=0x7f8100009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:25.572+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8114157fe0 con 0x7f8114072500 2024-05-09T00:15:26.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.166+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811406a4c0 con 0x7f8114072500 2024-05-09T00:15:26.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.167+0000 7f8111600640 1 -- 172.21.15.114:0/4256352447 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7f811406a4c0 con 0x7f8114072500 2024-05-09T00:15:26.167 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:26.169 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:26.170 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:26.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.174+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80f40762d0 msgr2=0x7f80f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.174+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80f40762d0 0x7f80f40787e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f81140c9b70 tx=0x7f8100009040 comp rx=0 tx=0).stop 2024-05-09T00:15:26.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.174+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8114072500 msgr2=0x7f81141f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.174+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8114072500 0x7f81141f31e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81140c5b60 tx=0x7f81080046c0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 shutdown_connections 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f80f40762d0 0x7f80f40787e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8114154e20 0x7f81141e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81140c65c0 0x7f8114151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 --2- 172.21.15.114:0/4256352447 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8114072500 0x7f81141f31e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 >> 172.21.15.114:0/4256352447 conn(0x7f81140c95f0 msgr2=0x7f81141578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 shutdown_connections 2024-05-09T00:15:26.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:26.175+0000 7f811c400640 1 -- 172.21.15.114:0/4256352447 wait complete. 2024-05-09T00:15:26.246 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-05-09T00:15:26.246 INFO:tasks.mds_thrash.fs.[b]:waiting for 103 secs before thrashing 2024-05-09T00:15:28.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:29.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.391+0000 7f6b54c00640 1 Processor -- start 2024-05-09T00:15:29.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.391+0000 7f6b54c00640 1 -- start start 2024-05-09T00:15:29.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.392+0000 7f6b54c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b500c8730 0x7f6b50155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b54c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b54c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b50158e80 con 0x7f6b50158a70 2024-05-09T00:15:29.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b54c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6b500b3460 con 0x7f6b500c8730 2024-05-09T00:15:29.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b54c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5015b630 con 0x7f6b500cb800 2024-05-09T00:15:29.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b4f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b500c8730 0x7f6b50155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b4f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b500c8730 0x7f6b50155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:57386/0 (socket says 172.21.15.114:57386) 2024-05-09T00:15:29.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b4f400640 1 -- 172.21.15.114:0/3312808636 learned_addr learned my addr 172.21.15.114:0/3312808636 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:29.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.393+0000 7f6b4fe00640 1 --2- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.394+0000 7f6b4f400640 1 -- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 msgr2=0x7f6b500cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:29.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.394+0000 7f6b4f400640 1 --2- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.394+0000 7f6b4f400640 1 -- 172.21.15.114:0/3312808636 >> v1:172.21.15.153:6789/0 conn(0x7f6b50158a70 legacy=0x7f6b500ca440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:15:29.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.394+0000 7f6b4f400640 1 -- 172.21.15.114:0/3312808636 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5008f550 con 0x7f6b500c8730 2024-05-09T00:15:29.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.395+0000 7f6b4f400640 1 --2- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b500c8730 0x7f6b50155710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b5015b7b0 tx=0x7f6b4002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97ef2fecd0ac88e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:29.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.397+0000 7f6b4e000640 1 -- 172.21.15.114:0/3312808636 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40037070 con 0x7f6b500c8730 2024-05-09T00:15:29.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.397+0000 7f6b4e000640 1 -- 172.21.15.114:0/3312808636 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4002add0 con 0x7f6b500c8730 2024-05-09T00:15:29.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.397+0000 7f6b4e000640 1 -- 172.21.15.114:0/3312808636 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40032660 con 0x7f6b500c8730 2024-05-09T00:15:29.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.399+0000 7f6b54c00640 1 -- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b500c8730 msgr2=0x7f6b50155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.399+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b500c8730 0x7f6b50155710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b5015b7b0 tx=0x7f6b4002a080 comp rx=0 tx=0).stop 2024-05-09T00:15:29.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.404+0000 7f6b54c00640 1 -- 172.21.15.114:0/3312808636 shutdown_connections 2024-05-09T00:15:29.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.404+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.404+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3312808636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b500c8730 0x7f6b50155710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.405+0000 7f6b54c00640 1 -- 172.21.15.114:0/3312808636 >> 172.21.15.114:0/3312808636 conn(0x7f6b500af450 msgr2=0x7f6b500af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:29.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.405+0000 7f6b54c00640 1 -- 172.21.15.114:0/3312808636 shutdown_connections 2024-05-09T00:15:29.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.405+0000 7f6b54c00640 1 -- 172.21.15.114:0/3312808636 wait complete. 2024-05-09T00:15:29.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.415+0000 7f6b54c00640 1 Processor -- start 2024-05-09T00:15:29.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.415+0000 7f6b54c00640 1 -- start start 2024-05-09T00:15:29.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.418+0000 7f6b54c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b500c8730 0x7f6b500c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.419+0000 7f6b54c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.419+0000 7f6b54c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 0x7f6b501504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.419+0000 7f6b54c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5015bb60 con 0x7f6b500c8730 2024-05-09T00:15:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.420+0000 7f6b54c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5015c1b0 con 0x7f6b50158a70 2024-05-09T00:15:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.420+0000 7f6b54c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5015be40 con 0x7f6b500cb800 2024-05-09T00:15:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.420+0000 7f6b4fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 0x7f6b501504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.420+0000 7f6b4fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 0x7f6b501504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:57396/0 (socket says 172.21.15.114:57396) 2024-05-09T00:15:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.420+0000 7f6b4fe00640 1 -- 172.21.15.114:0/3094929221 learned_addr learned my addr 172.21.15.114:0/3094929221 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:29.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.422+0000 7f6b4ea00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.422+0000 7f6b4f400640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b500c8730 0x7f6b500c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.423+0000 7f6b4fe00640 1 -- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 msgr2=0x7f6b500b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.424+0000 7f6b4fe00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.424+0000 7f6b4fe00640 1 -- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b500c8730 msgr2=0x7f6b500c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.424+0000 7f6b4fe00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b500c8730 0x7f6b500c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.427+0000 7f6b4fe00640 1 -- 172.21.15.114:0/3094929221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b501eeb60 con 0x7f6b50158a70 2024-05-09T00:15:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.427+0000 7f6b4f400640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b500c8730 0x7f6b500c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:15:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.427+0000 7f6b4ea00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.428+0000 7f6b4fe00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 0x7f6b501504e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b48007e60 tx=0x7f6b4800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.430+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48014420 con 0x7f6b50158a70 2024-05-09T00:15:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.432+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b48019070 con 0x7f6b50158a70 2024-05-09T00:15:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.432+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48014820 con 0x7f6b50158a70 2024-05-09T00:15:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.433+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b501eee00 con 0x7f6b50158a70 2024-05-09T00:15:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.436+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b500ce140 con 0x7f6b50158a70 2024-05-09T00:15:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.439+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b50078430 con 0x7f6b50158a70 2024-05-09T00:15:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.444+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b480149c0 con 0x7f6b50158a70 2024-05-09T00:15:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.447+0000 7f6b47400640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6b300763a0 0x7f6b300788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.447+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f6b48098370 con 0x7f6b50158a70 2024-05-09T00:15:29.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.449+0000 7f6b4f400640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6b300763a0 0x7f6b300788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.454+0000 7f6b4f400640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6b300763a0 0x7f6b300788b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b40034000 tx=0x7f6b4002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:29.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:29.457+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b501eeb60 con 0x7f6b50158a70 2024-05-09T00:15:30.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.017+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b5015b160 con 0x7f6b50158a70 2024-05-09T00:15:30.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.022+0000 7f6b47400640 1 -- 172.21.15.114:0/3094929221 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7f6b480616f0 con 0x7f6b50158a70 2024-05-09T00:15:30.021 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:30.021 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:30.021 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:30.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.033+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6b300763a0 msgr2=0x7f6b300788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.033+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6b300763a0 0x7f6b300788b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b40034000 tx=0x7f6b4002e000 comp rx=0 tx=0).stop 2024-05-09T00:15:30.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.033+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 msgr2=0x7f6b501504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.033+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 0x7f6b501504e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b48007e60 tx=0x7f6b4800e4b0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.036+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 shutdown_connections 2024-05-09T00:15:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.036+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6b300763a0 0x7f6b300788b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.036+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b50158a70 0x7f6b501504e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.036+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b500cb800 0x7f6b500b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.036+0000 7f6b54c00640 1 --2- 172.21.15.114:0/3094929221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b500c8730 0x7f6b500c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.036+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 >> 172.21.15.114:0/3094929221 conn(0x7f6b500af450 msgr2=0x7f6b50158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:30.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.039+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 shutdown_connections 2024-05-09T00:15:30.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.039+0000 7f6b54c00640 1 -- 172.21.15.114:0/3094929221 wait complete. 2024-05-09T00:15:30.104 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-05-09T00:15:30.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T00:15:30.104 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:15:30.164 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T00:15:30.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:30.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.663+0000 7f37fc800640 1 Processor -- start 2024-05-09T00:15:30.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.663+0000 7f37fc800640 1 -- start start 2024-05-09T00:15:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.672+0000 7f37fc800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37f406d1a0 0x7f37f40730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.672+0000 7f37fc800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37f40c5bb0 0x7f37f4151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.673+0000 7f37f9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37f40c5bb0 0x7f37f4151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.673+0000 7f37f9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37f40c5bb0 0x7f37f4151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:57408/0 (socket says 172.21.15.114:57408) 2024-05-09T00:15:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.674+0000 7f37f9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37f406d1a0 0x7f37f40730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.674+0000 7f37f9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37f406d1a0 0x7f37f40730f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35322/0 (socket says 172.21.15.114:35322) 2024-05-09T00:15:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.677+0000 7f37fc800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f40c4880 con 0x7f37f40c60f0 2024-05-09T00:15:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.677+0000 7f37f9400640 1 -- 172.21.15.114:0/1571400977 learned_addr learned my addr 172.21.15.114:0/1571400977 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:30.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.681+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287640535 0 0) 0x7f37f40c4880 con 0x7f37f40c60f0 2024-05-09T00:15:30.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.681+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f37f4073730 con 0x7f37f406d1a0 2024-05-09T00:15:30.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.681+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f37f40c4b60 con 0x7f37f40c5bb0 2024-05-09T00:15:30.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.681+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37dc003520 con 0x7f37f40c60f0 2024-05-09T00:15:30.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2746436473 0 0) 0x7f37dc003520 con 0x7f37f40c60f0 2024-05-09T00:15:30.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 >> v2:172.21.15.153:3300/0 conn(0x7f37f40c5bb0 msgr2=0x7f37f4151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 --2- 172.21.15.114:0/1571400977 >> v2:172.21.15.153:3300/0 conn(0x7f37f40c5bb0 0x7f37f4151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 >> v2:172.21.15.114:3300/0 conn(0x7f37f406d1a0 msgr2=0x7f37f40730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 --2- 172.21.15.114:0/1571400977 >> v2:172.21.15.114:3300/0 conn(0x7f37f406d1a0 0x7f37f40730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f40c4e40 con 0x7f37f40c60f0 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f37e40016f0 con 0x7f37f40c60f0 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 >> v1:172.21.15.153:6789/0 conn(0x7f37f40c60f0 legacy=0x7f37f4157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37dc003a00 0x7f37dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc004800 0x7f37dc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.682+0000 7f37f8a00640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37dc0051a0 0x7f37dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.683+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4073730 con 0x7f37dc004800 2024-05-09T00:15:30.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.683+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40c4b60 con 0x7f37dc0051a0 2024-05-09T00:15:30.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.683+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc00c190 con 0x7f37dc003a00 2024-05-09T00:15:30.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.683+0000 7f37f9e00640 1 --2- 172.21.15.114:0/1571400977 >> v2:172.21.15.114:3300/0 conn(0x7f37f406d1a0 0x7f37f40730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:30.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.683+0000 7f37fa800640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37dc0051a0 0x7f37dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.683+0000 7f37f9400640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc004800 0x7f37dc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.684+0000 7f37f9e00640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37dc003a00 0x7f37dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37fa800640 1 -- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37dc003a00 msgr2=0x7f37dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:30.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37fa800640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37dc003a00 0x7f37dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37fa800640 1 -- 172.21.15.114:0/1571400977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc004800 msgr2=0x7f37dc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:30.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37fa800640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc004800 0x7f37dc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37fa800640 1 -- 172.21.15.114:0/1571400977 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f40c4e40 con 0x7f37dc0051a0 2024-05-09T00:15:30.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37f9e00640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37dc003a00 0x7f37dc003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:30.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.685+0000 7f37f9400640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc004800 0x7f37dc004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:15:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.688+0000 7f37fa800640 1 -- 172.21.15.114:0/1571400977 reap_dead start 2024-05-09T00:15:30.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.688+0000 7f37fa800640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37dc0051a0 0x7f37dc00b9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37e400c210 tx=0x7f37dc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=725bfd042111ecb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.692+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e800dcd0 con 0x7f37dc0051a0 2024-05-09T00:15:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.693+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4032640 con 0x7f37dc0051a0 2024-05-09T00:15:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.693+0000 7f37f8a00640 1 -- 172.21.15.114:0/1571400977 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4007d40 con 0x7f37dc0051a0 2024-05-09T00:15:30.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.694+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37dc0051a0 msgr2=0x7f37dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.694+0000 7f37fc800640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37dc0051a0 0x7f37dc00b9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37e400c210 tx=0x7f37dc005830 comp rx=0 tx=0).stop 2024-05-09T00:15:30.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.696+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 shutdown_connections 2024-05-09T00:15:30.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.696+0000 7f37fc800640 1 --2- 172.21.15.114:0/1571400977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37dc0051a0 0x7f37dc00b9c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.696+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 >> 172.21.15.114:0/1571400977 conn(0x7f37f406c680 msgr2=0x7f37f406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.697+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 shutdown_connections 2024-05-09T00:15:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.697+0000 7f37fc800640 1 -- 172.21.15.114:0/1571400977 wait complete. 2024-05-09T00:15:30.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.707+0000 7f37fc800640 1 Processor -- start 2024-05-09T00:15:30.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.707+0000 7f37fc800640 1 -- start start 2024-05-09T00:15:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.712+0000 7f37fc800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc0051a0 0x7f37f4156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.712+0000 7f37fc800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 0x7f37f40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.713+0000 7f37fc800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37f414a630 0x7f37f414aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.713+0000 7f37fc800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40af840 con 0x7f37dc0051a0 2024-05-09T00:15:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.713+0000 7f37f9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 0x7f37f40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.713+0000 7f37f9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 0x7f37f40c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:36116/0 (socket says 172.21.15.114:36116) 2024-05-09T00:15:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.713+0000 7f37f9400640 1 -- 172.21.15.114:0/2126101301 learned_addr learned my addr 172.21.15.114:0/2126101301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.714+0000 7f37f9e00640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc0051a0 0x7f37f4156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.714+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40af6c0 con 0x7f37f414a630 2024-05-09T00:15:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.714+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f37f40730f0 con 0x7f37f414be50 2024-05-09T00:15:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.716+0000 7f37f9e00640 1 -- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 msgr2=0x7f37f40c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.716+0000 7f37f9e00640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 0x7f37f40c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.716+0000 7f37f9e00640 1 -- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37f414a630 msgr2=0x7f37f414aa40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:15:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.716+0000 7f37f9e00640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37f414a630 0x7f37f414aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.717+0000 7f37f9e00640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f4156850 con 0x7f37dc0051a0 2024-05-09T00:15:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.717+0000 7f37f9400640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 0x7f37f40c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:30.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.718+0000 7f37f9e00640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc0051a0 0x7f37f4156310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f37f00046b0 tx=0x7f37f0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.719+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f0014410 con 0x7f37dc0051a0 2024-05-09T00:15:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.719+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f0019070 con 0x7f37dc0051a0 2024-05-09T00:15:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.719+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00147b0 con 0x7f37dc0051a0 2024-05-09T00:15:30.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.720+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f41553e0 con 0x7f37dc0051a0 2024-05-09T00:15:30.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.720+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f4155830 con 0x7f37dc0051a0 2024-05-09T00:15:30.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.721+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f4077430 con 0x7f37dc0051a0 2024-05-09T00:15:30.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.734+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37f0005d10 con 0x7f37dc0051a0 2024-05-09T00:15:30.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.735+0000 7f37ee000640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37d80763a0 0x7f37d80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.736+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f37f0098ea0 con 0x7f37dc0051a0 2024-05-09T00:15:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.741+0000 7f37f9400640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37d80763a0 0x7f37d80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.744+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37f0062220 con 0x7f37dc0051a0 2024-05-09T00:15:30.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:30.745+0000 7f37f9400640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37d80763a0 0x7f37d80788b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f37e800db00 tx=0x7f37e800f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:31.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.305+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37f406cb30 con 0x7f37dc0051a0 2024-05-09T00:15:31.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.307+0000 7f37ee000640 1 -- 172.21.15.114:0/2126101301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7f37f006a210 con 0x7f37dc0051a0 2024-05-09T00:15:31.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:31.307 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:31.307 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.315+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37d80763a0 msgr2=0x7f37d80788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.315+0000 7f37fc800640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37d80763a0 0x7f37d80788b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f37e800db00 tx=0x7f37e800f040 comp rx=0 tx=0).stop 2024-05-09T00:15:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.315+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc0051a0 msgr2=0x7f37f4156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.315+0000 7f37fc800640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc0051a0 0x7f37f4156310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f37f00046b0 tx=0x7f37f0007700 comp rx=0 tx=0).stop 2024-05-09T00:15:31.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.324+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 shutdown_connections 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.324+0000 7f37fc800640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f37d80763a0 0x7f37d80788b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.324+0000 7f37fc800640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37f414a630 0x7f37f414aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.324+0000 7f37fc800640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37f414be50 0x7f37f40c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.324+0000 7f37fc800640 1 --2- 172.21.15.114:0/2126101301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc0051a0 0x7f37f4156310 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.324+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 >> 172.21.15.114:0/2126101301 conn(0x7f37f406c680 msgr2=0x7f37f4150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.325+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 shutdown_connections 2024-05-09T00:15:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:31.326+0000 7f37fc800640 1 -- 172.21.15.114:0/2126101301 wait complete. 2024-05-09T00:15:31.414 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:15:33.415 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.909+0000 7fc61e600640 1 Processor -- start 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.910+0000 7fc61e600640 1 -- start start 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.912+0000 7fc61e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618072890 0x7fc618159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.912+0000 7fc61e600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61815a190 con 0x7fc618160600 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.912+0000 7fc61e600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61815fe20 con 0x7fc618072d50 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.912+0000 7fc61e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc618160170 con 0x7fc618072890 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.913+0000 7fc617e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc618160600 0x7fc6180c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53302/0 (socket says 172.21.15.114:53302) 2024-05-09T00:15:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.913+0000 7fc617e00640 1 -- 172.21.15.114:0/407890329 learned_addr learned my addr 172.21.15.114:0/407890329 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:15:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.913+0000 7fc616a00640 1 --2- 172.21.15.114:0/407890329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618072890 0x7fc618159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.914+0000 7fc616a00640 1 -- 172.21.15.114:0/407890329 >> v1:172.21.15.153:6789/0 conn(0x7fc618072d50 legacy=0x7fc6180c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.914+0000 7fc616a00640 1 -- 172.21.15.114:0/407890329 >> v1:172.21.15.114:6789/0 conn(0x7fc618160600 legacy=0x7fc6180c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.914+0000 7fc616000640 1 -- 172.21.15.114:0/407890329 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938249089 0 0) 0x7fc61815fe20 con 0x7fc618072d50 2024-05-09T00:15:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.914+0000 7fc616a00640 1 -- 172.21.15.114:0/407890329 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61815d1b0 con 0x7fc618072890 2024-05-09T00:15:33.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.916+0000 7fc616a00640 1 --2- 172.21.15.114:0/407890329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618072890 0x7fc618159c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc61806d5c0 tx=0x7fc60802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b552661594149f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:33.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.919+0000 7fc616000640 1 -- 172.21.15.114:0/407890329 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608037070 con 0x7fc618072890 2024-05-09T00:15:33.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.919+0000 7fc616000640 1 -- 172.21.15.114:0/407890329 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60802ae50 con 0x7fc618072890 2024-05-09T00:15:33.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.919+0000 7fc616000640 1 -- 172.21.15.114:0/407890329 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608032640 con 0x7fc618072890 2024-05-09T00:15:33.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.920+0000 7fc61e600640 1 -- 172.21.15.114:0/407890329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618072890 msgr2=0x7fc618159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:33.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.920+0000 7fc61e600640 1 --2- 172.21.15.114:0/407890329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618072890 0x7fc618159c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc61806d5c0 tx=0x7fc60802a100 comp rx=0 tx=0).stop 2024-05-09T00:15:33.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.921+0000 7fc61e600640 1 -- 172.21.15.114:0/407890329 shutdown_connections 2024-05-09T00:15:33.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.921+0000 7fc61e600640 1 --2- 172.21.15.114:0/407890329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618072890 0x7fc618159c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:33.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.921+0000 7fc61e600640 1 -- 172.21.15.114:0/407890329 >> 172.21.15.114:0/407890329 conn(0x7fc61806c680 msgr2=0x7fc61806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:33.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.921+0000 7fc61e600640 1 -- 172.21.15.114:0/407890329 shutdown_connections 2024-05-09T00:15:33.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.921+0000 7fc61e600640 1 -- 172.21.15.114:0/407890329 wait complete. 2024-05-09T00:15:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.925+0000 7fc61e600640 1 Processor -- start 2024-05-09T00:15:33.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.925+0000 7fc61e600640 1 -- start start 2024-05-09T00:15:33.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.928+0000 7fc61e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 0x7fc61815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:33.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.928+0000 7fc61e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc618072d50 0x7fc6181f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:33.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.928+0000 7fc61e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 0x7fc618154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc61e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180c6760 con 0x7fc618072890 2024-05-09T00:15:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc61e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180c42e0 con 0x7fc618072d50 2024-05-09T00:15:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc61e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6180c68e0 con 0x7fc618160600 2024-05-09T00:15:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc617e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 0x7fc618154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc617e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 0x7fc618154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:36148/0 (socket says 172.21.15.114:36148) 2024-05-09T00:15:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc617400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 0x7fc61815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc617400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 0x7fc61815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35372/0 (socket says 172.21.15.114:35372) 2024-05-09T00:15:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.929+0000 7fc617400640 1 -- 172.21.15.114:0/1473724609 learned_addr learned my addr 172.21.15.114:0/1473724609 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.930+0000 7fc617400640 1 -- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 msgr2=0x7fc618154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.930+0000 7fc617400640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 0x7fc618154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.930+0000 7fc617400640 1 -- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc618072d50 msgr2=0x7fc6181f2db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:15:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.931+0000 7fc617e00640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 0x7fc618154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-09T00:15:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.932+0000 7fc616a00640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc618072d50 0x7fc6181f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.932+0000 7fc617400640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc618072d50 0x7fc6181f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.933+0000 7fc617400640 1 -- 172.21.15.114:0/1473724609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6181f32f0 con 0x7fc618072890 2024-05-09T00:15:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.933+0000 7fc616a00640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc618072d50 0x7fc6181f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.934+0000 7fc617400640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 0x7fc61815e740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc61000cb20 tx=0x7fc610002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:33.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.935+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610003b70 con 0x7fc618072890 2024-05-09T00:15:33.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.936+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc610003d10 con 0x7fc618072890 2024-05-09T00:15:33.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.936+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6180c6df0 con 0x7fc618072890 2024-05-09T00:15:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.937+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6100052b0 con 0x7fc618072890 2024-05-09T00:15:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.937+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6181f59b0 con 0x7fc618072890 2024-05-09T00:15:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.938+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc618077430 con 0x7fc618072890 2024-05-09T00:15:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.943+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc610005450 con 0x7fc618072890 2024-05-09T00:15:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.944+0000 7fc60f400640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc5f80763d0 0x7fc5f80788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.951+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7fc6100985d0 con 0x7fc618072890 2024-05-09T00:15:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.952+0000 7fc616a00640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc5f80763d0 0x7fc5f80788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.956+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6100618c0 con 0x7fc618072890 2024-05-09T00:15:33.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:33.959+0000 7fc616a00640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc5f80763d0 0x7fc5f80788e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc608034000 tx=0x7fc60802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.522+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6180c4540 con 0x7fc618072890 2024-05-09T00:15:34.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.526+0000 7fc60f400640 1 -- 172.21.15.114:0/1473724609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7fc6100611c0 con 0x7fc618072890 2024-05-09T00:15:34.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:34.528 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:34.529 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.531+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc5f80763d0 msgr2=0x7fc5f80788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.531+0000 7fc61e600640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc5f80763d0 0x7fc5f80788e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc608034000 tx=0x7fc60802e000 comp rx=0 tx=0).stop 2024-05-09T00:15:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.531+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 msgr2=0x7fc61815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.531+0000 7fc61e600640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 0x7fc61815e740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc61000cb20 tx=0x7fc610002090 comp rx=0 tx=0).stop 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.532+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 shutdown_connections 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.532+0000 7fc61e600640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc5f80763d0 0x7fc5f80788e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.532+0000 7fc61e600640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc618160600 0x7fc618154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.532+0000 7fc61e600640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc618072d50 0x7fc6181f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.532+0000 7fc61e600640 1 --2- 172.21.15.114:0/1473724609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc618072890 0x7fc61815e740 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.532+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 >> 172.21.15.114:0/1473724609 conn(0x7fc61806c680 msgr2=0x7fc61806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.533+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 shutdown_connections 2024-05-09T00:15:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:34.533+0000 7fc61e600640 1 -- 172.21.15.114:0/1473724609 wait complete. 2024-05-09T00:15:34.591 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:15:36.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.195+0000 7fb589800640 1 Processor -- start 2024-05-09T00:15:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.196+0000 7fb589800640 1 -- start start 2024-05-09T00:15:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.202+0000 7fb589800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb584155990 0x7fb584158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.202+0000 7fb589800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58415bad0 con 0x7fb5840cbc00 2024-05-09T00:15:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.202+0000 7fb589800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58415bdb0 con 0x7fb5840c8a40 2024-05-09T00:15:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.202+0000 7fb589800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb584159360 con 0x7fb584155990 2024-05-09T00:15:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.204+0000 7fb582000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb584155990 0x7fb584158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.207+0000 7fb582000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb584155990 0x7fb584158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35382/0 (socket says 172.21.15.114:35382) 2024-05-09T00:15:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.207+0000 7fb582000640 1 -- 172.21.15.114:0/3951428128 learned_addr learned my addr 172.21.15.114:0/3951428128 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:37.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.205+0000 7fb583400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb5840cbc00 0x7fb5840cc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53304/0 (socket says 172.21.15.114:53304) 2024-05-09T00:15:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.209+0000 7fb581600640 1 -- 172.21.15.114:0/3951428128 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870466633 0 0) 0x7fb58415bad0 con 0x7fb5840cbc00 2024-05-09T00:15:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.209+0000 7fb581600640 1 -- 172.21.15.114:0/3951428128 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb568003520 con 0x7fb5840cbc00 2024-05-09T00:15:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.209+0000 7fb582000640 1 -- 172.21.15.114:0/3951428128 >> v1:172.21.15.153:6789/0 conn(0x7fb5840c8a40 legacy=0x7fb5840af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.209+0000 7fb582000640 1 -- 172.21.15.114:0/3951428128 >> v1:172.21.15.114:6789/0 conn(0x7fb5840cbc00 legacy=0x7fb5840cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.209+0000 7fb582000640 1 -- 172.21.15.114:0/3951428128 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58415c090 con 0x7fb584155990 2024-05-09T00:15:37.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.214+0000 7fb582000640 1 --2- 172.21.15.114:0/3951428128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb584155990 0x7fb584158e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb570009870 tx=0x7fb57002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3367c8eff7d39d67 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:37.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.215+0000 7fb581600640 1 -- 172.21.15.114:0/3951428128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570037070 con 0x7fb584155990 2024-05-09T00:15:37.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.216+0000 7fb581600640 1 -- 172.21.15.114:0/3951428128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb570032440 con 0x7fb584155990 2024-05-09T00:15:37.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.216+0000 7fb581600640 1 -- 172.21.15.114:0/3951428128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570037070 con 0x7fb584155990 2024-05-09T00:15:37.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.218+0000 7fb589800640 1 -- 172.21.15.114:0/3951428128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb584155990 msgr2=0x7fb584158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.219+0000 7fb589800640 1 --2- 172.21.15.114:0/3951428128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb584155990 0x7fb584158e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb570009870 tx=0x7fb57002a1c0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.221+0000 7fb589800640 1 -- 172.21.15.114:0/3951428128 shutdown_connections 2024-05-09T00:15:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.221+0000 7fb589800640 1 --2- 172.21.15.114:0/3951428128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb584155990 0x7fb584158e20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.221+0000 7fb589800640 1 -- 172.21.15.114:0/3951428128 >> 172.21.15.114:0/3951428128 conn(0x7fb584068fd0 msgr2=0x7fb5840cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.221+0000 7fb589800640 1 -- 172.21.15.114:0/3951428128 shutdown_connections 2024-05-09T00:15:37.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.222+0000 7fb589800640 1 -- 172.21.15.114:0/3951428128 wait complete. 2024-05-09T00:15:37.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.231+0000 7fb589800640 1 Processor -- start 2024-05-09T00:15:37.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.232+0000 7fb589800640 1 -- start start 2024-05-09T00:15:37.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.236+0000 7fb589800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5840c8a40 0x7fb5841ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:37.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.236+0000 7fb589800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 0x7fb5840c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:37.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.237+0000 7fb582a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5840c8a40 0x7fb5841ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:37.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.237+0000 7fb582a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5840c8a40 0x7fb5841ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:36164/0 (socket says 172.21.15.114:36164) 2024-05-09T00:15:37.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.237+0000 7fb589800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584155990 0x7fb5841e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:37.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.238+0000 7fb582000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 0x7fb5840c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:37.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.238+0000 7fb582000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 0x7fb5840c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35394/0 (socket says 172.21.15.114:35394) 2024-05-09T00:15:37.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.238+0000 7fb582a00640 1 -- 172.21.15.114:0/60497848 learned_addr learned my addr 172.21.15.114:0/60497848 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:37.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.238+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb584155da0 con 0x7fb5840cbc00 2024-05-09T00:15:37.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.238+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb58415c650 con 0x7fb584155990 2024-05-09T00:15:37.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.238+0000 7fb583400640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584155990 0x7fb5841e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:37.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.239+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5840af950 con 0x7fb5840c8a40 2024-05-09T00:15:37.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.240+0000 7fb582000640 1 -- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5840c8a40 msgr2=0x7fb5841ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.240+0000 7fb582000640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5840c8a40 0x7fb5841ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.240+0000 7fb582000640 1 -- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584155990 msgr2=0x7fb5841e50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.240+0000 7fb582000640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584155990 0x7fb5841e50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.240+0000 7fb582000640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5840c51b0 con 0x7fb5840cbc00 2024-05-09T00:15:37.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.242+0000 7fb582000640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 0x7fb5840c6250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb58406f4f0 tx=0x7fb5700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:37.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.243+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570041020 con 0x7fb5840cbc00 2024-05-09T00:15:37.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.243+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5700044b0 con 0x7fb5840cbc00 2024-05-09T00:15:37.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.243+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5840c5490 con 0x7fb5840cbc00 2024-05-09T00:15:37.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.244+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570037040 con 0x7fb5840cbc00 2024-05-09T00:15:37.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.247+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5840c5a50 con 0x7fb5840cbc00 2024-05-09T00:15:37.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.249+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb570044020 con 0x7fb5840cbc00 2024-05-09T00:15:37.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.251+0000 7fb57aa00640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb564076350 0x7fb564078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:37.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.252+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7fb5700b7760 con 0x7fb5840cbc00 2024-05-09T00:15:37.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.252+0000 7fb582a00640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb564076350 0x7fb564078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:37.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.253+0000 7fb582a00640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb564076350 0x7fb564078860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb574000f60 tx=0x7fb574009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.263+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb584077430 con 0x7fb5840cbc00 2024-05-09T00:15:37.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.282+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb570080b70 con 0x7fb5840cbc00 2024-05-09T00:15:37.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.941+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb584159140 con 0x7fb5840cbc00 2024-05-09T00:15:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.943+0000 7fb57aa00640 1 -- 172.21.15.114:0/60497848 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7fb570080b70 con 0x7fb5840cbc00 2024-05-09T00:15:37.943 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:37.943 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb564076350 msgr2=0x7fb564078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb564076350 0x7fb564078860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb574000f60 tx=0x7fb574009040 comp rx=0 tx=0).stop 2024-05-09T00:15:37.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 msgr2=0x7fb5840c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:37.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 0x7fb5840c6250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb58406f4f0 tx=0x7fb5700046c0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 shutdown_connections 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb564076350 0x7fb564078860 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584155990 0x7fb5841e50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5840cbc00 0x7fb5840c6250 secure :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb58406f4f0 tx=0x7fb5700046c0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 --2- 172.21.15.114:0/60497848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5840c8a40 0x7fb5841ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.948+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 >> 172.21.15.114:0/60497848 conn(0x7fb584068fd0 msgr2=0x7fb5840cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.949+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 shutdown_connections 2024-05-09T00:15:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:37.949+0000 7fb589800640 1 -- 172.21.15.114:0/60497848 wait complete. 2024-05-09T00:15:38.003 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:15:40.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.536+0000 7f95c2c00640 1 Processor -- start 2024-05-09T00:15:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.537+0000 7f95c2c00640 1 -- start start 2024-05-09T00:15:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.543+0000 7f95c2c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95bc0c7980 0x7f95bc070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:40.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.544+0000 7f95c2c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95bc0710a0 0x7f95bc0c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:40.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.544+0000 7f95c2c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc15a070 con 0x7f95bc153730 2024-05-09T00:15:40.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.545+0000 7f95c2c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f95bc072fd0 con 0x7f95bc0c7980 2024-05-09T00:15:40.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.548+0000 7f95c2c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f95bc0c6060 con 0x7f95bc0710a0 2024-05-09T00:15:40.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.548+0000 7f95bbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95bc0c7980 0x7f95bc070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:40.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.548+0000 7f95bbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95bc0c7980 0x7f95bc070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32784/0 (socket says 172.21.15.114:32784) 2024-05-09T00:15:40.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.548+0000 7f95bbe00640 1 -- 172.21.15.114:0/3120295330 learned_addr learned my addr 172.21.15.114:0/3120295330 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:40.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.548+0000 7f95b3e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f95bc153730 0x7f95bc159570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:49170/0 (socket says 172.21.15.114:49170) 2024-05-09T00:15:40.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.548+0000 7f95c0c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95bc0710a0 0x7f95bc0c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:40.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.553+0000 7f95bb400640 1 -- 172.21.15.114:0/3120295330 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198038909 0 0) 0x7f95bc15a070 con 0x7f95bc153730 2024-05-09T00:15:40.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.553+0000 7f95bb400640 1 -- 172.21.15.114:0/3120295330 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95a0003520 con 0x7f95bc153730 2024-05-09T00:15:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.554+0000 7f95bbe00640 1 -- 172.21.15.114:0/3120295330 >> v2:172.21.15.153:3300/0 conn(0x7f95bc0710a0 msgr2=0x7f95bc0c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.555+0000 7f95bbe00640 1 --2- 172.21.15.114:0/3120295330 >> v2:172.21.15.153:3300/0 conn(0x7f95bc0710a0 0x7f95bc0c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.555+0000 7f95bbe00640 1 -- 172.21.15.114:0/3120295330 >> v1:172.21.15.153:6789/0 conn(0x7f95bc153730 legacy=0x7f95bc159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.555+0000 7f95bbe00640 1 -- 172.21.15.114:0/3120295330 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc15a350 con 0x7f95bc0c7980 2024-05-09T00:15:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.555+0000 7f95c0c00640 1 --2- 172.21.15.114:0/3120295330 >> v2:172.21.15.153:3300/0 conn(0x7f95bc0710a0 0x7f95bc0c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.560+0000 7f95bbe00640 1 --2- 172.21.15.114:0/3120295330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0c7980 0x7f95bc070970 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ab210 tx=0x7f95ac02e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef591e75ca6674c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:40.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.561+0000 7f95bb400640 1 -- 172.21.15.114:0/3120295330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03a070 con 0x7f95bc0c7980 2024-05-09T00:15:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.563+0000 7f95bb400640 1 -- 172.21.15.114:0/3120295330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac00b650 con 0x7f95bc0c7980 2024-05-09T00:15:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.563+0000 7f95bb400640 1 -- 172.21.15.114:0/3120295330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00ba20 con 0x7f95bc0c7980 2024-05-09T00:15:40.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.567+0000 7f95c2c00640 1 -- 172.21.15.114:0/3120295330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0c7980 msgr2=0x7f95bc070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:40.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.567+0000 7f95c2c00640 1 --2- 172.21.15.114:0/3120295330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0c7980 0x7f95bc070970 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ab210 tx=0x7f95ac02e450 comp rx=0 tx=0).stop 2024-05-09T00:15:40.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.571+0000 7f95c2c00640 1 -- 172.21.15.114:0/3120295330 shutdown_connections 2024-05-09T00:15:40.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.571+0000 7f95c2c00640 1 --2- 172.21.15.114:0/3120295330 >> v2:172.21.15.153:3300/0 conn(0x7f95bc0710a0 0x7f95bc0c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:40.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.571+0000 7f95c2c00640 1 --2- 172.21.15.114:0/3120295330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0c7980 0x7f95bc070970 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:40.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.571+0000 7f95c2c00640 1 -- 172.21.15.114:0/3120295330 >> 172.21.15.114:0/3120295330 conn(0x7f95bc0cbb70 msgr2=0x7f95bc0ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:40.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.572+0000 7f95c2c00640 1 -- 172.21.15.114:0/3120295330 shutdown_connections 2024-05-09T00:15:40.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.572+0000 7f95c2c00640 1 -- 172.21.15.114:0/3120295330 wait complete. 2024-05-09T00:15:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.576+0000 7f95c2c00640 1 Processor -- start 2024-05-09T00:15:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.576+0000 7f95c2c00640 1 -- start start 2024-05-09T00:15:40.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.579+0000 7f95c2c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 0x7f95bc152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:40.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.580+0000 7f95c2c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc0c7980 0x7f95bc0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:40.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.580+0000 7f95c2c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc153730 0x7f95bc1e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:40.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.580+0000 7f95c2c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc159c80 con 0x7f95bc0710a0 2024-05-09T00:15:40.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.580+0000 7f95c2c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc072cf0 con 0x7f95bc0c7980 2024-05-09T00:15:40.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.580+0000 7f95c2c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc159e00 con 0x7f95bc153730 2024-05-09T00:15:40.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.581+0000 7f95bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 0x7f95bc152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:40.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.581+0000 7f95bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 0x7f95bc152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32786/0 (socket says 172.21.15.114:32786) 2024-05-09T00:15:40.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.581+0000 7f95bbe00640 1 -- 172.21.15.114:0/2889450534 learned_addr learned my addr 172.21.15.114:0/2889450534 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.581+0000 7f95c0c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc153730 0x7f95bc1e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95bbe00640 1 -- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc153730 msgr2=0x7f95bc1e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95bbe00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc153730 0x7f95bc1e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95bbe00640 1 -- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc0c7980 msgr2=0x7f95bc0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95b3e00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc0c7980 0x7f95bc0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95bbe00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc0c7980 0x7f95bc0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95bbe00640 1 -- 172.21.15.114:0/2889450534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc156e30 con 0x7f95bc0710a0 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95b3e00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc0c7980 0x7f95bc0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.582+0000 7f95bbe00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 0x7f95bc152ae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95ac02ea40 tx=0x7f95ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.583+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03a040 con 0x7f95bc0710a0 2024-05-09T00:15:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.583+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc1edb00 con 0x7f95bc0710a0 2024-05-09T00:15:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.583+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc156b50 con 0x7f95bc0710a0 2024-05-09T00:15:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.583+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac044070 con 0x7f95bc0710a0 2024-05-09T00:15:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.583+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03f810 con 0x7f95bc0710a0 2024-05-09T00:15:40.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.587+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc077430 con 0x7f95bc0710a0 2024-05-09T00:15:40.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.588+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f95ac03f9b0 con 0x7f95bc0710a0 2024-05-09T00:15:40.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.589+0000 7f95b8c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9598076300 0x7f9598078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:40.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.589+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f95ac0bc220 con 0x7f95bc0710a0 2024-05-09T00:15:40.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.594+0000 7f95b3e00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9598076300 0x7f9598078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:40.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.601+0000 7f95b3e00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9598076300 0x7f9598078810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0c5650 tx=0x7f95a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:40.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:40.607+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f95ac085530 con 0x7f95bc0710a0 2024-05-09T00:15:41.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.161+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95bc0b1250 con 0x7f95bc0710a0 2024-05-09T00:15:41.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.163+0000 7f95b8c00640 1 -- 172.21.15.114:0/2889450534 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7f95ac084e30 con 0x7f95bc0710a0 2024-05-09T00:15:41.162 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:41.162 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:41.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.167+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9598076300 msgr2=0x7f9598078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:41.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.167+0000 7f95c2c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9598076300 0x7f9598078810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0c5650 tx=0x7f95a4009040 comp rx=0 tx=0).stop 2024-05-09T00:15:41.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.167+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 msgr2=0x7f95bc152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:41.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.167+0000 7f95c2c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 0x7f95bc152ae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95ac02ea40 tx=0x7f95ac0046c0 comp rx=0 tx=0).stop 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.168+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 shutdown_connections 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.168+0000 7f95c2c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9598076300 0x7f9598078810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.168+0000 7f95c2c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95bc153730 0x7f95bc1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.168+0000 7f95c2c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc0c7980 0x7f95bc0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.168+0000 7f95c2c00640 1 --2- 172.21.15.114:0/2889450534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95bc0710a0 0x7f95bc152ae0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.168+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 >> 172.21.15.114:0/2889450534 conn(0x7f95bc0cbb70 msgr2=0x7f95bc0c7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.169+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 shutdown_connections 2024-05-09T00:15:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:41.169+0000 7f95c2c00640 1 -- 172.21.15.114:0/2889450534 wait complete. 2024-05-09T00:15:41.223 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:15:43.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:43.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.742+0000 7f3900e00640 1 Processor -- start 2024-05-09T00:15:43.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.744+0000 7f3900e00640 1 -- start start 2024-05-09T00:15:43.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.750+0000 7f3900e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f38fc072d50 0x7f38fc0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f3900e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc160600 0x7f38fc0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f3900e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38fc0c4ca0 con 0x7f38fc072890 2024-05-09T00:15:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f3900e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f38fc160170 con 0x7f38fc072d50 2024-05-09T00:15:43.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f3900e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc15fe20 con 0x7f38fc160600 2024-05-09T00:15:43.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f38f9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f38fc072d50 0x7f38fc0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:43.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f38f9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f38fc072d50 0x7f38fc0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:34522/0 (socket says 172.21.15.114:34522) 2024-05-09T00:15:43.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f38f9e00640 1 -- 172.21.15.114:0/2174467752 learned_addr learned my addr 172.21.15.114:0/2174467752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:43.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.751+0000 7f38fa800640 1 --2- 172.21.15.114:0/2174467752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc160600 0x7f38fc0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:43.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.753+0000 7f38f8a00640 1 -- 172.21.15.114:0/2174467752 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832894467 0 0) 0x7f38fc0c4ca0 con 0x7f38fc072890 2024-05-09T00:15:43.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.753+0000 7f38fa800640 1 -- 172.21.15.114:0/2174467752 >> v2:172.21.15.153:3300/0 conn(0x7f38fc072d50 msgr2=0x7f38fc0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:43.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.753+0000 7f38fa800640 1 --2- 172.21.15.114:0/2174467752 >> v2:172.21.15.153:3300/0 conn(0x7f38fc072d50 0x7f38fc0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:43.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.753+0000 7f38fa800640 1 -- 172.21.15.114:0/2174467752 >> v1:172.21.15.114:6789/0 conn(0x7f38fc072890 legacy=0x7f38fc159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:43.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.753+0000 7f38fa800640 1 -- 172.21.15.114:0/2174467752 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc15d1b0 con 0x7f38fc160600 2024-05-09T00:15:43.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.758+0000 7f38fa800640 1 --2- 172.21.15.114:0/2174467752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc160600 0x7f38fc0c6050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009d90 tx=0x7f38f402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2553c5ae285fd7e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.761+0000 7f38f8a00640 1 -- 172.21.15.114:0/2174467752 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4007740 con 0x7f38fc160600 2024-05-09T00:15:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.761+0000 7f38f8a00640 1 -- 172.21.15.114:0/2174467752 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40078e0 con 0x7f38fc160600 2024-05-09T00:15:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.761+0000 7f38f8a00640 1 -- 172.21.15.114:0/2174467752 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4007cb0 con 0x7f38fc160600 2024-05-09T00:15:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.762+0000 7f3900e00640 1 -- 172.21.15.114:0/2174467752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc160600 msgr2=0x7f38fc0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:43.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.762+0000 7f3900e00640 1 --2- 172.21.15.114:0/2174467752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc160600 0x7f38fc0c6050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009d90 tx=0x7f38f402a5f0 comp rx=0 tx=0).stop 2024-05-09T00:15:43.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.763+0000 7f3900e00640 1 -- 172.21.15.114:0/2174467752 shutdown_connections 2024-05-09T00:15:43.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.763+0000 7f3900e00640 1 --2- 172.21.15.114:0/2174467752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc160600 0x7f38fc0c6050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:43.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.763+0000 7f3900e00640 1 --2- 172.21.15.114:0/2174467752 >> v2:172.21.15.153:3300/0 conn(0x7f38fc072d50 0x7f38fc0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:43.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.763+0000 7f3900e00640 1 -- 172.21.15.114:0/2174467752 >> 172.21.15.114:0/2174467752 conn(0x7f38fc06c680 msgr2=0x7f38fc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:43.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.764+0000 7f3900e00640 1 -- 172.21.15.114:0/2174467752 shutdown_connections 2024-05-09T00:15:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.764+0000 7f3900e00640 1 -- 172.21.15.114:0/2174467752 wait complete. 2024-05-09T00:15:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.768+0000 7f3900e00640 1 Processor -- start 2024-05-09T00:15:43.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.768+0000 7f3900e00640 1 -- start start 2024-05-09T00:15:43.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.771+0000 7f3900e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc072890 0x7f38fc1fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:43.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.771+0000 7f3900e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc072d50 0x7f38fc06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:43.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.771+0000 7f3900e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc160600 0x7f38fc151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:43.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.771+0000 7f38f9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc072890 0x7f38fc1fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:43.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.772+0000 7f38f9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc072890 0x7f38fc1fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43588/0 (socket says 172.21.15.114:43588) 2024-05-09T00:15:43.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.772+0000 7f38f9e00640 1 -- 172.21.15.114:0/3954503020 learned_addr learned my addr 172.21.15.114:0/3954503020 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:43.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.772+0000 7f3900e00640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc160a10 con 0x7f38fc072d50 2024-05-09T00:15:43.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.772+0000 7f3900e00640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0c42e0 con 0x7f38fc160600 2024-05-09T00:15:43.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.772+0000 7f3900e00640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc160b90 con 0x7f38fc072890 2024-05-09T00:15:43.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.772+0000 7f38f9400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc072d50 0x7f38fc06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.773+0000 7f38f9400640 1 -- 172.21.15.114:0/3954503020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc072890 msgr2=0x7f38fc1fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.773+0000 7f38f9400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc072890 0x7f38fc1fedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.774+0000 7f38f9400640 1 -- 172.21.15.114:0/3954503020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc160600 msgr2=0x7f38fc151bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:15:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.774+0000 7f38f9400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc160600 0x7f38fc151bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.774+0000 7f38f9400640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc1fbaf0 con 0x7f38fc072d50 2024-05-09T00:15:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.774+0000 7f38f9400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc072d50 0x7f38fc06fa00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c390 tx=0x7f38ec00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.775+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec017070 con 0x7f38fc072d50 2024-05-09T00:15:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.775+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ec0052d0 con 0x7f38fc072d50 2024-05-09T00:15:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.775+0000 7f3900e00640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc1fe5f0 con 0x7f38fc072d50 2024-05-09T00:15:43.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.775+0000 7f3900e00640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc1ff330 con 0x7f38fc072d50 2024-05-09T00:15:43.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.779+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec011890 con 0x7f38fc072d50 2024-05-09T00:15:43.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.779+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d4005290 con 0x7f38fc072d50 2024-05-09T00:15:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.783+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38ec01a070 con 0x7f38fc072d50 2024-05-09T00:15:43.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.785+0000 7f38f2000640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38dc0762d0 0x7f38dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:43.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.786+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7182+0+0 (secure 0 0 0) 0x7f38ec097130 con 0x7f38fc072d50 2024-05-09T00:15:43.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.787+0000 7f38f9e00640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38dc0762d0 0x7f38dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:43.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.788+0000 7f38f9e00640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38dc0762d0 0x7f38dc0787e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009bb0 tx=0x7f38e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:43.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:43.790+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f38ec021020 con 0x7f38fc072d50 2024-05-09T00:15:44.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.288+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38d4005580 con 0x7f38fc072d50 2024-05-09T00:15:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.294+0000 7f38f2000640 1 -- 172.21.15.114:0/3954503020 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6497 (secure 0 0 0) 0x7f38ec060640 con 0x7f38fc072d50 2024-05-09T00:15:44.294 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:44.296 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":4960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:14:26.367799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4819":{"gid":4819,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/4100525107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4100525107},{"type":"v1","addr":"172.21.15.153:6835","nonce":4100525107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4819,"qdb_cluster":[4819]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-05-09T00:15:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.298+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38dc0762d0 msgr2=0x7f38dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:44.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.298+0000 7f38e7400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38dc0762d0 0x7f38dc0787e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009bb0 tx=0x7f38e8008040 comp rx=0 tx=0).stop 2024-05-09T00:15:44.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.298+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc072d50 msgr2=0x7f38fc06fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:44.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.298+0000 7f38e7400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc072d50 0x7f38fc06fa00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c390 tx=0x7f38ec00c790 comp rx=0 tx=0).stop 2024-05-09T00:15:44.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.299+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 shutdown_connections 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.299+0000 7f38e7400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f38dc0762d0 0x7f38dc0787e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.299+0000 7f38e7400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38fc160600 0x7f38fc151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.299+0000 7f38e7400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38fc072d50 0x7f38fc06fa00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.299+0000 7f38e7400640 1 --2- 172.21.15.114:0/3954503020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38fc072890 0x7f38fc1fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.299+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 >> 172.21.15.114:0/3954503020 conn(0x7f38fc06c680 msgr2=0x7f38fc15bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.300+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 shutdown_connections 2024-05-09T00:15:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:44.300+0000 7f38e7400640 1 -- 172.21.15.114:0/3954503020 wait complete. 2024-05-09T00:15:44.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:15:44.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:15:44.363 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:15:46.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:46.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.870+0000 7f849aa00640 1 Processor -- start 2024-05-09T00:15:46.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.871+0000 7f849aa00640 1 -- start start 2024-05-09T00:15:46.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.875+0000 7f849aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84940730f0 0x7f8494151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:46.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.875+0000 7f849aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8494151d60 0x7f8494157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:46.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.875+0000 7f849aa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84940c4880 con 0x7f84940c5bb0 2024-05-09T00:15:46.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.875+0000 7f849aa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8494073500 con 0x7f84940730f0 2024-05-09T00:15:46.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.875+0000 7f849aa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8494073730 con 0x7f8494151d60 2024-05-09T00:15:46.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.876+0000 7f8493e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f84940c5bb0 0x7f84940c62d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:49186/0 (socket says 172.21.15.114:49186) 2024-05-09T00:15:46.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.876+0000 7f8493e00640 1 -- 172.21.15.114:0/1651882053 learned_addr learned my addr 172.21.15.114:0/1651882053 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:15:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.877+0000 7f8492a00640 1 -- 172.21.15.114:0/1651882053 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847621590 0 0) 0x7f84940c4880 con 0x7f84940c5bb0 2024-05-09T00:15:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.877+0000 7f8492a00640 1 -- 172.21.15.114:0/1651882053 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8478003520 con 0x7f84940c5bb0 2024-05-09T00:15:46.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.878+0000 7f8493400640 1 --2- 172.21.15.114:0/1651882053 >> v2:172.21.15.114:3300/0 conn(0x7f84940730f0 0x7f8494151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:46.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.880+0000 7f8493400640 1 -- 172.21.15.114:0/1651882053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8494151d60 msgr2=0x7f8494157c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:15:46.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.880+0000 7f8493400640 1 --2- 172.21.15.114:0/1651882053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8494151d60 0x7f8494157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:46.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.880+0000 7f8493400640 1 -- 172.21.15.114:0/1651882053 >> v1:172.21.15.153:6789/0 conn(0x7f84940c5bb0 legacy=0x7f84940c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:46.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.880+0000 7f8493400640 1 -- 172.21.15.114:0/1651882053 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84940c4b60 con 0x7f84940730f0 2024-05-09T00:15:46.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.886+0000 7f8493400640 1 --2- 172.21.15.114:0/1651882053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84940730f0 0x7f8494151820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f848c009c80 tx=0x7f848c02ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78faac3b3e9b06b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:46.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.888+0000 7f8492a00640 1 -- 172.21.15.114:0/1651882053 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c037070 con 0x7f84940730f0 2024-05-09T00:15:46.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.890+0000 7f8492a00640 1 -- 172.21.15.114:0/1651882053 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c033870 con 0x7f84940730f0 2024-05-09T00:15:46.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.890+0000 7f8492a00640 1 -- 172.21.15.114:0/1651882053 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c037070 con 0x7f84940730f0 2024-05-09T00:15:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.895+0000 7f849aa00640 1 -- 172.21.15.114:0/1651882053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84940730f0 msgr2=0x7f8494151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.895+0000 7f849aa00640 1 --2- 172.21.15.114:0/1651882053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84940730f0 0x7f8494151820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f848c009c80 tx=0x7f848c02ea10 comp rx=0 tx=0).stop 2024-05-09T00:15:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.895+0000 7f849aa00640 1 -- 172.21.15.114:0/1651882053 shutdown_connections 2024-05-09T00:15:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.895+0000 7f849aa00640 1 --2- 172.21.15.114:0/1651882053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8494151d60 0x7f8494157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.899+0000 7f849aa00640 1 --2- 172.21.15.114:0/1651882053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84940730f0 0x7f8494151820 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.899+0000 7f849aa00640 1 -- 172.21.15.114:0/1651882053 >> 172.21.15.114:0/1651882053 conn(0x7f849406c680 msgr2=0x7f849406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:46.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.914+0000 7f849aa00640 1 -- 172.21.15.114:0/1651882053 shutdown_connections 2024-05-09T00:15:46.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.915+0000 7f849aa00640 1 -- 172.21.15.114:0/1651882053 wait complete. 2024-05-09T00:15:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.922+0000 7f849aa00640 1 Processor -- start 2024-05-09T00:15:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.922+0000 7f849aa00640 1 -- start start 2024-05-09T00:15:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.924+0000 7f849aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84940730f0 0x7f8494156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.924+0000 7f849aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84940c5bb0 0x7f84941f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.924+0000 7f849aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 0x7f8494146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.924+0000 7f849aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f84940af6c0 con 0x7f8494151d60 2024-05-09T00:15:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.924+0000 7f849aa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f84940c5120 con 0x7f84940730f0 2024-05-09T00:15:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.924+0000 7f849aa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f84940af840 con 0x7f84940c5bb0 2024-05-09T00:15:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.925+0000 7f8498a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 0x7f8494146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.925+0000 7f8498a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 0x7f8494146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32824/0 (socket says 172.21.15.114:32824) 2024-05-09T00:15:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.925+0000 7f8498a00640 1 -- 172.21.15.114:0/2806296085 learned_addr learned my addr 172.21.15.114:0/2806296085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.926+0000 7f8493400640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84940c5bb0 0x7f84941f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.926+0000 7f8493e00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84940730f0 0x7f8494156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.927+0000 7f8498a00640 1 -- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84940c5bb0 msgr2=0x7f84941f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.927+0000 7f8498a00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84940c5bb0 0x7f84941f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.927+0000 7f8498a00640 1 -- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84940730f0 msgr2=0x7f8494156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.927+0000 7f8498a00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84940730f0 0x7f8494156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.927+0000 7f8498a00640 1 -- 172.21.15.114:0/2806296085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84941502b0 con 0x7f8494151d60 2024-05-09T00:15:46.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.932+0000 7f8498a00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 0x7f8494146580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f848000b4c0 tx=0x7f848000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:46.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.932+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480015020 con 0x7f8494151d60 2024-05-09T00:15:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.939+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8494150590 con 0x7f8494151d60 2024-05-09T00:15:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.939+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480011850 con 0x7f8494151d60 2024-05-09T00:15:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.945+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849414f510 con 0x7f8494151d60 2024-05-09T00:15:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.939+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480011c40 con 0x7f8494151d60 2024-05-09T00:15:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.955+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8494077430 con 0x7f8494151d60 2024-05-09T00:15:46.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.957+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8480018020 con 0x7f8494151d60 2024-05-09T00:15:46.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.962+0000 7f848be00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f84740762d0 0x7f84740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:46.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.963+0000 7f8493e00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f84740762d0 0x7f84740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:46.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.968+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f8480094dd0 con 0x7f8494151d60 2024-05-09T00:15:46.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.970+0000 7f8493e00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f84740762d0 0x7f84740787e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8484005880 tx=0x7f8484006aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:46.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:46.992+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f848009a070 con 0x7f8494151d60 2024-05-09T00:15:47.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.550+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8494153850 con 0x7f8494151d60 2024-05-09T00:15:47.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.553+0000 7f848be00640 1 -- 172.21.15.114:0/2806296085 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5661 (secure 0 0 0) 0x7f8480060070 con 0x7f8494151d60 2024-05-09T00:15:47.555 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:47.556 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:44.956859+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:47.556 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 43 2024-05-09T00:15:47.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.561+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f84740762d0 msgr2=0x7f84740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:47.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.561+0000 7f849aa00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f84740762d0 0x7f84740787e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8484005880 tx=0x7f8484006aa0 comp rx=0 tx=0).stop 2024-05-09T00:15:47.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.561+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 msgr2=0x7f8494146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:47.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.561+0000 7f849aa00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 0x7f8494146580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f848000b4c0 tx=0x7f848000b980 comp rx=0 tx=0).stop 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 shutdown_connections 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f84740762d0 0x7f84740787e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8494151d60 0x7f8494146580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84940c5bb0 0x7f84941f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 --2- 172.21.15.114:0/2806296085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84940730f0 0x7f8494156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 >> 172.21.15.114:0/2806296085 conn(0x7f849406c680 msgr2=0x7f849406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.562+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 shutdown_connections 2024-05-09T00:15:47.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:47.563+0000 7f849aa00640 1 -- 172.21.15.114:0/2806296085 wait complete. 2024-05-09T00:15:47.628 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-05-09T00:15:47.628 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T00:15:47.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:48.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.178+0000 7fcfcfc00640 1 Processor -- start 2024-05-09T00:15:48.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.178+0000 7fcfcfc00640 1 -- start start 2024-05-09T00:15:48.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.184+0000 7fcfcfc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:48.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.185+0000 7fcfcfc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcfc80ca110 0x7fcfc80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:48.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.185+0000 7fcfcfc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc80c49b0 con 0x7fcfc8154c20 2024-05-09T00:15:48.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.185+0000 7fcfcfc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc8155190 con 0x7fcfc80ca110 2024-05-09T00:15:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.185+0000 7fcfcfc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc80af800 con 0x7fcfc8157770 2024-05-09T00:15:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.186+0000 7fcfcd200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.186+0000 7fcfce600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcfc80ca110 0x7fcfc80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.187+0000 7fcfce600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcfc80ca110 0x7fcfc80af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49900/0 (socket says 172.21.15.114:49900) 2024-05-09T00:15:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.187+0000 7fcfce600640 1 -- 172.21.15.114:0/2359509317 learned_addr learned my addr 172.21.15.114:0/2359509317 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.191+0000 7fcfce600640 1 -- 172.21.15.114:0/2359509317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 msgr2=0x7fcfc8072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.191+0000 7fcfce600640 1 --2- 172.21.15.114:0/2359509317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.191+0000 7fcfce600640 1 -- 172.21.15.114:0/2359509317 >> v1:172.21.15.153:6789/0 conn(0x7fcfc8154c20 legacy=0x7fcfc80c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.191+0000 7fcfce600640 1 -- 172.21.15.114:0/2359509317 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc8073110 con 0x7fcfc80ca110 2024-05-09T00:15:48.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.201+0000 7fcfce600640 1 --2- 172.21.15.114:0/2359509317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc80ca110 0x7fcfc80af2c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009e50 tx=0x7fcfc002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8cc6943e5079f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:48.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.202+0000 7fcfc7400640 1 -- 172.21.15.114:0/2359509317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0036070 con 0x7fcfc80ca110 2024-05-09T00:15:48.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.203+0000 7fcfc7400640 1 -- 172.21.15.114:0/2359509317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0031600 con 0x7fcfc80ca110 2024-05-09T00:15:48.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.203+0000 7fcfc7400640 1 -- 172.21.15.114:0/2359509317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0031a10 con 0x7fcfc80ca110 2024-05-09T00:15:48.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.206+0000 7fcfcfc00640 1 -- 172.21.15.114:0/2359509317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc80ca110 msgr2=0x7fcfc80af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:48.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.206+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/2359509317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc80ca110 0x7fcfc80af2c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009e50 tx=0x7fcfc002a6a0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.207+0000 7fcfcfc00640 1 -- 172.21.15.114:0/2359509317 shutdown_connections 2024-05-09T00:15:48.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.207+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/2359509317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc80ca110 0x7fcfc80af2c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.207+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/2359509317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.207+0000 7fcfcfc00640 1 -- 172.21.15.114:0/2359509317 >> 172.21.15.114:0/2359509317 conn(0x7fcfc80c95f0 msgr2=0x7fcfc80c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:48.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.208+0000 7fcfcfc00640 1 -- 172.21.15.114:0/2359509317 shutdown_connections 2024-05-09T00:15:48.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.208+0000 7fcfcfc00640 1 -- 172.21.15.114:0/2359509317 wait complete. 2024-05-09T00:15:48.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.218+0000 7fcfcfc00640 1 Processor -- start 2024-05-09T00:15:48.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.219+0000 7fcfcfc00640 1 -- start start 2024-05-09T00:15:48.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.227+0000 7fcfcfc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfc80ca110 0x7fcfc8152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:48.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.228+0000 7fcfcfc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc8154c20 0x7fcfc8148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:48.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.229+0000 7fcfcfc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:48.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfcfc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80c5c90 con 0x7fcfc8154c20 2024-05-09T00:15:48.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfcfc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80c4c50 con 0x7fcfc80ca110 2024-05-09T00:15:48.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfcfc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc8072be0 con 0x7fcfc8157770 2024-05-09T00:15:48.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfcd200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfc80ca110 0x7fcfc8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:48.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfce600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:48.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfce600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:53496/0 (socket says 172.21.15.114:53496) 2024-05-09T00:15:48.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.231+0000 7fcfce600640 1 -- 172.21.15.114:0/297838536 learned_addr learned my addr 172.21.15.114:0/297838536 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:48.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.232+0000 7fcfc7e00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc8154c20 0x7fcfc8148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.233+0000 7fcfce600640 1 -- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfc80ca110 msgr2=0x7fcfc8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.233+0000 7fcfce600640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfc80ca110 0x7fcfc8152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.233+0000 7fcfce600640 1 -- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc8154c20 msgr2=0x7fcfc8148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.233+0000 7fcfce600640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc8154c20 0x7fcfc8148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.233+0000 7fcfce600640 1 -- 172.21.15.114:0/297838536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc81479c0 con 0x7fcfc8157770 2024-05-09T00:15:48.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.234+0000 7fcfce600640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8148590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0034040 tx=0x7fcfc0004a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:48.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.235+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0036050 con 0x7fcfc8157770 2024-05-09T00:15:48.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.237+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc8145100 con 0x7fcfc8157770 2024-05-09T00:15:48.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.237+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc8152190 con 0x7fcfc8157770 2024-05-09T00:15:48.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.240+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0042070 con 0x7fcfc8157770 2024-05-09T00:15:48.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.240+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0009510 con 0x7fcfc8157770 2024-05-09T00:15:48.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.244+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc81fe470 con 0x7fcfc8157770 2024-05-09T00:15:48.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.249+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcfc0007bf0 con 0x7fcfc8157770 2024-05-09T00:15:48.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.252+0000 7fcfc4c00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcfa8076300 0x7fcfa8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:48.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.252+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7fcfc00b8310 con 0x7fcfc8157770 2024-05-09T00:15:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.253+0000 7fcfcd200640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcfa8076300 0x7fcfa8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.254+0000 7fcfcd200640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcfa8076300 0x7fcfa8078810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8071e00 tx=0x7fcfbc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:48.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.262+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcfc81fe470 con 0x7fcfc8157770 2024-05-09T00:15:48.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.871+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfc8077430 con 0x7fcfc8157770 2024-05-09T00:15:48.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.874+0000 7fcfc4c00640 1 -- 172.21.15.114:0/297838536 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5661 (secure 0 0 0) 0x7fcfc004b020 con 0x7fcfc8157770 2024-05-09T00:15:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:48.878 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:44.956859+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 43 2024-05-09T00:15:48.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.889+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcfa8076300 msgr2=0x7fcfa8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.889+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcfa8076300 0x7fcfa8078810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8071e00 tx=0x7fcfbc009190 comp rx=0 tx=0).stop 2024-05-09T00:15:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 msgr2=0x7fcfc8148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8148590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0034040 tx=0x7fcfc0004a70 comp rx=0 tx=0).stop 2024-05-09T00:15:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 shutdown_connections 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcfa8076300 0x7fcfa8078810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfc8157770 0x7fcfc8148590 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc8154c20 0x7fcfc8148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 --2- 172.21.15.114:0/297838536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfc80ca110 0x7fcfc8152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 >> 172.21.15.114:0/297838536 conn(0x7fcfc80c95f0 msgr2=0x7fcfc80c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 shutdown_connections 2024-05-09T00:15:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:48.890+0000 7fcfcfc00640 1 -- 172.21.15.114:0/297838536 wait complete. 2024-05-09T00:15:48.954 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 43, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 43, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4960": { "addr": "172.21.15.114:6836/281438172", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 281438172, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 281438172, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4960, "incarnation": 43, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:15:44.956859+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4960 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 41, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4888": { "addr": "172.21.15.114:6837/372512194", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 372512194, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 372512194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4888, "incarnation": 38, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:15:12.953509+0000", "qdb_cluster": [ 4888 ], "qdb_leader": 4888, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4888 } } } ], "standbys": [ { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 31, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:15:50.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:51.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.477+0000 7f2df3000640 1 Processor -- start 2024-05-09T00:15:51.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.477+0000 7f2df3000640 1 -- start start 2024-05-09T00:15:51.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.480+0000 7f2df3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2de4042fb0 0x7f2de40075d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.480+0000 7f2df3000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2de4033260 0x7f2de4033670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.480+0000 7f2df3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4033bb0 0x7f2de404e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.481+0000 7f2df3000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2de4042a80 con 0x7f2de4033260 2024-05-09T00:15:51.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.481+0000 7f2df3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2de404b130 con 0x7f2de4042fb0 2024-05-09T00:15:51.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.481+0000 7f2df3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2de4035960 con 0x7f2de4033bb0 2024-05-09T00:15:51.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.481+0000 7f2debe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2de4042fb0 0x7f2de40075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.481+0000 7f2df1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4033bb0 0x7f2de404e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.482+0000 7f2df1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4033bb0 0x7f2de404e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:53498/0 (socket says 172.21.15.114:53498) 2024-05-09T00:15:51.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.482+0000 7f2df1000640 1 -- 172.21.15.114:0/120718660 learned_addr learned my addr 172.21.15.114:0/120718660 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:51.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.482+0000 7f2deb400640 1 --2- 172.21.15.114:0/120718660 >> v2:172.21.15.114:3300/0 conn(0x7f2de4033260 0x7f2de4033670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.483+0000 7f2deb400640 1 -- 172.21.15.114:0/120718660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4033bb0 msgr2=0x7f2de404e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:51.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.483+0000 7f2deb400640 1 --2- 172.21.15.114:0/120718660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4033bb0 0x7f2de404e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.483+0000 7f2deb400640 1 -- 172.21.15.114:0/120718660 >> v2:172.21.15.153:3300/0 conn(0x7f2de4042fb0 msgr2=0x7f2de40075d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:51.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.483+0000 7f2deb400640 1 --2- 172.21.15.114:0/120718660 >> v2:172.21.15.153:3300/0 conn(0x7f2de4042fb0 0x7f2de40075d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.483+0000 7f2deb400640 1 -- 172.21.15.114:0/120718660 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de4042cd0 con 0x7f2de4033260 2024-05-09T00:15:51.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.485+0000 7f2deb400640 1 --2- 172.21.15.114:0/120718660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033260 0x7f2de4033670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2de4035ae0 tx=0x7f2dd802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae92f477a9a949b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.486+0000 7f2deaa00640 1 -- 172.21.15.114:0/120718660 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8037070 con 0x7f2de4033260 2024-05-09T00:15:51.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.487+0000 7f2deaa00640 1 -- 172.21.15.114:0/120718660 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd802ae40 con 0x7f2de4033260 2024-05-09T00:15:51.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.487+0000 7f2deaa00640 1 -- 172.21.15.114:0/120718660 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8032660 con 0x7f2de4033260 2024-05-09T00:15:51.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.488+0000 7f2df3000640 1 -- 172.21.15.114:0/120718660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033260 msgr2=0x7f2de4033670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.488+0000 7f2df3000640 1 --2- 172.21.15.114:0/120718660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033260 0x7f2de4033670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2de4035ae0 tx=0x7f2dd802a0f0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.489+0000 7f2df3000640 1 -- 172.21.15.114:0/120718660 shutdown_connections 2024-05-09T00:15:51.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.489+0000 7f2df3000640 1 --2- 172.21.15.114:0/120718660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4033bb0 0x7f2de404e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.489+0000 7f2df3000640 1 --2- 172.21.15.114:0/120718660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033260 0x7f2de4033670 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.489+0000 7f2df3000640 1 --2- 172.21.15.114:0/120718660 >> v2:172.21.15.153:3300/0 conn(0x7f2de4042fb0 0x7f2de40075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.489+0000 7f2df3000640 1 -- 172.21.15.114:0/120718660 >> 172.21.15.114:0/120718660 conn(0x7f2de404c850 msgr2=0x7f2de404cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:51.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.490+0000 7f2df3000640 1 -- 172.21.15.114:0/120718660 shutdown_connections 2024-05-09T00:15:51.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.490+0000 7f2df3000640 1 -- 172.21.15.114:0/120718660 wait complete. 2024-05-09T00:15:51.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.494+0000 7f2df3000640 1 Processor -- start 2024-05-09T00:15:51.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.494+0000 7f2df3000640 1 -- start start 2024-05-09T00:15:51.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.500+0000 7f2df3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 0x7f2de4042230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.500+0000 7f2df3000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033bb0 0x7f2de4165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.500+0000 7f2debe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 0x7f2de4042230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.500+0000 7f2debe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 0x7f2de4042230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:33544/0 (socket says 172.21.15.114:33544) 2024-05-09T00:15:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.500+0000 7f2debe00640 1 -- 172.21.15.114:0/919551321 learned_addr learned my addr 172.21.15.114:0/919551321 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:15:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.501+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4042fb0 0x7f2de400daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.501+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2de404a750 con 0x7f2de4033bb0 2024-05-09T00:15:51.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.501+0000 7f2deb400640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033bb0 0x7f2de4165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.502+0000 7f2df1000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4042fb0 0x7f2de400daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.502+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4035bb0 con 0x7f2de4033260 2024-05-09T00:15:51.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.502+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2de404c4f0 con 0x7f2de4042fb0 2024-05-09T00:15:51.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.504+0000 7f2deb400640 1 -- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4042fb0 msgr2=0x7f2de400daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.504+0000 7f2deb400640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4042fb0 0x7f2de400daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.504+0000 7f2deb400640 1 -- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 msgr2=0x7f2de4042230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.504+0000 7f2deb400640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 0x7f2de4042230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.504+0000 7f2deb400640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de400aa30 con 0x7f2de4033bb0 2024-05-09T00:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.505+0000 7f2debe00640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 0x7f2de4042230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.506+0000 7f2deb400640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033bb0 0x7f2de4165690 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8031000 tx=0x7f2dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.506+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8041020 con 0x7f2de4033bb0 2024-05-09T00:15:51.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.507+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd803d690 con 0x7f2de4033bb0 2024-05-09T00:15:51.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.507+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de4042770 con 0x7f2de4033bb0 2024-05-09T00:15:51.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.507+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de40412c0 con 0x7f2de4033bb0 2024-05-09T00:15:51.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.515+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8037040 con 0x7f2de4033bb0 2024-05-09T00:15:51.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.519+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc8005290 con 0x7f2de4033bb0 2024-05-09T00:15:51.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.519+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2dd8044020 con 0x7f2de4033bb0 2024-05-09T00:15:51.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.521+0000 7f2ddfe00640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2dcc076320 0x7f2dcc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:51.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.523+0000 7f2debe00640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2dcc076320 0x7f2dcc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.524+0000 7f2debe00640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2dcc076320 0x7f2dcc078830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2de0006a90 tx=0x7f2de0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.525+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f2dd807cf80 con 0x7f2de4033bb0 2024-05-09T00:15:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:51.547+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2de400aa30 con 0x7f2de4033bb0 2024-05-09T00:15:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.146+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dc8005850 con 0x7f2de4033bb0 2024-05-09T00:15:52.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.149+0000 7f2ddfe00640 1 -- 172.21.15.114:0/919551321 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5669 (secure 0 0 0) 0x7f2dd8081090 con 0x7f2de4033bb0 2024-05-09T00:15:52.151 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:15:52.151 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:15:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2024-05-09T00:15:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.154+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2dcc076320 msgr2=0x7f2dcc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.154+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2dcc076320 0x7f2dcc078830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2de0006a90 tx=0x7f2de0008040 comp rx=0 tx=0).stop 2024-05-09T00:15:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.155+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033bb0 msgr2=0x7f2de4165690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.155+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033bb0 0x7f2de4165690 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8031000 tx=0x7f2dd80046c0 comp rx=0 tx=0).stop 2024-05-09T00:15:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.156+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 shutdown_connections 2024-05-09T00:15:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.156+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2dcc076320 0x7f2dcc078830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.156+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2de4042fb0 0x7f2de400daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.157+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2de4033bb0 0x7f2de4165690 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.157+0000 7f2df3000640 1 --2- 172.21.15.114:0/919551321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de4033260 0x7f2de4042230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.157+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 >> 172.21.15.114:0/919551321 conn(0x7f2de404c850 msgr2=0x7f2de4004a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.158+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 shutdown_connections 2024-05-09T00:15:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:15:52.158+0000 7f2df3000640 1 -- 172.21.15.114:0/919551321 wait complete. 2024-05-09T00:15:52.226 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=4819 2024-05-09T00:15:52.226 INFO:tasks.mds_thrash.fs.[a]:waiting for 8 secs before reviving mds.d 2024-05-09T00:15:53.115 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-05-09T00:15:53.117+0000 7f2d6b000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:16:00.227 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-05-09T00:16:00.227 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T00:16:00.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T00:16:00.235 INFO:tasks.ceph.mds.d:Started 2024-05-09T00:16:00.236 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:00.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.713+0000 7fa470a00640 1 Processor -- start 2024-05-09T00:16:00.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.713+0000 7fa470a00640 1 -- start start 2024-05-09T00:16:00.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.715+0000 7fa470a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa46c06e3b0 0x7fa46c0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.715+0000 7fa470a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.715+0000 7fa470a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c06e7c0 con 0x7fa46c0c4de0 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.715+0000 7fa470a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c0c7e20 con 0x7fa46c06e3b0 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.715+0000 7fa470a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c0c5900 con 0x7fa46c0ac1b0 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.720+0000 7fa46b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.720+0000 7fa46b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c0ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:60102/0 (socket says 172.21.15.114:60102) 2024-05-09T00:16:00.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.720+0000 7fa46b200640 1 -- 172.21.15.114:0/3567671625 learned_addr learned my addr 172.21.15.114:0/3567671625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:00.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.720+0000 7fa46a800640 1 --2- 172.21.15.114:0/3567671625 >> v2:172.21.15.153:3300/0 conn(0x7fa46c06e3b0 0x7fa46c0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:00.722 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-09T00:16:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.721+0000 7fa46a800640 1 -- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 msgr2=0x7fa46c0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.721+0000 7fa46a800640 1 --2- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c0ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.721+0000 7fa46a800640 1 -- 172.21.15.114:0/3567671625 >> v1:172.21.15.153:6789/0 conn(0x7fa46c0c4de0 legacy=0x7fa46c0c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.721+0000 7fa46a800640 1 -- 172.21.15.114:0/3567671625 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0a8b60 con 0x7fa46c06e3b0 2024-05-09T00:16:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.724+0000 7fa46a800640 1 --2- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c82b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4580097a0 tx=0x7fa45802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e155a1ee74a15211 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.726+0000 7fa469400640 1 -- 172.21.15.114:0/3567671625 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458037070 con 0x7fa46c06e3b0 2024-05-09T00:16:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.726+0000 7fa469400640 1 -- 172.21.15.114:0/3567671625 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa458032440 con 0x7fa46c06e3b0 2024-05-09T00:16:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.727+0000 7fa469400640 1 -- 172.21.15.114:0/3567671625 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45802ae60 con 0x7fa46c06e3b0 2024-05-09T00:16:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.728+0000 7fa470a00640 1 -- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c06e3b0 msgr2=0x7fa46c0c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.728+0000 7fa470a00640 1 --2- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c82b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4580097a0 tx=0x7fa45802a110 comp rx=0 tx=0).stop 2024-05-09T00:16:00.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.731+0000 7fa470a00640 1 -- 172.21.15.114:0/3567671625 shutdown_connections 2024-05-09T00:16:00.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.731+0000 7fa470a00640 1 --2- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.731+0000 7fa470a00640 1 --2- 172.21.15.114:0/3567671625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c82b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.732+0000 7fa470a00640 1 -- 172.21.15.114:0/3567671625 >> 172.21.15.114:0/3567671625 conn(0x7fa46c0aaeb0 msgr2=0x7fa46c0ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.733+0000 7fa470a00640 1 -- 172.21.15.114:0/3567671625 shutdown_connections 2024-05-09T00:16:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.733+0000 7fa470a00640 1 -- 172.21.15.114:0/3567671625 wait complete. 2024-05-09T00:16:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.741+0000 7fa470a00640 1 Processor -- start 2024-05-09T00:16:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.741+0000 7fa470a00640 1 -- start start 2024-05-09T00:16:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.743+0000 7fa470a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.744+0000 7fa46a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.745+0000 7fa46a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58280/0 (socket says 172.21.15.114:58280) 2024-05-09T00:16:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.745+0000 7fa46a800640 1 -- 172.21.15.114:0/3590123376 learned_addr learned my addr 172.21.15.114:0/3590123376 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.745+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c1eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.745+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c0c4de0 0x7fa46c1eb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.746+0000 7fa469e00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c1eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.746+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0c7ab0 con 0x7fa46c06e3b0 2024-05-09T00:16:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.746+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0c4760 con 0x7fa46c0c4de0 2024-05-09T00:16:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.746+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c0a8860 con 0x7fa46c0ac1b0 2024-05-09T00:16:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.748+0000 7fa46a800640 1 -- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 msgr2=0x7fa46c1eb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.748+0000 7fa46a800640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c1eb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.748+0000 7fa46a800640 1 -- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c0c4de0 msgr2=0x7fa46c1eb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.748+0000 7fa46a800640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c0c4de0 0x7fa46c1eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.748+0000 7fa46a800640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c1eeb70 con 0x7fa46c06e3b0 2024-05-09T00:16:00.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.750+0000 7fa46a800640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c2710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa458035040 tx=0x7fa4580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:00.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.751+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458041030 con 0x7fa46c06e3b0 2024-05-09T00:16:00.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.752+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45803d4e0 con 0x7fa46c06e3b0 2024-05-09T00:16:00.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.752+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1eee50 con 0x7fa46c06e3b0 2024-05-09T00:16:00.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.752+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c0c8a70 con 0x7fa46c06e3b0 2024-05-09T00:16:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.755+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458037040 con 0x7fa46c06e3b0 2024-05-09T00:16:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.762+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa444005290 con 0x7fa46c06e3b0 2024-05-09T00:16:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.767+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa458044070 con 0x7fa46c06e3b0 2024-05-09T00:16:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.768+0000 7fa462a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa44c0762d0 0x7fa44c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.769+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7fa4580b7ef0 con 0x7fa46c06e3b0 2024-05-09T00:16:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.773+0000 7fa469e00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa44c0762d0 0x7fa44c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.774+0000 7fa469e00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa44c0762d0 0x7fa44c0787e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4640012e0 tx=0x7fa464009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:00.777+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa458081220 con 0x7fa46c06e3b0 2024-05-09T00:16:01.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.447+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa444005580 con 0x7fa46c06e3b0 2024-05-09T00:16:01.447 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:01.447 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2024-05-09T00:16:01.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.449+0000 7fa462a00640 1 -- 172.21.15.114:0/3590123376 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5669 (secure 0 0 0) 0x7fa458089210 con 0x7fa46c06e3b0 2024-05-09T00:16:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa44c0762d0 msgr2=0x7fa44c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa44c0762d0 0x7fa44c0787e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4640012e0 tx=0x7fa464009040 comp rx=0 tx=0).stop 2024-05-09T00:16:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 msgr2=0x7fa46c0c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c2710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa458035040 tx=0x7fa4580046c0 comp rx=0 tx=0).stop 2024-05-09T00:16:01.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 shutdown_connections 2024-05-09T00:16:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa44c0762d0 0x7fa44c0787e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46c0c4de0 0x7fa46c1eb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa46c0ac1b0 0x7fa46c1eb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 --2- 172.21.15.114:0/3590123376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46c06e3b0 0x7fa46c0c2710 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.453+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 >> 172.21.15.114:0/3590123376 conn(0x7fa46c0aaeb0 msgr2=0x7fa46c0ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.456+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 shutdown_connections 2024-05-09T00:16:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:01.456+0000 7fa470a00640 1 -- 172.21.15.114:0/3590123376 wait complete. 2024-05-09T00:16:01.510 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-09T00:16:03.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:04.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.012+0000 7fcb4ee00640 1 Processor -- start 2024-05-09T00:16:04.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.013+0000 7fcb4ee00640 1 -- start start 2024-05-09T00:16:04.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.022+0000 7fcb4ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 0x7fcb480c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:04.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.022+0000 7fcb4ee00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb480c8c10 0x7fcb480cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:04.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.022+0000 7fcb4ee00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4815d4d0 con 0x7fcb4806dc30 2024-05-09T00:16:04.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.022+0000 7fcb4ee00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480c9810 con 0x7fcb480c8c10 2024-05-09T00:16:04.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.022+0000 7fcb4ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480c9af0 con 0x7fcb480b33d0 2024-05-09T00:16:04.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.025+0000 7fcb47400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb480c8c10 0x7fcb480cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:04.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.025+0000 7fcb47e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 0x7fcb480c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:04.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.025+0000 7fcb47e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 0x7fcb480c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:60122/0 (socket says 172.21.15.114:60122) 2024-05-09T00:16:04.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.025+0000 7fcb47e00640 1 -- 172.21.15.114:0/4152814014 learned_addr learned my addr 172.21.15.114:0/4152814014 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:04.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.031+0000 7fcb46a00640 1 -- 172.21.15.114:0/4152814014 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876609191 0 0) 0x7fcb4815d4d0 con 0x7fcb4806dc30 2024-05-09T00:16:04.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.031+0000 7fcb47e00640 1 -- 172.21.15.114:0/4152814014 >> v2:172.21.15.114:3300/0 conn(0x7fcb480c8c10 msgr2=0x7fcb480cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:04.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.031+0000 7fcb47e00640 1 --2- 172.21.15.114:0/4152814014 >> v2:172.21.15.114:3300/0 conn(0x7fcb480c8c10 0x7fcb480cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.031+0000 7fcb47e00640 1 -- 172.21.15.114:0/4152814014 >> v1:172.21.15.114:6789/0 conn(0x7fcb4806dc30 legacy=0x7fcb4815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:04.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.032+0000 7fcb47e00640 1 -- 172.21.15.114:0/4152814014 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4806e040 con 0x7fcb480b33d0 2024-05-09T00:16:04.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.032+0000 7fcb47400640 1 --2- 172.21.15.114:0/4152814014 >> v2:172.21.15.114:3300/0 conn(0x7fcb480c8c10 0x7fcb480cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:16:04.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.036+0000 7fcb47e00640 1 --2- 172.21.15.114:0/4152814014 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 0x7fcb480c0ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009e50 tx=0x7fcb4002a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410b7120a8339e36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:04.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.036+0000 7fcb46a00640 1 -- 172.21.15.114:0/4152814014 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40036070 con 0x7fcb480b33d0 2024-05-09T00:16:04.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.037+0000 7fcb46a00640 1 -- 172.21.15.114:0/4152814014 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb40031600 con 0x7fcb480b33d0 2024-05-09T00:16:04.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.037+0000 7fcb46a00640 1 -- 172.21.15.114:0/4152814014 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40036070 con 0x7fcb480b33d0 2024-05-09T00:16:04.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.038+0000 7fcb4ee00640 1 -- 172.21.15.114:0/4152814014 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 msgr2=0x7fcb480c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:04.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.038+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/4152814014 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 0x7fcb480c0ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009e50 tx=0x7fcb4002a6a0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.041+0000 7fcb4ee00640 1 -- 172.21.15.114:0/4152814014 shutdown_connections 2024-05-09T00:16:04.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.041+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/4152814014 >> v2:172.21.15.114:3300/0 conn(0x7fcb480c8c10 0x7fcb480cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.041+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/4152814014 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb480b33d0 0x7fcb480c0ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.041+0000 7fcb4ee00640 1 -- 172.21.15.114:0/4152814014 >> 172.21.15.114:0/4152814014 conn(0x7fcb480cdad0 msgr2=0x7fcb480cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:04.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.043+0000 7fcb4ee00640 1 -- 172.21.15.114:0/4152814014 shutdown_connections 2024-05-09T00:16:04.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.044+0000 7fcb4ee00640 1 -- 172.21.15.114:0/4152814014 wait complete. 2024-05-09T00:16:04.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.047+0000 7fcb4ee00640 1 Processor -- start 2024-05-09T00:16:04.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.047+0000 7fcb4ee00640 1 -- start start 2024-05-09T00:16:04.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.050+0000 7fcb4ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb4806dc30 0x7fcb48159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:04.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.050+0000 7fcb4ee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 0x7fcb481f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.051+0000 7fcb4ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 0x7fcb48156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.052+0000 7fcb4ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4815d210 con 0x7fcb480c8c10 2024-05-09T00:16:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.052+0000 7fcb4ee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4815d090 con 0x7fcb480b33d0 2024-05-09T00:16:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.052+0000 7fcb4ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb48167090 con 0x7fcb4806dc30 2024-05-09T00:16:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.052+0000 7fcb4ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 0x7fcb48156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:04.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.052+0000 7fcb4ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 0x7fcb48156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58292/0 (socket says 172.21.15.114:58292) 2024-05-09T00:16:04.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.053+0000 7fcb47400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 0x7fcb481f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:04.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.053+0000 7fcb47400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 0x7fcb481f2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44108/0 (socket says 172.21.15.114:44108) 2024-05-09T00:16:04.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.053+0000 7fcb47400640 1 -- 172.21.15.114:0/2860694288 learned_addr learned my addr 172.21.15.114:0/2860694288 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:04.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.054+0000 7fcb47400640 1 -- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb4806dc30 msgr2=0x7fcb48159ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:16:04.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.054+0000 7fcb47400640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb4806dc30 0x7fcb48159ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.055+0000 7fcb47400640 1 -- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 msgr2=0x7fcb48156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:04.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.057+0000 7fcb47400640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 0x7fcb48156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.057+0000 7fcb47400640 1 -- 172.21.15.114:0/2860694288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480c37e0 con 0x7fcb480b33d0 2024-05-09T00:16:04.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.057+0000 7fcb4ce00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 0x7fcb48156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-09T00:16:04.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.058+0000 7fcb47400640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 0x7fcb481f2840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800e960 tx=0x7fcb3800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:04.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.058+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38017070 con 0x7fcb480b33d0 2024-05-09T00:16:04.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.059+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3800ca00 con 0x7fcb480b33d0 2024-05-09T00:16:04.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.059+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481f6b40 con 0x7fcb480b33d0 2024-05-09T00:16:04.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.059+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4815a7f0 con 0x7fcb480b33d0 2024-05-09T00:16:04.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.060+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800cdb0 con 0x7fcb480b33d0 2024-05-09T00:16:04.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.061+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb480ae600 con 0x7fcb480b33d0 2024-05-09T00:16:04.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.066+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb3801a070 con 0x7fcb480b33d0 2024-05-09T00:16:04.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.068+0000 7fcb3fe00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb28076300 0x7fcb28078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:04.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.070+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7fcb38098250 con 0x7fcb480b33d0 2024-05-09T00:16:04.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.071+0000 7fcb47e00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb28076300 0x7fcb28078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.077+0000 7fcb47e00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb28076300 0x7fcb28078810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb40033000 tx=0x7fcb40009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.077+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcb480ae600 con 0x7fcb480b33d0 2024-05-09T00:16:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.695+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb48077430 con 0x7fcb480b33d0 2024-05-09T00:16:04.697 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:04.697 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.699+0000 7fcb3fe00640 1 -- 172.21.15.114:0/2860694288 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+6497 (secure 0 0 0) 0x7fcb480c37e0 con 0x7fcb480b33d0 2024-05-09T00:16:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-05-09T00:16:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.704+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb28076300 msgr2=0x7fcb28078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.704+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb28076300 0x7fcb28078810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb40033000 tx=0x7fcb40009000 comp rx=0 tx=0).stop 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.704+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 msgr2=0x7fcb481f2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.704+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 0x7fcb481f2840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800e960 tx=0x7fcb3800ee20 comp rx=0 tx=0).stop 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.705+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 shutdown_connections 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.705+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fcb28076300 0x7fcb28078810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.705+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb480c8c10 0x7fcb48156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.705+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb480b33d0 0x7fcb481f2840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.705+0000 7fcb4ee00640 1 --2- 172.21.15.114:0/2860694288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb4806dc30 0x7fcb48159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:04.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.705+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 >> 172.21.15.114:0/2860694288 conn(0x7fcb480cdad0 msgr2=0x7fcb481662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:04.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.706+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 shutdown_connections 2024-05-09T00:16:04.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:04.706+0000 7fcb4ee00640 1 -- 172.21.15.114:0/2860694288 wait complete. 2024-05-09T00:16:04.769 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-05-09T00:16:04.769 INFO:tasks.mds_thrash.fs.[a]:waiting for 15 secs before thrashing 2024-05-09T00:16:14.664 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:16:14.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:16:19.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:20.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.353+0000 7f75ce400640 1 Processor -- start 2024-05-09T00:16:20.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.354+0000 7f75ce400640 1 -- start start 2024-05-09T00:16:20.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.358+0000 7f75ce400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75c8072d50 0x7f75c80c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.359+0000 7f75c7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75c8072d50 0x7f75c80c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.359+0000 7f75ce400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75c8160600 0x7f75c80c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.359+0000 7f75c7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75c8072d50 0x7f75c80c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:37926/0 (socket says 172.21.15.114:37926) 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.359+0000 7f75c7400640 1 -- 172.21.15.114:0/3750780646 learned_addr learned my addr 172.21.15.114:0/3750780646 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.359+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c80c4ca0 con 0x7f75c8072890 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.360+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f75c8160170 con 0x7f75c8160600 2024-05-09T00:16:20.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.360+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f75c815fe20 con 0x7f75c8072d50 2024-05-09T00:16:20.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.361+0000 7f75c7e00640 1 --2- 172.21.15.114:0/3750780646 >> v2:172.21.15.114:3300/0 conn(0x7f75c8160600 0x7f75c80c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:20.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.364+0000 7f75c7400640 1 -- 172.21.15.114:0/3750780646 >> v2:172.21.15.114:3300/0 conn(0x7f75c8160600 msgr2=0x7f75c80c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:20.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.364+0000 7f75c7400640 1 --2- 172.21.15.114:0/3750780646 >> v2:172.21.15.114:3300/0 conn(0x7f75c8160600 0x7f75c80c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.364+0000 7f75c7400640 1 -- 172.21.15.114:0/3750780646 >> v1:172.21.15.114:6789/0 conn(0x7f75c8072890 legacy=0x7f75c8159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:20.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.364+0000 7f75c7400640 1 -- 172.21.15.114:0/3750780646 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c815d1b0 con 0x7f75c8072d50 2024-05-09T00:16:20.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.362+0000 7f75c6000640 1 -- 172.21.15.114:0/3750780646 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640178677 0 0) 0x7f75c80c4ca0 con 0x7f75c8072890 2024-05-09T00:16:20.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.369+0000 7f75c7400640 1 --2- 172.21.15.114:0/3750780646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c8072d50 0x7f75c80c4760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75c806d5c0 tx=0x7f75b402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b11e92afd7e939bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:20.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.372+0000 7f75c6000640 1 -- 172.21.15.114:0/3750780646 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4037070 con 0x7f75c8072d50 2024-05-09T00:16:20.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.372+0000 7f75c6000640 1 -- 172.21.15.114:0/3750780646 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b4032440 con 0x7f75c8072d50 2024-05-09T00:16:20.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.372+0000 7f75c6000640 1 -- 172.21.15.114:0/3750780646 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4032810 con 0x7f75c8072d50 2024-05-09T00:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.374+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c8072d50 msgr2=0x7f75c80c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.374+0000 7f75ce400640 1 --2- 172.21.15.114:0/3750780646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c8072d50 0x7f75c80c4760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75c806d5c0 tx=0x7f75b402a230 comp rx=0 tx=0).stop 2024-05-09T00:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.377+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 shutdown_connections 2024-05-09T00:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.377+0000 7f75ce400640 1 --2- 172.21.15.114:0/3750780646 >> v2:172.21.15.114:3300/0 conn(0x7f75c8160600 0x7f75c80c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.377+0000 7f75ce400640 1 --2- 172.21.15.114:0/3750780646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c8072d50 0x7f75c80c4760 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75c806d5c0 tx=0x7f75b402a230 comp rx=0 tx=0).stop 2024-05-09T00:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.377+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 >> 172.21.15.114:0/3750780646 conn(0x7f75c806c680 msgr2=0x7f75c806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.377+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 shutdown_connections 2024-05-09T00:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.378+0000 7f75ce400640 1 -- 172.21.15.114:0/3750780646 wait complete. 2024-05-09T00:16:20.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.385+0000 7f75ce400640 1 Processor -- start 2024-05-09T00:16:20.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.385+0000 7f75ce400640 1 -- start start 2024-05-09T00:16:20.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.390+0000 7f75ce400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 0x7f75c81f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:20.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.390+0000 7f75ce400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c8160600 0x7f75c8157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.390+0000 7f75c7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 0x7f75c81f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.391+0000 7f75c7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 0x7f75c81f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59270/0 (socket says 172.21.15.114:59270) 2024-05-09T00:16:20.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.393+0000 7f75c7400640 1 -- 172.21.15.114:0/2669490736 learned_addr learned my addr 172.21.15.114:0/2669490736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:20.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.393+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c80c8690 0x7f75c814b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:20.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.395+0000 7f75c6a00640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c8160600 0x7f75c8157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:20.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.395+0000 7f75c7e00640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c80c8690 0x7f75c814b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:20.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.393+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8160a10 con 0x7f75c8072890 2024-05-09T00:16:20.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.395+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75c80c42e0 con 0x7f75c80c8690 2024-05-09T00:16:20.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.396+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f75c8160b90 con 0x7f75c8160600 2024-05-09T00:16:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.399+0000 7f75c6a00640 1 -- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c80c8690 msgr2=0x7f75c814b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:20.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.400+0000 7f75c6a00640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c80c8690 0x7f75c814b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.400+0000 7f75c6a00640 1 -- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 msgr2=0x7f75c81f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:20.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.401+0000 7f75c6a00640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 0x7f75c81f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.401+0000 7f75c6a00640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c81590c0 con 0x7f75c8160600 2024-05-09T00:16:20.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.401+0000 7f75c7e00640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c80c8690 0x7f75c814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:16:20.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.402+0000 7f75c7400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 0x7f75c81f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:16:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.405+0000 7f75c6a00640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c8160600 0x7f75c8157e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c390 tx=0x7f75b800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.405+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8017070 con 0x7f75c8160600 2024-05-09T00:16:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.406+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b80035f0 con 0x7f75c8160600 2024-05-09T00:16:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.406+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c81593a0 con 0x7f75c8160600 2024-05-09T00:16:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.406+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b80039e0 con 0x7f75c8160600 2024-05-09T00:16:20.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.407+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c8158370 con 0x7f75c8160600 2024-05-09T00:16:20.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.411+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75b801a070 con 0x7f75c8160600 2024-05-09T00:16:20.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.411+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c8157420 con 0x7f75c8160600 2024-05-09T00:16:20.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.413+0000 7f75bf400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75a80762d0 0x7f75a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:20.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.414+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f75b8096c60 con 0x7f75c8160600 2024-05-09T00:16:20.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.417+0000 7f75c7400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75a80762d0 0x7f75a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:20.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.424+0000 7f75c7400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75a80762d0 0x7f75a80787e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75b4035040 tx=0x7f75b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:20.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.425+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75b809c060 con 0x7f75c8160600 2024-05-09T00:16:20.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.946+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75c8077430 con 0x7f75c8160600 2024-05-09T00:16:20.952 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:20.952 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:20.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.952+0000 7f75bf400640 1 -- 172.21.15.114:0/2669490736 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+6497 (secure 0 0 0) 0x7f75b805f830 con 0x7f75c8160600 2024-05-09T00:16:20.952 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-05-09T00:16:20.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.964+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75a80762d0 msgr2=0x7f75a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:20.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.964+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75a80762d0 0x7f75a80787e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75b4035040 tx=0x7f75b402e000 comp rx=0 tx=0).stop 2024-05-09T00:16:20.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.964+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c8160600 msgr2=0x7f75c8157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.964+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c8160600 0x7f75c8157e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c390 tx=0x7f75b800c850 comp rx=0 tx=0).stop 2024-05-09T00:16:20.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.967+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 shutdown_connections 2024-05-09T00:16:20.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.967+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f75a80762d0 0x7f75a80787e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.967+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c80c8690 0x7f75c814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.967+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75c8160600 0x7f75c8157e30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.967+0000 7f75ce400640 1 --2- 172.21.15.114:0/2669490736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c8072890 0x7f75c81f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:20.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.967+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 >> 172.21.15.114:0/2669490736 conn(0x7f75c806c680 msgr2=0x7f75c815a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:20.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.968+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 shutdown_connections 2024-05-09T00:16:20.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:20.968+0000 7f75ce400640 1 -- 172.21.15.114:0/2669490736 wait complete. 2024-05-09T00:16:21.035 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2024-05-09T00:16:21.035 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T00:16:21.035 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:16:21.109 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T00:16:21.109 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:21.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.605+0000 7f65bd600640 1 Processor -- start 2024-05-09T00:16:21.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.606+0000 7f65bd600640 1 -- start start 2024-05-09T00:16:21.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.609+0000 7f65bd600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f65b806e3b0 0x7f65b80c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.610+0000 7f65bd600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 0x7f65b80c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.610+0000 7f65bd600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f65b80ab9d0 0x7f65b8158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.610+0000 7f65bd600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f65b80c7e20 con 0x7f65b80ab9d0 2024-05-09T00:16:21.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.610+0000 7f65bd600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f65b806e7c0 con 0x7f65b806e3b0 2024-05-09T00:16:21.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.610+0000 7f65bd600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f65b80a8b60 con 0x7f65b80c4de0 2024-05-09T00:16:21.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.611+0000 7f65afe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 0x7f65b80c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.611+0000 7f65afe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 0x7f65b80c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51422/0 (socket says 172.21.15.114:51422) 2024-05-09T00:16:21.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.611+0000 7f65afe00640 1 -- 172.21.15.114:0/1519103756 learned_addr learned my addr 172.21.15.114:0/1519103756 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:21.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.611+0000 7f65b7e00640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.153:3300/0 conn(0x7f65b806e3b0 0x7f65b80c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.612+0000 7f65bcc00640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.114:3300/0 conn(0x7f65b80ab9d0 0x7f65b8158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.612+0000 7f65afe00640 1 -- 172.21.15.114:0/1519103756 >> v2:172.21.15.153:3300/0 conn(0x7f65b806e3b0 msgr2=0x7f65b80c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:21.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.612+0000 7f65afe00640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.153:3300/0 conn(0x7f65b806e3b0 0x7f65b80c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.612+0000 7f65afe00640 1 -- 172.21.15.114:0/1519103756 >> v2:172.21.15.114:3300/0 conn(0x7f65b80ab9d0 msgr2=0x7f65b8158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:21.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.612+0000 7f65afe00640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.114:3300/0 conn(0x7f65b80ab9d0 0x7f65b8158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.612+0000 7f65afe00640 1 -- 172.21.15.114:0/1519103756 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b80c4480 con 0x7f65b80c4de0 2024-05-09T00:16:21.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.614+0000 7f65bcc00640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.114:3300/0 conn(0x7f65b80ab9d0 0x7f65b8158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:21.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.615+0000 7f65afe00640 1 --2- 172.21.15.114:0/1519103756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 0x7f65b80c51f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65b80714e0 tx=0x7f65a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae791996671c2929 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:21.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.615+0000 7f65b7400640 1 -- 172.21.15.114:0/1519103756 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0037070 con 0x7f65b80c4de0 2024-05-09T00:16:21.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.615+0000 7f65b7400640 1 -- 172.21.15.114:0/1519103756 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0032440 con 0x7f65b80c4de0 2024-05-09T00:16:21.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.615+0000 7f65b7400640 1 -- 172.21.15.114:0/1519103756 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0032850 con 0x7f65b80c4de0 2024-05-09T00:16:21.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.617+0000 7f65bd600640 1 -- 172.21.15.114:0/1519103756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 msgr2=0x7f65b80c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:21.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.617+0000 7f65bd600640 1 --2- 172.21.15.114:0/1519103756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 0x7f65b80c51f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65b80714e0 tx=0x7f65a002a180 comp rx=0 tx=0).stop 2024-05-09T00:16:21.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.617+0000 7f65bd600640 1 -- 172.21.15.114:0/1519103756 shutdown_connections 2024-05-09T00:16:21.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.617+0000 7f65bd600640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.114:3300/0 conn(0x7f65b80ab9d0 0x7f65b8158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.617+0000 7f65bd600640 1 --2- 172.21.15.114:0/1519103756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b80c4de0 0x7f65b80c51f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.618+0000 7f65bd600640 1 --2- 172.21.15.114:0/1519103756 >> v2:172.21.15.153:3300/0 conn(0x7f65b806e3b0 0x7f65b80c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.618+0000 7f65bd600640 1 -- 172.21.15.114:0/1519103756 >> 172.21.15.114:0/1519103756 conn(0x7f65b80aaeb0 msgr2=0x7f65b80ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:21.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.622+0000 7f65bd600640 1 -- 172.21.15.114:0/1519103756 shutdown_connections 2024-05-09T00:16:21.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.622+0000 7f65bd600640 1 -- 172.21.15.114:0/1519103756 wait complete. 2024-05-09T00:16:21.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.627+0000 7f65bd600640 1 Processor -- start 2024-05-09T00:16:21.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.628+0000 7f65bd600640 1 -- start start 2024-05-09T00:16:21.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.635+0000 7f65bd600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 0x7f65b814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.635+0000 7f65bd600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b80ab9d0 0x7f65b81509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.636+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 0x7f65b814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.637+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 0x7f65b814e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51424/0 (socket says 172.21.15.114:51424) 2024-05-09T00:16:21.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.636+0000 7f65bd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65b80c4de0 0x7f65b8144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.637+0000 7f65afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b80ab9d0 0x7f65b81509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.637+0000 7f65afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b80ab9d0 0x7f65b81509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:37942/0 (socket says 172.21.15.114:37942) 2024-05-09T00:16:21.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.638+0000 7f65bd600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f65b80a8860 con 0x7f65b80c4de0 2024-05-09T00:16:21.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.639+0000 7f65b7e00640 1 -- 172.21.15.114:0/1001657691 learned_addr learned my addr 172.21.15.114:0/1001657691 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:21.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.639+0000 7f65bcc00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65b80c4de0 0x7f65b8144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.639+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65b80c7ab0 con 0x7f65b80ab9d0 2024-05-09T00:16:21.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.639+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f65b80c87f0 con 0x7f65b806e3b0 2024-05-09T00:16:21.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.642+0000 7f65b7e00640 1 -- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b80ab9d0 msgr2=0x7f65b81509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:21.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.642+0000 7f65b7e00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b80ab9d0 0x7f65b81509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.642+0000 7f65b7e00640 1 -- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65b80c4de0 msgr2=0x7f65b8144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:21.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.643+0000 7f65b7e00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65b80c4de0 0x7f65b8144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:21.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.643+0000 7f65b7e00640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b8146e30 con 0x7f65b806e3b0 2024-05-09T00:16:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.643+0000 7f65bcc00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65b80c4de0 0x7f65b8144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:16:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.645+0000 7f65b7e00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 0x7f65b814e400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65a800e8a0 tx=0x7f65a800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.647+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8017070 con 0x7f65b806e3b0 2024-05-09T00:16:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.647+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a800c940 con 0x7f65b806e3b0 2024-05-09T00:16:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.647+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a800cd10 con 0x7f65b806e3b0 2024-05-09T00:16:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.647+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b8147e90 con 0x7f65b806e3b0 2024-05-09T00:16:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.647+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b81473b0 con 0x7f65b806e3b0 2024-05-09T00:16:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.661+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f65a801a070 con 0x7f65b806e3b0 2024-05-09T00:16:21.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.670+0000 7f65b4c00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f65940763d0 0x7f65940788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:21.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.670+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f65a8097960 con 0x7f65b806e3b0 2024-05-09T00:16:21.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.672+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6590005290 con 0x7f65b806e3b0 2024-05-09T00:16:21.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.673+0000 7f65afe00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f65940763d0 0x7f65940788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:21.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.675+0000 7f65afe00640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f65940763d0 0x7f65940788e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65a0034000 tx=0x7f65a0040040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:21.688+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f65a8021070 con 0x7f65b806e3b0 2024-05-09T00:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.289+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6590005580 con 0x7f65b806e3b0 2024-05-09T00:16:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.292+0000 7f65b4c00640 1 -- 172.21.15.114:0/1001657691 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+6497 (secure 0 0 0) 0x7f65a8060c80 con 0x7f65b806e3b0 2024-05-09T00:16:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:22.298 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:22.298 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-05-09T00:16:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.308+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f65940763d0 msgr2=0x7f65940788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.308+0000 7f65bd600640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f65940763d0 0x7f65940788e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65a0034000 tx=0x7f65a0040040 comp rx=0 tx=0).stop 2024-05-09T00:16:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.308+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 msgr2=0x7f65b814e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.308+0000 7f65bd600640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 0x7f65b814e400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65a800e8a0 tx=0x7f65a800ed60 comp rx=0 tx=0).stop 2024-05-09T00:16:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.310+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 shutdown_connections 2024-05-09T00:16:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.310+0000 7f65bd600640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f65940763d0 0x7f65940788e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.310+0000 7f65bd600640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65b80c4de0 0x7f65b8144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.310+0000 7f65bd600640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65b80ab9d0 0x7f65b81509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.310+0000 7f65bd600640 1 --2- 172.21.15.114:0/1001657691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65b806e3b0 0x7f65b814e400 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.310+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 >> 172.21.15.114:0/1001657691 conn(0x7f65b80aaeb0 msgr2=0x7f65b814d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.313+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 shutdown_connections 2024-05-09T00:16:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:22.313+0000 7f65bd600640 1 -- 172.21.15.114:0/1001657691 wait complete. 2024-05-09T00:16:22.364 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:16:24.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:24.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.980+0000 7f67c3a00640 1 Processor -- start 2024-05-09T00:16:24.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.980+0000 7f67c3a00640 1 -- start start 2024-05-09T00:16:24.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.986+0000 7f67c3a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67bc0c5bb0 0x7f67bc0730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:24.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.986+0000 7f67c3a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc0c62d0 0x7f67bc151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:24.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.986+0000 7f67c3a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67bc0c66e0 0x7f67bc157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:24.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.986+0000 7f67c3a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc073730 con 0x7f67bc0c66e0 2024-05-09T00:16:24.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.986+0000 7f67c3a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc0c4880 con 0x7f67bc0c5bb0 2024-05-09T00:16:24.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.986+0000 7f67c3a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc0c4b60 con 0x7f67bc0c62d0 2024-05-09T00:16:24.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.988+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc0c62d0 0x7f67bc151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.988+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc0c62d0 0x7f67bc151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51426/0 (socket says 172.21.15.114:51426) 2024-05-09T00:16:24.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.988+0000 7f67b3e00640 1 -- 172.21.15.114:0/927685369 learned_addr learned my addr 172.21.15.114:0/927685369 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:24.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.989+0000 7f67c1000640 1 --2- 172.21.15.114:0/927685369 >> v2:172.21.15.153:3300/0 conn(0x7f67bc0c5bb0 0x7f67bc0730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.991+0000 7f67c1a00640 1 --2- 172.21.15.114:0/927685369 >> v2:172.21.15.114:3300/0 conn(0x7f67bc0c66e0 0x7f67bc157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.991+0000 7f67c1000640 1 -- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc0c62d0 msgr2=0x7f67bc151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.991+0000 7f67c1000640 1 --2- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc0c62d0 0x7f67bc151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.991+0000 7f67c1000640 1 -- 172.21.15.114:0/927685369 >> v2:172.21.15.114:3300/0 conn(0x7f67bc0c66e0 msgr2=0x7f67bc157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.992+0000 7f67c1000640 1 --2- 172.21.15.114:0/927685369 >> v2:172.21.15.114:3300/0 conn(0x7f67bc0c66e0 0x7f67bc157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:24.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.993+0000 7f67c1000640 1 -- 172.21.15.114:0/927685369 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc0c4e40 con 0x7f67bc0c5bb0 2024-05-09T00:16:24.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.994+0000 7f67c1a00640 1 --2- 172.21.15.114:0/927685369 >> v2:172.21.15.114:3300/0 conn(0x7f67bc0c66e0 0x7f67bc157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:24.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:24.997+0000 7f67c1000640 1 --2- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0730f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f67bc072030 tx=0x7f67ac02a540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f129c667969e19ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.001+0000 7f67bbe00640 1 -- 172.21.15.114:0/927685369 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac007740 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.001+0000 7f67bbe00640 1 -- 172.21.15.114:0/927685369 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac0078e0 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.001+0000 7f67bbe00640 1 -- 172.21.15.114:0/927685369 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac007cb0 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.004+0000 7f67c3a00640 1 -- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c5bb0 msgr2=0x7f67bc0730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.004+0000 7f67c3a00640 1 --2- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0730f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f67bc072030 tx=0x7f67ac02a540 comp rx=0 tx=0).stop 2024-05-09T00:16:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.005+0000 7f67c3a00640 1 -- 172.21.15.114:0/927685369 shutdown_connections 2024-05-09T00:16:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.005+0000 7f67c3a00640 1 --2- 172.21.15.114:0/927685369 >> v2:172.21.15.114:3300/0 conn(0x7f67bc0c66e0 0x7f67bc157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.005+0000 7f67c3a00640 1 --2- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc0c62d0 0x7f67bc151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.005+0000 7f67c3a00640 1 --2- 172.21.15.114:0/927685369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0730f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.005+0000 7f67c3a00640 1 -- 172.21.15.114:0/927685369 >> 172.21.15.114:0/927685369 conn(0x7f67bc06c680 msgr2=0x7f67bc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:25.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.016+0000 7f67c3a00640 1 -- 172.21.15.114:0/927685369 shutdown_connections 2024-05-09T00:16:25.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.016+0000 7f67c3a00640 1 -- 172.21.15.114:0/927685369 wait complete. 2024-05-09T00:16:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.021+0000 7f67c3a00640 1 Processor -- start 2024-05-09T00:16:25.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.023+0000 7f67c3a00640 1 -- start start 2024-05-09T00:16:25.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c3a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c3a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c62d0 0x7f67bc1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c3a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc1609e0 0x7f67bc0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c3a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc0af840 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c3a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc0af6c0 con 0x7f67bc0c62d0 2024-05-09T00:16:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c3a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc06d1a0 con 0x7f67bc1609e0 2024-05-09T00:16:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59306/0 (socket says 172.21.15.114:59306) 2024-05-09T00:16:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.026+0000 7f67c1000640 1 -- 172.21.15.114:0/726741517 learned_addr learned my addr 172.21.15.114:0/726741517 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.027+0000 7f67c1000640 1 -- 172.21.15.114:0/726741517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc1609e0 msgr2=0x7f67bc0ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.027+0000 7f67c1000640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc1609e0 0x7f67bc0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.027+0000 7f67c1000640 1 -- 172.21.15.114:0/726741517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c62d0 msgr2=0x7f67bc1604a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:16:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.027+0000 7f67c1000640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c62d0 0x7f67bc1604a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.027+0000 7f67c1000640 1 -- 172.21.15.114:0/726741517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc0c9080 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.028+0000 7f67c1000640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0c87c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f67ac02ab30 tx=0x7f67ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.028+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac03f070 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.029+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac031bc0 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.029+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac043410 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.029+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc14e730 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.029+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc161180 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.031+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc077430 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.034+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f67ac0435b0 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.035+0000 7f67b9600640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6798076320 0x7f6798078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.035+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f67ac0b8f50 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.036+0000 7f67b3e00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6798076320 0x7f6798078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.038+0000 7f67b3e00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6798076320 0x7f6798078830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0c9510 tx=0x7f67a4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:25.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.046+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f67bc0c9080 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.639+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67bc074030 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.641+0000 7f67b9600640 1 -- 172.21.15.114:0/726741517 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+6497 (secure 0 0 0) 0x7f67ac088090 con 0x7f67bc0c5bb0 2024-05-09T00:16:25.642 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:25.642 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:25.643 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-05-09T00:16:25.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.653+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6798076320 msgr2=0x7f6798078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:25.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.653+0000 7f67c3a00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6798076320 0x7f6798078830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0c9510 tx=0x7f67a4009240 comp rx=0 tx=0).stop 2024-05-09T00:16:25.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.653+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 msgr2=0x7f67bc0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:25.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.653+0000 7f67c3a00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0c87c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f67ac02ab30 tx=0x7f67ac004a40 comp rx=0 tx=0).stop 2024-05-09T00:16:25.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 shutdown_connections 2024-05-09T00:16:25.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6798076320 0x7f6798078830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67bc1609e0 0x7f67bc0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67bc0c62d0 0x7f67bc1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 --2- 172.21.15.114:0/726741517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc0c5bb0 0x7f67bc0c87c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:25.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 >> 172.21.15.114:0/726741517 conn(0x7f67bc06c680 msgr2=0x7f67bc143a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:25.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 shutdown_connections 2024-05-09T00:16:25.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:25.656+0000 7f67c3a00640 1 -- 172.21.15.114:0/726741517 wait complete. 2024-05-09T00:16:25.716 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:16:27.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:28.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.248+0000 7f6c9aa00640 1 Processor -- start 2024-05-09T00:16:28.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.249+0000 7f6c9aa00640 1 -- start start 2024-05-09T00:16:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.254+0000 7f6c9aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c940731b0 0x7f6c940735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.254+0000 7f6c9aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c94157bf0 0x7f6c94158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.254+0000 7f6c9aa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c941546c0 con 0x7f6c94072c60 2024-05-09T00:16:28.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.254+0000 7f6c9aa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6c94068d20 con 0x7f6c940731b0 2024-05-09T00:16:28.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.254+0000 7f6c9aa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c941552d0 con 0x7f6c94157bf0 2024-05-09T00:16:28.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.255+0000 7f6c9a000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c94157bf0 0x7f6c94158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:28.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.255+0000 7f6c9a000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c94157bf0 0x7f6c94158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:37846/0 (socket says 172.21.15.114:37846) 2024-05-09T00:16:28.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.255+0000 7f6c9a000640 1 -- 172.21.15.114:0/2074489675 learned_addr learned my addr 172.21.15.114:0/2074489675 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:28.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.256+0000 7f6c9a000640 1 -- 172.21.15.114:0/2074489675 >> v2:172.21.15.114:3300/0 conn(0x7f6c940731b0 msgr2=0x7f6c940735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.256+0000 7f6c9a000640 1 --2- 172.21.15.114:0/2074489675 >> v2:172.21.15.114:3300/0 conn(0x7f6c940731b0 0x7f6c940735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.257+0000 7f6c9a000640 1 -- 172.21.15.114:0/2074489675 >> v1:172.21.15.153:6789/0 conn(0x7f6c94072c60 legacy=0x7f6c94068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:28.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.257+0000 7f6c9a000640 1 -- 172.21.15.114:0/2074489675 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c941549a0 con 0x7f6c94157bf0 2024-05-09T00:16:28.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.265+0000 7f6c9a000640 1 --2- 172.21.15.114:0/2074489675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94157bf0 0x7f6c94158000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c940c4760 tx=0x7f6c8c02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f2ba09435e00fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:28.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.267+0000 7f6c93e00640 1 -- 172.21.15.114:0/2074489675 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c036070 con 0x7f6c94157bf0 2024-05-09T00:16:28.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.267+0000 7f6c93e00640 1 -- 172.21.15.114:0/2074489675 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c031600 con 0x7f6c94157bf0 2024-05-09T00:16:28.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.267+0000 7f6c93e00640 1 -- 172.21.15.114:0/2074489675 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0319d0 con 0x7f6c94157bf0 2024-05-09T00:16:28.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.271+0000 7f6c9aa00640 1 -- 172.21.15.114:0/2074489675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94157bf0 msgr2=0x7f6c94158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:28.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.271+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/2074489675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94157bf0 0x7f6c94158000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c940c4760 tx=0x7f6c8c02a6c0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.274+0000 7f6c9aa00640 1 -- 172.21.15.114:0/2074489675 shutdown_connections 2024-05-09T00:16:28.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.274+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/2074489675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94157bf0 0x7f6c94158000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.274+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/2074489675 >> v2:172.21.15.114:3300/0 conn(0x7f6c940731b0 0x7f6c940735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.274+0000 7f6c9aa00640 1 -- 172.21.15.114:0/2074489675 >> 172.21.15.114:0/2074489675 conn(0x7f6c9406c680 msgr2=0x7f6c9406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.276+0000 7f6c9aa00640 1 -- 172.21.15.114:0/2074489675 shutdown_connections 2024-05-09T00:16:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.276+0000 7f6c9aa00640 1 -- 172.21.15.114:0/2074489675 wait complete. 2024-05-09T00:16:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.281+0000 7f6c9aa00640 1 Processor -- start 2024-05-09T00:16:28.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.285+0000 7f6c9aa00640 1 -- start start 2024-05-09T00:16:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.287+0000 7f6c9aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 0x7f6c94152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.287+0000 7f6c9aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c940731b0 0x7f6c9413baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.287+0000 7f6c9aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94157bf0 0x7f6c941651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.287+0000 7f6c9aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c94151ec0 con 0x7f6c94157bf0 2024-05-09T00:16:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.287+0000 7f6c9aa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c94154f60 con 0x7f6c94072c60 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.287+0000 7f6c9aa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c940ab5e0 con 0x7f6c940731b0 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.289+0000 7f6c99600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 0x7f6c94152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.289+0000 7f6c99600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 0x7f6c94152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:37858/0 (socket says 172.21.15.114:37858) 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.289+0000 7f6c99600640 1 -- 172.21.15.114:0/1578428049 learned_addr learned my addr 172.21.15.114:0/1578428049 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.290+0000 7f6c99600640 1 -- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c940731b0 msgr2=0x7f6c9413baf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.290+0000 7f6c99600640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c940731b0 0x7f6c9413baf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.290+0000 7f6c99600640 1 -- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94157bf0 msgr2=0x7f6c941651a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.290+0000 7f6c99600640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94157bf0 0x7f6c941651a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.290+0000 7f6c99600640 1 -- 172.21.15.114:0/1578428049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c940c8990 con 0x7f6c94072c60 2024-05-09T00:16:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.290+0000 7f6c99600640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 0x7f6c94152370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c430 tx=0x7f6c8800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:28.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.291+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88017070 con 0x7f6c94072c60 2024-05-09T00:16:28.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.292+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c880052d0 con 0x7f6c94072c60 2024-05-09T00:16:28.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.292+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c880037f0 con 0x7f6c94072c60 2024-05-09T00:16:28.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.293+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c940c7930 con 0x7f6c94072c60 2024-05-09T00:16:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.296+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9413e770 con 0x7f6c94072c60 2024-05-09T00:16:28.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.300+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c94078350 con 0x7f6c94072c60 2024-05-09T00:16:28.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.304+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c8801a070 con 0x7f6c94072c60 2024-05-09T00:16:28.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.306+0000 7f6c91600640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c74076320 0x7f6c74078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:28.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.310+0000 7f6c98c00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c74076320 0x7f6c74078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:28.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.312+0000 7f6c98c00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c74076320 0x7f6c74078830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6c940b0150 tx=0x7f6c80006b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:28.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.312+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f6c8805c150 con 0x7f6c94072c60 2024-05-09T00:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.325+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c88060260 con 0x7f6c94072c60 2024-05-09T00:16:28.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.896+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c940c5bc0 con 0x7f6c94072c60 2024-05-09T00:16:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.899+0000 7f6c91600640 1 -- 172.21.15.114:0/1578428049 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+6497 (secure 0 0 0) 0x7f6c8805fb60 con 0x7f6c94072c60 2024-05-09T00:16:28.900 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:28.900 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:28.900 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-05-09T00:16:28.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.903+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c74076320 msgr2=0x7f6c74078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:28.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.903+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c74076320 0x7f6c74078830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6c940b0150 tx=0x7f6c80006b80 comp rx=0 tx=0).stop 2024-05-09T00:16:28.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.903+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 msgr2=0x7f6c94152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:28.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.903+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 0x7f6c94152370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c430 tx=0x7f6c8800c8f0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 shutdown_connections 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f6c74076320 0x7f6c74078830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94157bf0 0x7f6c941651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c940731b0 0x7f6c9413baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 --2- 172.21.15.114:0/1578428049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c94072c60 0x7f6c94152370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 >> 172.21.15.114:0/1578428049 conn(0x7f6c9406c680 msgr2=0x7f6c9413fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 shutdown_connections 2024-05-09T00:16:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:28.905+0000 7f6c9aa00640 1 -- 172.21.15.114:0/1578428049 wait complete. 2024-05-09T00:16:28.983 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:16:30.984 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:31.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.524+0000 7f493a400640 1 Processor -- start 2024-05-09T00:16:31.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.524+0000 7f493a400640 1 -- start start 2024-05-09T00:16:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.534+0000 7f493a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f492c035550 0x7f492c04b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.535+0000 7f493a400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f492c0075d0 0x7f492c0db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.535+0000 7f4933400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f492c035550 0x7f492c04b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.535+0000 7f4933400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f492c035550 0x7f492c04b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:37860/0 (socket says 172.21.15.114:37860) 2024-05-09T00:16:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.535+0000 7f4933400640 1 -- 172.21.15.114:0/1040997382 learned_addr learned my addr 172.21.15.114:0/1040997382 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.536+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c00e4d0 con 0x7f492c0079e0 2024-05-09T00:16:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.536+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f492c00f0e0 con 0x7f492c0075d0 2024-05-09T00:16:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.536+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f492c00e7b0 con 0x7f492c035550 2024-05-09T00:16:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.536+0000 7f4932a00640 1 --2- 172.21.15.114:0/1040997382 >> v2:172.21.15.114:3300/0 conn(0x7f492c0075d0 0x7f492c0db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.537+0000 7f4933400640 1 -- 172.21.15.114:0/1040997382 >> v2:172.21.15.114:3300/0 conn(0x7f492c0075d0 msgr2=0x7f492c0db250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.537+0000 7f4932000640 1 -- 172.21.15.114:0/1040997382 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993773171 0 0) 0x7f492c00e4d0 con 0x7f492c0079e0 2024-05-09T00:16:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.537+0000 7f4933400640 1 --2- 172.21.15.114:0/1040997382 >> v2:172.21.15.114:3300/0 conn(0x7f492c0075d0 0x7f492c0db250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.537+0000 7f4933400640 1 -- 172.21.15.114:0/1040997382 >> v1:172.21.15.153:6789/0 conn(0x7f492c0079e0 legacy=0x7f492c04ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.537+0000 7f4933400640 1 -- 172.21.15.114:0/1040997382 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c00ea90 con 0x7f492c035550 2024-05-09T00:16:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.537+0000 7f4932a00640 1 --2- 172.21.15.114:0/1040997382 >> v2:172.21.15.114:3300/0 conn(0x7f492c0075d0 0x7f492c0db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:31.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.540+0000 7f4933400640 1 --2- 172.21.15.114:0/1040997382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c04b040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f492c050e80 tx=0x7f492802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19079a1020095599 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:31.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.541+0000 7f4932000640 1 -- 172.21.15.114:0/1040997382 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928037070 con 0x7f492c035550 2024-05-09T00:16:31.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.541+0000 7f4932000640 1 -- 172.21.15.114:0/1040997382 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4928032440 con 0x7f492c035550 2024-05-09T00:16:31.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.541+0000 7f4932000640 1 -- 172.21.15.114:0/1040997382 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928032810 con 0x7f492c035550 2024-05-09T00:16:31.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.542+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 msgr2=0x7f492c04b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:31.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.542+0000 7f493a400640 1 --2- 172.21.15.114:0/1040997382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c04b040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f492c050e80 tx=0x7f492802a180 comp rx=0 tx=0).stop 2024-05-09T00:16:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.543+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 shutdown_connections 2024-05-09T00:16:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.543+0000 7f493a400640 1 --2- 172.21.15.114:0/1040997382 >> v2:172.21.15.114:3300/0 conn(0x7f492c0075d0 0x7f492c0db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.543+0000 7f493a400640 1 --2- 172.21.15.114:0/1040997382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c04b040 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.543+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 >> 172.21.15.114:0/1040997382 conn(0x7f492c04c850 msgr2=0x7f492c04cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.543+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 shutdown_connections 2024-05-09T00:16:31.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.543+0000 7f493a400640 1 -- 172.21.15.114:0/1040997382 wait complete. 2024-05-09T00:16:31.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.547+0000 7f493a400640 1 Processor -- start 2024-05-09T00:16:31.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.547+0000 7f493a400640 1 -- start start 2024-05-09T00:16:31.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.550+0000 7f493a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 0x7f492c0d5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.550+0000 7f493a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c180950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f4933400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 0x7f492c0d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f4933400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 0x7f492c0d5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43614/0 (socket says 172.21.15.114:43614) 2024-05-09T00:16:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f493a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492c17d430 0x7f492c0da360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f4933400640 1 -- 172.21.15.114:0/4120242743 learned_addr learned my addr 172.21.15.114:0/4120242743 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f492c0db910 con 0x7f492c17d430 2024-05-09T00:16:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f492c0db790 con 0x7f492c035550 2024-05-09T00:16:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f492c0dba90 con 0x7f492c0075d0 2024-05-09T00:16:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.551+0000 7f4932a00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c180950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.552+0000 7f4933e00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492c17d430 0x7f492c0da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.552+0000 7f4933400640 1 -- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 msgr2=0x7f492c180950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.552+0000 7f4933400640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c180950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.552+0000 7f4933400640 1 -- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492c17d430 msgr2=0x7f492c0da360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.552+0000 7f4933400640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492c17d430 0x7f492c0da360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.552+0000 7f4933400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c180e90 con 0x7f492c0075d0 2024-05-09T00:16:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.553+0000 7f4933400640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 0x7f492c0d5030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f492802a1c0 tx=0x7f49280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.553+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928037040 con 0x7f492c0075d0 2024-05-09T00:16:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.554+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4928042070 con 0x7f492c0075d0 2024-05-09T00:16:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.554+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c0dc3e0 con 0x7f492c0075d0 2024-05-09T00:16:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.554+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c0d37d0 con 0x7f492c0075d0 2024-05-09T00:16:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.554+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928030bb0 con 0x7f492c0075d0 2024-05-09T00:16:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.557+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4928047460 con 0x7f492c0075d0 2024-05-09T00:16:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.558+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4910005290 con 0x7f492c0075d0 2024-05-09T00:16:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.559+0000 7f4927400640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f49140762d0 0x7f49140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.560+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f49280b88e0 con 0x7f492c0075d0 2024-05-09T00:16:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.560+0000 7f4932a00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f49140762d0 0x7f49140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.566+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4928081690 con 0x7f492c0075d0 2024-05-09T00:16:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:31.567+0000 7f4932a00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f49140762d0 0x7f49140787e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f492c0d9c50 tx=0x7f4920008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:32.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.088+0000 7f493a400640 1 -- 172.21.15.114:0/4120242743 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4910005580 con 0x7f492c0075d0 2024-05-09T00:16:32.093 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:32.093 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:15:51.350754+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4960":{"gid":4960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":10,"addr":"172.21.15.114:6836/281438172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":281438172},{"type":"v1","addr":"172.21.15.114:6836","nonce":281438172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4960,"qdb_cluster":[4960]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.089+0000 7f4927400640 1 -- 172.21.15.114:0/4120242743 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+6497 (secure 0 0 0) 0x7f4928085990 con 0x7f492c0075d0 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.094+0000 7f4924c00640 1 -- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f49140762d0 msgr2=0x7f49140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.094+0000 7f4924c00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f49140762d0 0x7f49140787e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f492c0d9c50 tx=0x7f4920008040 comp rx=0 tx=0).stop 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.094+0000 7f4924c00640 1 -- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 msgr2=0x7f492c0d5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.094+0000 7f4924c00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 0x7f492c0d5030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f492802a1c0 tx=0x7f49280046c0 comp rx=0 tx=0).stop 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.095+0000 7f4924c00640 1 -- 172.21.15.114:0/4120242743 shutdown_connections 2024-05-09T00:16:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.095+0000 7f4924c00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f49140762d0 0x7f49140787e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.095+0000 7f4924c00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492c17d430 0x7f492c0da360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.095+0000 7f4924c00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f492c035550 0x7f492c180950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.095+0000 7f4924c00640 1 --2- 172.21.15.114:0/4120242743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f492c0075d0 0x7f492c0d5030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.095+0000 7f4924c00640 1 -- 172.21.15.114:0/4120242743 >> 172.21.15.114:0/4120242743 conn(0x7f492c04c850 msgr2=0x7f492c004a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.096+0000 7f4924c00640 1 -- 172.21.15.114:0/4120242743 shutdown_connections 2024-05-09T00:16:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:32.097+0000 7f4924c00640 1 -- 172.21.15.114:0/4120242743 wait complete. 2024-05-09T00:16:32.144 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:16:34.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.610+0000 7f72fce00640 1 Processor -- start 2024-05-09T00:16:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.610+0000 7f72fce00640 1 -- start start 2024-05-09T00:16:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.623+0000 7f72fce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72f806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.623+0000 7f72fce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72f8158ff0 0x7f72f80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.623+0000 7f72f5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72f806e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.623+0000 7f72f5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72f806e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43620/0 (socket says 172.21.15.114:43620) 2024-05-09T00:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.624+0000 7f72f5400640 1 -- 172.21.15.114:0/2171438920 learned_addr learned my addr 172.21.15.114:0/2171438920 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.624+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f80cb2e0 con 0x7f72f80c5fd0 2024-05-09T00:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.624+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f72f806e5e0 con 0x7f72f8158ff0 2024-05-09T00:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.624+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72f806e810 con 0x7f72f80ca020 2024-05-09T00:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.624+0000 7f72f6800640 1 --2- 172.21.15.114:0/2171438920 >> v2:172.21.15.114:3300/0 conn(0x7f72f8158ff0 0x7f72f80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.624+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223353941 0 0) 0x7f72f80cb2e0 con 0x7f72f80c5fd0 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.625+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72dc003520 con 0x7f72f80c5fd0 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.625+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 53547291 0 0) 0x7f72dc003520 con 0x7f72f80c5fd0 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.625+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 msgr2=0x7f72f806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.625+0000 7f72f4a00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72f806e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.625+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 >> v2:172.21.15.114:3300/0 conn(0x7f72f8158ff0 msgr2=0x7f72f80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 --2- 172.21.15.114:0/2171438920 >> v2:172.21.15.114:3300/0 conn(0x7f72f8158ff0 0x7f72f80c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f806eaf0 con 0x7f72f80c5fd0 2024-05-09T00:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f72e00016f0 con 0x7f72f80c5fd0 2024-05-09T00:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 >> v1:172.21.15.114:6789/0 conn(0x7f72f80c5fd0 legacy=0x7f72f815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72dc004800 0x7f72dc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72f806e810 con 0x7f72dc004800 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc00bad0 con 0x7f72dc003a00 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.626+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc00bcd0 con 0x7f72f80ca020 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.627+0000 7f72f6800640 1 --2- 172.21.15.114:0/2171438920 >> v2:172.21.15.114:3300/0 conn(0x7f72f8158ff0 0x7f72f80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.627+0000 7f72f5e00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.628+0000 7f72f5400640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72dc004800 0x7f72dc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.628+0000 7f72f6800640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.628+0000 7f72f5e00640 1 -- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 msgr2=0x7f72dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.628+0000 7f72f5e00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f80ca020 0x7f72dc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.628+0000 7f72f5e00640 1 -- 172.21.15.114:0/2171438920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72dc004800 msgr2=0x7f72dc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.628+0000 7f72f5e00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72dc004800 0x7f72dc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.629+0000 7f72f5e00640 1 -- 172.21.15.114:0/2171438920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f806eaf0 con 0x7f72dc003a00 2024-05-09T00:16:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.631+0000 7f72f5e00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72dc003e70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c160 tx=0x7f72dc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1e9a19d5e856 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.631+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0036070 con 0x7f72dc003a00 2024-05-09T00:16:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.632+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e0031600 con 0x7f72dc003a00 2024-05-09T00:16:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.632+0000 7f72f4a00640 1 -- 172.21.15.114:0/2171438920 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0007cc0 con 0x7f72dc003a00 2024-05-09T00:16:34.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.638+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 msgr2=0x7f72dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:34.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.638+0000 7f72fce00640 1 --2- 172.21.15.114:0/2171438920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72dc003e70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c160 tx=0x7f72dc005830 comp rx=0 tx=0).stop 2024-05-09T00:16:34.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.638+0000 7f72f6800640 1 -- 172.21.15.114:0/2171438920 reap_dead start 2024-05-09T00:16:34.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.642+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 shutdown_connections 2024-05-09T00:16:34.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.642+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 >> 172.21.15.114:0/2171438920 conn(0x7f72f80cb7b0 msgr2=0x7f72f80cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:34.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.642+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 shutdown_connections 2024-05-09T00:16:34.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.642+0000 7f72fce00640 1 -- 172.21.15.114:0/2171438920 wait complete. 2024-05-09T00:16:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.648+0000 7f72fce00640 1 Processor -- start 2024-05-09T00:16:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.653+0000 7f72fce00640 1 -- start start 2024-05-09T00:16:34.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.656+0000 7f72fce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72f814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.656+0000 7f72fce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72f814f400 0x7f72f8157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.656+0000 7f72fce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f8157ff0 0x7f72f81edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.660+0000 7f72f5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72f814f400 0x7f72f8157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.661+0000 7f72f5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72f814f400 0x7f72f8157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59452/0 (socket says 172.21.15.114:59452) 2024-05-09T00:16:34.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.661+0000 7f72f5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72f814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.662+0000 7f72f5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72f814ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:37888/0 (socket says 172.21.15.114:37888) 2024-05-09T00:16:34.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.662+0000 7f72f5400640 1 -- 172.21.15.114:0/3187290357 learned_addr learned my addr 172.21.15.114:0/3187290357 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:34.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.662+0000 7f72f6800640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f8157ff0 0x7f72f81edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.663+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72f815c6d0 con 0x7f72f814f400 2024-05-09T00:16:34.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.663+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72f815baa0 con 0x7f72dc003a00 2024-05-09T00:16:34.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.663+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72f806e0a0 con 0x7f72f8157ff0 2024-05-09T00:16:34.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.665+0000 7f72f6800640 1 -- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 msgr2=0x7f72f814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:34.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.665+0000 7f72f6800640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72f814ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:34.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.665+0000 7f72f6800640 1 -- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72f814f400 msgr2=0x7f72f8157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:34.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.665+0000 7f72f6800640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72f814f400 0x7f72f8157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:34.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.665+0000 7f72f6800640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f814f200 con 0x7f72f8157ff0 2024-05-09T00:16:34.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.667+0000 7f72f5e00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72f814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:16:34.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.670+0000 7f72f6800640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f8157ff0 0x7f72f81edbe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f72f80c9b10 tx=0x7f72e8010530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:34.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.674+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8010de0 con 0x7f72f8157ff0 2024-05-09T00:16:34.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.674+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f8072540 con 0x7f72f8157ff0 2024-05-09T00:16:34.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.675+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f8070110 con 0x7f72f8157ff0 2024-05-09T00:16:34.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.675+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e801c070 con 0x7f72f8157ff0 2024-05-09T00:16:34.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.675+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8017670 con 0x7f72f8157ff0 2024-05-09T00:16:34.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.677+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d0005290 con 0x7f72f8157ff0 2024-05-09T00:16:34.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.681+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f72e8017810 con 0x7f72f8157ff0 2024-05-09T00:16:34.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.682+0000 7f72ee000640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f72d40762d0 0x7f72d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:34.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.682+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7268+0+0 (secure 0 0 0) 0x7f72e8099670 con 0x7f72f8157ff0 2024-05-09T00:16:34.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.683+0000 7f72f5e00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f72d40762d0 0x7f72d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.686+0000 7f72f5e00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f72d40762d0 0x7f72d40787e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72f80c9dd0 tx=0x7f72e0033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:34.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:34.690+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f72e8026020 con 0x7f72f8157ff0 2024-05-09T00:16:35.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.193+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72d0005580 con 0x7f72f8157ff0 2024-05-09T00:16:35.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.198+0000 7f72ee000640 1 -- 172.21.15.114:0/3187290357 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5664 (secure 0 0 0) 0x7f72f814f200 con 0x7f72f8157ff0 2024-05-09T00:16:35.198 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:35.198 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:34.973620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:35.199 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-05-09T00:16:35.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f72d40762d0 msgr2=0x7f72d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:35.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f72d40762d0 0x7f72d40787e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72f80c9dd0 tx=0x7f72e0033040 comp rx=0 tx=0).stop 2024-05-09T00:16:35.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f8157ff0 msgr2=0x7f72f81edbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:35.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f8157ff0 0x7f72f81edbe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f72f80c9b10 tx=0x7f72e8010530 comp rx=0 tx=0).stop 2024-05-09T00:16:35.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 shutdown_connections 2024-05-09T00:16:35.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f72d40762d0 0x7f72d40787e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72f8157ff0 0x7f72f81edbe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72f814f400 0x7f72f8157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 --2- 172.21.15.114:0/3187290357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc003a00 0x7f72f814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.202+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 >> 172.21.15.114:0/3187290357 conn(0x7f72f80cb7b0 msgr2=0x7f72f81536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.203+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 shutdown_connections 2024-05-09T00:16:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.203+0000 7f72fce00640 1 -- 172.21.15.114:0/3187290357 wait complete. 2024-05-09T00:16:35.260 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2024-05-09T00:16:35.260 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T00:16:35.260 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.794+0000 7f9edbe00640 1 Processor -- start 2024-05-09T00:16:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.794+0000 7f9edbe00640 1 -- start start 2024-05-09T00:16:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.800+0000 7f9edbe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9edc06f4c0 0x7f9edc0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.800+0000 7f9edbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9edc0c3b00 0x7f9edc0c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.801+0000 7f9edbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c7000 0x7f9edc0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.802+0000 7f9edbe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0a87c0 con 0x7f9edc0c3b00 2024-05-09T00:16:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.802+0000 7f9edbe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0c4d50 con 0x7f9edc06f4c0 2024-05-09T00:16:35.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.802+0000 7f9edbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0c54d0 con 0x7f9edc0c7000 2024-05-09T00:16:35.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.804+0000 7f9edb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c7000 0x7f9edc0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.804+0000 7f9edb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c7000 0x7f9edc0c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:43650/0 (socket says 172.21.15.114:43650) 2024-05-09T00:16:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.804+0000 7f9edb400640 1 -- 172.21.15.114:0/3287801923 learned_addr learned my addr 172.21.15.114:0/3287801923 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.804+0000 7f9eda000640 1 --2- 172.21.15.114:0/3287801923 >> v2:172.21.15.114:3300/0 conn(0x7f9edc0c3b00 0x7f9edc0c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.805+0000 7f9eda000640 1 -- 172.21.15.114:0/3287801923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c7000 msgr2=0x7f9edc0c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.805+0000 7f9eda000640 1 --2- 172.21.15.114:0/3287801923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c7000 0x7f9edc0c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.805+0000 7f9eda000640 1 -- 172.21.15.114:0/3287801923 >> v2:172.21.15.153:3300/0 conn(0x7f9edc06f4c0 msgr2=0x7f9edc0c5e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:16:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.805+0000 7f9eda000640 1 --2- 172.21.15.114:0/3287801923 >> v2:172.21.15.153:3300/0 conn(0x7f9edc06f4c0 0x7f9edc0c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.805+0000 7f9eda000640 1 -- 172.21.15.114:0/3287801923 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0c57b0 con 0x7f9edc0c3b00 2024-05-09T00:16:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.807+0000 7f9eda000640 1 --2- 172.21.15.114:0/3287801923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c3b00 0x7f9edc0c3f10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0714e0 tx=0x7f9ec802a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd255857c90360a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:35.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.809+0000 7f9ed9600640 1 -- 172.21.15.114:0/3287801923 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8037070 con 0x7f9edc0c3b00 2024-05-09T00:16:35.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.809+0000 7f9ed9600640 1 -- 172.21.15.114:0/3287801923 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec802ade0 con 0x7f9edc0c3b00 2024-05-09T00:16:35.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.811+0000 7f9edbe00640 1 -- 172.21.15.114:0/3287801923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c3b00 msgr2=0x7f9edc0c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:35.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.811+0000 7f9edbe00640 1 --2- 172.21.15.114:0/3287801923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c3b00 0x7f9edc0c3f10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0714e0 tx=0x7f9ec802a090 comp rx=0 tx=0).stop 2024-05-09T00:16:35.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.811+0000 7f9edbe00640 1 -- 172.21.15.114:0/3287801923 shutdown_connections 2024-05-09T00:16:35.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.811+0000 7f9edbe00640 1 --2- 172.21.15.114:0/3287801923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c7000 0x7f9edc0c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.812+0000 7f9edbe00640 1 --2- 172.21.15.114:0/3287801923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c3b00 0x7f9edc0c3f10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.812+0000 7f9edbe00640 1 --2- 172.21.15.114:0/3287801923 >> v2:172.21.15.153:3300/0 conn(0x7f9edc06f4c0 0x7f9edc0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.812+0000 7f9edbe00640 1 -- 172.21.15.114:0/3287801923 >> 172.21.15.114:0/3287801923 conn(0x7f9edc0c92e0 msgr2=0x7f9edc0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.812+0000 7f9edbe00640 1 -- 172.21.15.114:0/3287801923 shutdown_connections 2024-05-09T00:16:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.812+0000 7f9edbe00640 1 -- 172.21.15.114:0/3287801923 wait complete. 2024-05-09T00:16:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.817+0000 7f9edbe00640 1 Processor -- start 2024-05-09T00:16:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.817+0000 7f9edbe00640 1 -- start start 2024-05-09T00:16:35.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.823+0000 7f9edbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9edc06f4c0 0x7f9edc0c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.823+0000 7f9edbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c3b00 0x7f9edc14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.823+0000 7f9edbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 0x7f9edc13fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.823+0000 7f9edbe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc06f8d0 con 0x7f9edc0c7000 2024-05-09T00:16:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.823+0000 7f9edbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc0a8a10 con 0x7f9edc06f4c0 2024-05-09T00:16:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.823+0000 7f9edbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0c63d0 con 0x7f9edc0c3b00 2024-05-09T00:16:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.824+0000 7f9edaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9edc06f4c0 0x7f9edc0c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:35.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.824+0000 7f9eda000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c3b00 0x7f9edc14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:35.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.825+0000 7f9edb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 0x7f9edc13fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:35.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.826+0000 7f9edb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 0x7f9edc13fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59482/0 (socket says 172.21.15.114:59482) 2024-05-09T00:16:35.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.826+0000 7f9edb400640 1 -- 172.21.15.114:0/16718146 learned_addr learned my addr 172.21.15.114:0/16718146 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:35.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.827+0000 7f9edb400640 1 -- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c3b00 msgr2=0x7f9edc14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:35.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.827+0000 7f9edb400640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c3b00 0x7f9edc14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.827+0000 7f9edb400640 1 -- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9edc06f4c0 msgr2=0x7f9edc0c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:35.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.827+0000 7f9edb400640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9edc06f4c0 0x7f9edc0c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:35.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.827+0000 7f9edb400640 1 -- 172.21.15.114:0/16718146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0c2b40 con 0x7f9edc0c7000 2024-05-09T00:16:35.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.828+0000 7f9edaa00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9edc06f4c0 0x7f9edc0c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:35.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.829+0000 7f9edb400640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 0x7f9edc13fab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4007e00 tx=0x7f9ed400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.836+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400dd50 con 0x7f9edc0c7000 2024-05-09T00:16:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.836+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4003990 con 0x7f9edc0c7000 2024-05-09T00:16:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.836+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4003d80 con 0x7f9edc0c7000 2024-05-09T00:16:35.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.839+0000 7f9edbe00640 1 -- 172.21.15.114:0/16718146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc14bac0 con 0x7f9edc0c7000 2024-05-09T00:16:35.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.839+0000 7f9edbe00640 1 -- 172.21.15.114:0/16718146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc0a9fe0 con 0x7f9edc0c7000 2024-05-09T00:16:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.844+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc078350 con 0x7f9edc0c7000 2024-05-09T00:16:35.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.849+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ed401c020 con 0x7f9edc0c7000 2024-05-09T00:16:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.851+0000 7f9ed3400640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9ebc076320 0x7f9ebc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.852+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7f9ed4097910 con 0x7f9edc0c7000 2024-05-09T00:16:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.852+0000 7f9edaa00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9ebc076320 0x7f9ebc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.865+0000 7f9edaa00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9ebc076320 0x7f9ebc078830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00a810 tx=0x7f9ecc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:35.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:35.874+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ed4010070 con 0x7f9edc0c7000 2024-05-09T00:16:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.431+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9edc0ab730 con 0x7f9edc0c7000 2024-05-09T00:16:36.432 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:36.433 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:34.973620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.432+0000 7f9ed3400640 1 -- 172.21.15.114:0/16718146 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5664 (secure 0 0 0) 0x7f9ed4060c50 con 0x7f9edc0c7000 2024-05-09T00:16:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-05-09T00:16:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.437+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9ebc076320 msgr2=0x7f9ebc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.437+0000 7f9ed0c00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9ebc076320 0x7f9ebc078830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00a810 tx=0x7f9ecc008040 comp rx=0 tx=0).stop 2024-05-09T00:16:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.437+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 msgr2=0x7f9edc13fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.437+0000 7f9ed0c00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 0x7f9edc13fab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4007e00 tx=0x7f9ed400d4a0 comp rx=0 tx=0).stop 2024-05-09T00:16:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.438+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 shutdown_connections 2024-05-09T00:16:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.438+0000 7f9ed0c00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9ebc076320 0x7f9ebc078830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.438+0000 7f9ed0c00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9edc0c7000 0x7f9edc13fab0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.438+0000 7f9ed0c00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9edc0c3b00 0x7f9edc14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:36.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.439+0000 7f9ed0c00640 1 --2- 172.21.15.114:0/16718146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9edc06f4c0 0x7f9edc0c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:36.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.439+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 >> 172.21.15.114:0/16718146 conn(0x7f9edc0c92e0 msgr2=0x7f9edc0ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:36.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.439+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 shutdown_connections 2024-05-09T00:16:36.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:36.439+0000 7f9ed0c00640 1 -- 172.21.15.114:0/16718146 wait complete. 2024-05-09T00:16:36.490 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 48, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 48, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5017": { "addr": "172.21.15.153:6835/1232162808", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6834", "nonce": 1232162808, "type": "v2" }, { "addr": "172.21.15.153:6835", "nonce": 1232162808, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5017, "incarnation": 48, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:16:34.973620+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5017 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 41, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4888": { "addr": "172.21.15.114:6837/372512194", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 372512194, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 372512194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4888, "incarnation": 38, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:15:12.953509+0000", "qdb_cluster": [ 4888 ], "qdb_leader": 4888, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4888 } } } ], "standbys": [ { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 31, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:16:38.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:39.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.023+0000 7f777d600640 1 Processor -- start 2024-05-09T00:16:39.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.024+0000 7f777d600640 1 -- start start 2024-05-09T00:16:39.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.027+0000 7f777d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7770046770 0x7f7770047210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:39.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.027+0000 7f777d600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777004a010 con 0x7f77700d4330 2024-05-09T00:16:39.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.027+0000 7f777d600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777002e990 con 0x7f7770007030 2024-05-09T00:16:39.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.027+0000 7f777d600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7770046c40 con 0x7f7770046770 2024-05-09T00:16:39.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.028+0000 7f7777400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7770007030 0x7f7770049900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:48622/0 (socket says 172.21.15.114:48622) 2024-05-09T00:16:39.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.028+0000 7f7777400640 1 -- 172.21.15.114:0/1614173707 learned_addr learned my addr 172.21.15.114:0/1614173707 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:16:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.028+0000 7f7777e00640 1 --2- 172.21.15.114:0/1614173707 >> v2:172.21.15.153:3300/0 conn(0x7f7770046770 0x7f7770047210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.029+0000 7f7777e00640 1 -- 172.21.15.114:0/1614173707 >> v1:172.21.15.153:6789/0 conn(0x7f7770007030 legacy=0x7f7770049900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.029+0000 7f7777e00640 1 -- 172.21.15.114:0/1614173707 >> v1:172.21.15.114:6789/0 conn(0x7f77700d4330 legacy=0x7f777000b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.029+0000 7f7777e00640 1 -- 172.21.15.114:0/1614173707 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7770046490 con 0x7f7770046770 2024-05-09T00:16:39.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.032+0000 7f7777e00640 1 --2- 172.21.15.114:0/1614173707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f7770047210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f776c010ba0 tx=0x7f776c02e620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b7889f47f92ea3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.033+0000 7f7776a00640 1 -- 172.21.15.114:0/1614173707 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c03c070 con 0x7f7770046770 2024-05-09T00:16:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.033+0000 7f7776a00640 1 -- 172.21.15.114:0/1614173707 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c034480 con 0x7f7770046770 2024-05-09T00:16:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.034+0000 7f777d600640 1 -- 172.21.15.114:0/1614173707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 msgr2=0x7f7770047210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.034+0000 7f7776a00640 1 -- 172.21.15.114:0/1614173707 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c03c070 con 0x7f7770046770 2024-05-09T00:16:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.034+0000 7f777d600640 1 --2- 172.21.15.114:0/1614173707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f7770047210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f776c010ba0 tx=0x7f776c02e620 comp rx=0 tx=0).stop 2024-05-09T00:16:39.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.037+0000 7f777d600640 1 -- 172.21.15.114:0/1614173707 shutdown_connections 2024-05-09T00:16:39.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.037+0000 7f777d600640 1 --2- 172.21.15.114:0/1614173707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f7770047210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.037+0000 7f777d600640 1 -- 172.21.15.114:0/1614173707 >> 172.21.15.114:0/1614173707 conn(0x7f7770006090 msgr2=0x7f77700064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:39.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.037+0000 7f777d600640 1 -- 172.21.15.114:0/1614173707 shutdown_connections 2024-05-09T00:16:39.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.037+0000 7f777d600640 1 -- 172.21.15.114:0/1614173707 wait complete. 2024-05-09T00:16:39.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.043+0000 7f777d600640 1 Processor -- start 2024-05-09T00:16:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.044+0000 7f777d600640 1 -- start start 2024-05-09T00:16:39.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.047+0000 7f777d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7770007030 0x7f77700d3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:39.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.047+0000 7f777d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f777016d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:39.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.048+0000 7f777d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77700d4330 0x7f77700cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:39.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.048+0000 7f777d600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f777000b9a0 con 0x7f7770007030 2024-05-09T00:16:39.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.048+0000 7f7777400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f777016d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:39.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.048+0000 7f7777400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f777016d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:40410/0 (socket says 172.21.15.114:40410) 2024-05-09T00:16:39.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.048+0000 7f7777400640 1 -- 172.21.15.114:0/3125104423 learned_addr learned my addr 172.21.15.114:0/3125104423 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:39.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.048+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f77700d79f0 con 0x7f7770046770 2024-05-09T00:16:39.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.049+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f777000bb20 con 0x7f77700d4330 2024-05-09T00:16:39.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.049+0000 7f7777e00640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7770007030 0x7f77700d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:39.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.050+0000 7f7777e00640 1 -- 172.21.15.114:0/3125104423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77700d4330 msgr2=0x7f77700cdff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:16:39.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.050+0000 7f7777e00640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77700d4330 0x7f77700cdff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.050+0000 7f7777e00640 1 -- 172.21.15.114:0/3125104423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 msgr2=0x7f777016d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:39.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.050+0000 7f7777e00640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f777016d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.050+0000 7f7777e00640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77700cf1d0 con 0x7f7770007030 2024-05-09T00:16:39.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.051+0000 7f7777e00640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7770007030 0x7f77700d3220 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7770007470 tx=0x7f776c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:39.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.052+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c046070 con 0x7f7770007030 2024-05-09T00:16:39.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.053+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c034db0 con 0x7f7770007030 2024-05-09T00:16:39.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.053+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77701709a0 con 0x7f7770007030 2024-05-09T00:16:39.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.053+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7770045b70 con 0x7f7770007030 2024-05-09T00:16:39.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.058+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c03c040 con 0x7f7770007030 2024-05-09T00:16:39.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.058+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770005570 con 0x7f7770007030 2024-05-09T00:16:39.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.061+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f776c03f070 con 0x7f7770007030 2024-05-09T00:16:39.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.063+0000 7f776be00640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77580762d0 0x7f77580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.064+0000 7f7777400640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77580762d0 0x7f77580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.068+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7f776c081d30 con 0x7f7770007030 2024-05-09T00:16:39.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.072+0000 7f7777400640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77580762d0 0x7f77580787e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7770031790 tx=0x7f77640060b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.081+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f776c04f030 con 0x7f7770007030 2024-05-09T00:16:39.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.568+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77700074d0 con 0x7f7770007030 2024-05-09T00:16:39.569 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:39.569 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:34.973620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:39.569 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-05-09T00:16:39.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.569+0000 7f776be00640 1 -- 172.21.15.114:0/3125104423 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5664 (secure 0 0 0) 0x7f776c085e40 con 0x7f7770007030 2024-05-09T00:16:39.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.576+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77580762d0 msgr2=0x7f77580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:39.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.576+0000 7f777d600640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77580762d0 0x7f77580787e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7770031790 tx=0x7f77640060b0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.577+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7770007030 msgr2=0x7f77700d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.577+0000 7f777d600640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7770007030 0x7f77700d3220 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7770007470 tx=0x7f776c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 shutdown_connections 2024-05-09T00:16:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f77580762d0 0x7f77580787e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f77700d4330 0x7f77700cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770046770 0x7f777016d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 --2- 172.21.15.114:0/3125104423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7770007030 0x7f77700d3220 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 >> 172.21.15.114:0/3125104423 conn(0x7f7770006090 msgr2=0x7f77700d6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 shutdown_connections 2024-05-09T00:16:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:39.579+0000 7f777d600640 1 -- 172.21.15.114:0/3125104423 wait complete. 2024-05-09T00:16:39.632 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:16:41.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.176+0000 7ff477000640 1 Processor -- start 2024-05-09T00:16:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.176+0000 7ff477000640 1 -- start start 2024-05-09T00:16:42.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.186+0000 7ff475c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff4700c4080 0x7ff47006e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50512/0 (socket says 172.21.15.114:50512) 2024-05-09T00:16:42.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.187+0000 7ff475c00640 1 -- 172.21.15.114:0/3889782196 learned_addr learned my addr 172.21.15.114:0/3889782196 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:16:42.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.187+0000 7ff477000640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:42.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.187+0000 7ff477000640 1 --2- 172.21.15.114:0/3889782196 >> v2:172.21.15.153:3300/0 conn(0x7ff4701589f0 0x7ff47006cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:42.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.187+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff47006ed40 con 0x7ff4700c4080 2024-05-09T00:16:42.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.187+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff470158e00 con 0x7ff4701589f0 2024-05-09T00:16:42.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.187+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff47006dec0 con 0x7ff47008ed30 2024-05-09T00:16:42.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.188+0000 7ff476600640 1 --2- 172.21.15.114:0/3889782196 >> v2:172.21.15.153:3300/0 conn(0x7ff4701589f0 0x7ff47006cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.189+0000 7ff46fe00640 1 -- 172.21.15.114:0/3889782196 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062824367 0 0) 0x7ff47006ed40 con 0x7ff4700c4080 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.189+0000 7ff46fe00640 1 -- 172.21.15.114:0/3889782196 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff458003520 con 0x7ff4700c4080 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.189+0000 7ff475200640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.190+0000 7ff476600640 1 -- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 msgr2=0x7ff4700cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.190+0000 7ff476600640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.190+0000 7ff476600640 1 -- 172.21.15.114:0/3889782196 >> v1:172.21.15.114:6789/0 conn(0x7ff4700c4080 legacy=0x7ff47006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:42.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.190+0000 7ff476600640 1 -- 172.21.15.114:0/3889782196 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4700c8a50 con 0x7ff4701589f0 2024-05-09T00:16:42.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.195+0000 7ff476600640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4701589f0 0x7ff47006cfb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097a0 tx=0x7ff45c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7161c6becef8ecc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.197+0000 7ff46fe00640 1 -- 172.21.15.114:0/3889782196 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c037070 con 0x7ff4701589f0 2024-05-09T00:16:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.197+0000 7ff46fe00640 1 -- 172.21.15.114:0/3889782196 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c032440 con 0x7ff4701589f0 2024-05-09T00:16:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.197+0000 7ff46fe00640 1 -- 172.21.15.114:0/3889782196 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c032810 con 0x7ff4701589f0 2024-05-09T00:16:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.199+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4701589f0 msgr2=0x7ff47006cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.199+0000 7ff477000640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4701589f0 0x7ff47006cfb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097a0 tx=0x7ff45c02a180 comp rx=0 tx=0).stop 2024-05-09T00:16:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.199+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 shutdown_connections 2024-05-09T00:16:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.199+0000 7ff477000640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4701589f0 0x7ff47006cfb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.199+0000 7ff477000640 1 --2- 172.21.15.114:0/3889782196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.199+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 >> 172.21.15.114:0/3889782196 conn(0x7ff4700cd8e0 msgr2=0x7ff4700cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.201+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 shutdown_connections 2024-05-09T00:16:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.201+0000 7ff477000640 1 -- 172.21.15.114:0/3889782196 wait complete. 2024-05-09T00:16:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.206+0000 7ff477000640 1 Processor -- start 2024-05-09T00:16:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.207+0000 7ff477000640 1 -- start start 2024-05-09T00:16:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.210+0000 7ff477000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.211+0000 7ff477000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 0x7ff4701edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.211+0000 7ff477000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4701589f0 0x7ff470157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.212+0000 7ff475200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 0x7ff4701edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.212+0000 7ff475200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 0x7ff4701edfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:40422/0 (socket says 172.21.15.114:40422) 2024-05-09T00:16:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.212+0000 7ff475200640 1 -- 172.21.15.114:0/4221680655 learned_addr learned my addr 172.21.15.114:0/4221680655 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.212+0000 7ff475c00640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.212+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff4700c8330 con 0x7ff4701589f0 2024-05-09T00:16:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.212+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff47006e1a0 con 0x7ff4700c4080 2024-05-09T00:16:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.213+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff47006d4f0 con 0x7ff47008ed30 2024-05-09T00:16:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.213+0000 7ff476600640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4701589f0 0x7ff470157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.217+0000 7ff475200640 1 -- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 msgr2=0x7ff4700c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.217+0000 7ff475200640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.218+0000 7ff475200640 1 -- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4701589f0 msgr2=0x7ff470157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.218+0000 7ff475200640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4701589f0 0x7ff470157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.218+0000 7ff476600640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4701589f0 0x7ff470157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.219+0000 7ff475200640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4701f1ee0 con 0x7ff4700c4080 2024-05-09T00:16:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.219+0000 7ff475200640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 0x7ff4701edfe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff468007ea0 tx=0x7ff468007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.220+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468014620 con 0x7ff4700c4080 2024-05-09T00:16:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.220+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff468019070 con 0x7ff4700c4080 2024-05-09T00:16:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.220+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47015c3e0 con 0x7ff4700c4080 2024-05-09T00:16:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.221+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff470150860 con 0x7ff4700c4080 2024-05-09T00:16:42.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.223+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468014a00 con 0x7ff4700c4080 2024-05-09T00:16:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.229+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44c005290 con 0x7ff4700c4080 2024-05-09T00:16:42.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.230+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff468014ba0 con 0x7ff4700c4080 2024-05-09T00:16:42.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.231+0000 7ff46d600640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff4500763d0 0x7ff4500788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:42.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.232+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7ff468098440 con 0x7ff4700c4080 2024-05-09T00:16:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.233+0000 7ff475c00640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff4500763d0 0x7ff4500788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.235+0000 7ff475c00640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff4500763d0 0x7ff4500788e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff464005880 tx=0x7ff464006aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.245+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff468061710 con 0x7ff4700c4080 2024-05-09T00:16:42.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.751+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff44c005580 con 0x7ff4700c4080 2024-05-09T00:16:42.754 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:42.754 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:34.973620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:42.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.756+0000 7ff46d600640 1 -- 172.21.15.114:0/4221680655 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5664 (secure 0 0 0) 0x7ff468061010 con 0x7ff4700c4080 2024-05-09T00:16:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-05-09T00:16:42.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.759+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff4500763d0 msgr2=0x7ff4500788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:42.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.759+0000 7ff477000640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff4500763d0 0x7ff4500788e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff464005880 tx=0x7ff464006aa0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.759+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 msgr2=0x7ff4701edfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:42.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.759+0000 7ff477000640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 0x7ff4701edfe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff468007ea0 tx=0x7ff468007f90 comp rx=0 tx=0).stop 2024-05-09T00:16:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.761+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 shutdown_connections 2024-05-09T00:16:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.761+0000 7ff477000640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff4500763d0 0x7ff4500788e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.761+0000 7ff477000640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4701589f0 0x7ff470157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.761+0000 7ff477000640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4700c4080 0x7ff4701edfe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.761+0000 7ff477000640 1 --2- 172.21.15.114:0/4221680655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff47008ed30 0x7ff4700c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:42.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.761+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 >> 172.21.15.114:0/4221680655 conn(0x7ff4700cd8e0 msgr2=0x7ff4701e1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:42.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.762+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 shutdown_connections 2024-05-09T00:16:42.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:42.765+0000 7ff477000640 1 -- 172.21.15.114:0/4221680655 wait complete. 2024-05-09T00:16:42.814 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:16:44.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:44.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:16:44.992 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:16:45.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.437+0000 7f7aeb200640 1 Processor -- start 2024-05-09T00:16:45.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.437+0000 7f7aeb200640 1 -- start start 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.441+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0cb7d0 0x7f7aec1639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.441+0000 7f7aeb200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aec158050 con 0x7f7aec06de70 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.441+0000 7f7aeb200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aec158f40 con 0x7f7aec0c8870 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.441+0000 7f7aeb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec1583a0 con 0x7f7aec0cb7d0 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.442+0000 7f7aea800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0cb7d0 0x7f7aec1639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.442+0000 7f7ae9e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7aec0c8870 0x7f7aec158830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:48636/0 (socket says 172.21.15.114:48636) 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.443+0000 7f7ae9e00640 1 -- 172.21.15.114:0/3410411933 learned_addr learned my addr 172.21.15.114:0/3410411933 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.443+0000 7f7aea800640 1 -- 172.21.15.114:0/3410411933 >> v1:172.21.15.153:6789/0 conn(0x7f7aec0c8870 legacy=0x7f7aec158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.444+0000 7f7aea800640 1 -- 172.21.15.114:0/3410411933 >> v1:172.21.15.114:6789/0 conn(0x7f7aec06de70 legacy=0x7f7aec06cc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:16:45.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.444+0000 7f7aea800640 1 -- 172.21.15.114:0/3410411933 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec0c7f70 con 0x7f7aec0cb7d0 2024-05-09T00:16:45.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.450+0000 7f7aea800640 1 --2- 172.21.15.114:0/3410411933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0cb7d0 0x7f7aec1639e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8013050 tx=0x7f7ad8032780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3262e4d32bd7dcc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:45.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.453+0000 7f7ae8a00640 1 -- 172.21.15.114:0/3410411933 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80114e0 con 0x7f7aec0cb7d0 2024-05-09T00:16:45.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.453+0000 7f7ae8a00640 1 -- 172.21.15.114:0/3410411933 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8011680 con 0x7f7aec0cb7d0 2024-05-09T00:16:45.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.454+0000 7f7ae8a00640 1 -- 172.21.15.114:0/3410411933 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800fa70 con 0x7f7aec0cb7d0 2024-05-09T00:16:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.455+0000 7f7aeb200640 1 -- 172.21.15.114:0/3410411933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0cb7d0 msgr2=0x7f7aec1639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.455+0000 7f7aeb200640 1 --2- 172.21.15.114:0/3410411933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0cb7d0 0x7f7aec1639e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8013050 tx=0x7f7ad8032780 comp rx=0 tx=0).stop 2024-05-09T00:16:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.460+0000 7f7aeb200640 1 -- 172.21.15.114:0/3410411933 shutdown_connections 2024-05-09T00:16:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.460+0000 7f7aeb200640 1 --2- 172.21.15.114:0/3410411933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0cb7d0 0x7f7aec1639e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.460+0000 7f7aeb200640 1 -- 172.21.15.114:0/3410411933 >> 172.21.15.114:0/3410411933 conn(0x7f7aec0cd650 msgr2=0x7f7aec0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:45.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.461+0000 7f7aeb200640 1 -- 172.21.15.114:0/3410411933 shutdown_connections 2024-05-09T00:16:45.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.463+0000 7f7aeb200640 1 -- 172.21.15.114:0/3410411933 wait complete. 2024-05-09T00:16:45.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.473+0000 7f7aeb200640 1 Processor -- start 2024-05-09T00:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.473+0000 7f7aeb200640 1 -- start start 2024-05-09T00:16:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.479+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 0x7f7aec1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.480+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0c8870 0x7f7aec148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.480+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aec0cb7d0 0x7f7aec156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.483+0000 7f7aeb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec06d490 con 0x7f7aec06de70 2024-05-09T00:16:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.483+0000 7f7aeb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec06d310 con 0x7f7aec0cb7d0 2024-05-09T00:16:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.483+0000 7f7aeb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec0ccef0 con 0x7f7aec0c8870 2024-05-09T00:16:45.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.483+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 0x7f7aec1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:45.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.484+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 0x7f7aec1522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50506/0 (socket says 172.21.15.114:50506) 2024-05-09T00:16:45.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.484+0000 7f7ae9e00640 1 -- 172.21.15.114:0/350069518 learned_addr learned my addr 172.21.15.114:0/350069518 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.485+0000 7f7ae9e00640 1 -- 172.21.15.114:0/350069518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0c8870 msgr2=0x7f7aec148290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:16:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.485+0000 7f7ae9e00640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0c8870 0x7f7aec148290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.485+0000 7f7ae9e00640 1 -- 172.21.15.114:0/350069518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aec0cb7d0 msgr2=0x7f7aec156aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:16:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.485+0000 7f7ae9e00640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aec0cb7d0 0x7f7aec156aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.485+0000 7f7ae9e00640 1 -- 172.21.15.114:0/350069518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec1eadb0 con 0x7f7aec06de70 2024-05-09T00:16:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.486+0000 7f7ae9e00640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 0x7f7aec1522e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400cbc0 tx=0x7f7ae400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.488+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4017070 con 0x7f7aec06de70 2024-05-09T00:16:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.488+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec1eb090 con 0x7f7aec06de70 2024-05-09T00:16:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.488+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae400aca0 con 0x7f7aec06de70 2024-05-09T00:16:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.490+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4017070 con 0x7f7aec06de70 2024-05-09T00:16:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.493+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec147a90 con 0x7f7aec06de70 2024-05-09T00:16:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.495+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec078350 con 0x7f7aec06de70 2024-05-09T00:16:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.499+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ae401a070 con 0x7f7aec06de70 2024-05-09T00:16:45.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.510+0000 7f7ae2000640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7acc076500 0x7f7acc078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:45.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.510+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7f7ae4097300 con 0x7f7aec06de70 2024-05-09T00:16:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.512+0000 7f7ae9400640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7acc076500 0x7f7acc078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:45.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.519+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ae4060680 con 0x7f7aec06de70 2024-05-09T00:16:45.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.521+0000 7f7ae9400640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7acc076500 0x7f7acc078a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7aec156210 tx=0x7f7adc006b30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:45.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.997+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7aec0c8620 con 0x7f7aec06de70 2024-05-09T00:16:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:45.998+0000 7f7ae2000640 1 -- 172.21.15.114:0/350069518 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5665 (secure 0 0 0) 0x7f7ae405ff80 con 0x7f7aec06de70 2024-05-09T00:16:45.997 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:45.997 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:44.969924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:45.997 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 50 2024-05-09T00:16:46.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.003+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7acc076500 msgr2=0x7f7acc078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:46.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7acc076500 0x7f7acc078a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7aec156210 tx=0x7f7adc006b30 comp rx=0 tx=0).stop 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 msgr2=0x7f7aec1522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 0x7f7aec1522e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400cbc0 tx=0x7f7ae400a060 comp rx=0 tx=0).stop 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 shutdown_connections 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7acc076500 0x7f7acc078a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aec0cb7d0 0x7f7aec156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aec0c8870 0x7f7aec148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 --2- 172.21.15.114:0/350069518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec06de70 0x7f7aec1522e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 >> 172.21.15.114:0/350069518 conn(0x7f7aec0cd650 msgr2=0x7f7aec0acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 shutdown_connections 2024-05-09T00:16:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:46.004+0000 7f7aeb200640 1 -- 172.21.15.114:0/350069518 wait complete. 2024-05-09T00:16:46.049 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:16:46.657 INFO:tasks.ceph.mds.d.smithi153.stderr:2024-05-09T00:16:46.657+0000 7f22d7800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:16:48.049 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:48.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.581+0000 7ff767c00640 1 Processor -- start 2024-05-09T00:16:48.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.581+0000 7ff767c00640 1 -- start start 2024-05-09T00:16:48.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.586+0000 7ff767c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff760072890 0x7ff760159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:48.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.587+0000 7ff767c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff760160600 0x7ff7600c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:48.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.587+0000 7ff767c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76015a190 con 0x7ff760072d50 2024-05-09T00:16:48.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.588+0000 7ff767c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff760160170 con 0x7ff760160600 2024-05-09T00:16:48.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.588+0000 7ff767c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff76015fe20 con 0x7ff760072890 2024-05-09T00:16:48.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.588+0000 7ff765c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff760160600 0x7ff7600c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:48.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.589+0000 7ff765c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff760160600 0x7ff7600c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54210/0 (socket says 172.21.15.114:54210) 2024-05-09T00:16:48.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.589+0000 7ff765c00640 1 -- 172.21.15.114:0/3777314684 learned_addr learned my addr 172.21.15.114:0/3777314684 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:48.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.590+0000 7ff765c00640 1 -- 172.21.15.114:0/3777314684 >> v2:172.21.15.153:3300/0 conn(0x7ff760072890 msgr2=0x7ff760159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:48.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.590+0000 7ff75fe00640 1 --2- 172.21.15.114:0/3777314684 >> v2:172.21.15.153:3300/0 conn(0x7ff760072890 0x7ff760159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:48.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.590+0000 7ff765c00640 1 --2- 172.21.15.114:0/3777314684 >> v2:172.21.15.153:3300/0 conn(0x7ff760072890 0x7ff760159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:48.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.590+0000 7ff765c00640 1 -- 172.21.15.114:0/3777314684 >> v1:172.21.15.114:6789/0 conn(0x7ff760072d50 legacy=0x7ff7600c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:48.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.590+0000 7ff765c00640 1 -- 172.21.15.114:0/3777314684 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76015d1b0 con 0x7ff760160600 2024-05-09T00:16:48.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.590+0000 7ff75fe00640 1 --2- 172.21.15.114:0/3777314684 >> v2:172.21.15.153:3300/0 conn(0x7ff760072890 0x7ff760159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:48.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.597+0000 7ff765c00640 1 --2- 172.21.15.114:0/3777314684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760160600 0x7ff7600c6050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff7601602f0 tx=0x7ff74c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98eb1a088283b9a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:48.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.597+0000 7ff75f400640 1 -- 172.21.15.114:0/3777314684 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c037070 con 0x7ff760160600 2024-05-09T00:16:48.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.597+0000 7ff75f400640 1 -- 172.21.15.114:0/3777314684 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c032440 con 0x7ff760160600 2024-05-09T00:16:48.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.597+0000 7ff75f400640 1 -- 172.21.15.114:0/3777314684 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c032810 con 0x7ff760160600 2024-05-09T00:16:48.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.599+0000 7ff767c00640 1 -- 172.21.15.114:0/3777314684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760160600 msgr2=0x7ff7600c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:48.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.599+0000 7ff767c00640 1 --2- 172.21.15.114:0/3777314684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760160600 0x7ff7600c6050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff7601602f0 tx=0x7ff74c02a130 comp rx=0 tx=0).stop 2024-05-09T00:16:48.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.603+0000 7ff767c00640 1 -- 172.21.15.114:0/3777314684 shutdown_connections 2024-05-09T00:16:48.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.603+0000 7ff767c00640 1 --2- 172.21.15.114:0/3777314684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760160600 0x7ff7600c6050 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:48.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.603+0000 7ff767c00640 1 --2- 172.21.15.114:0/3777314684 >> v2:172.21.15.153:3300/0 conn(0x7ff760072890 0x7ff760159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:48.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.603+0000 7ff767c00640 1 -- 172.21.15.114:0/3777314684 >> 172.21.15.114:0/3777314684 conn(0x7ff76006c680 msgr2=0x7ff76006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:48.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.604+0000 7ff767c00640 1 -- 172.21.15.114:0/3777314684 shutdown_connections 2024-05-09T00:16:48.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.604+0000 7ff767c00640 1 -- 172.21.15.114:0/3777314684 wait complete. 2024-05-09T00:16:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.607+0000 7ff767c00640 1 Processor -- start 2024-05-09T00:16:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.610+0000 7ff767c00640 1 -- start start 2024-05-09T00:16:48.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.614+0000 7ff767c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 0x7ff7601f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:48.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.615+0000 7ff767c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760072d50 0x7ff7601f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:48.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.615+0000 7ff765200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 0x7ff7601f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:48.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.615+0000 7ff765200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 0x7ff7601f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:35788/0 (socket says 172.21.15.114:35788) 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.616+0000 7ff765200640 1 -- 172.21.15.114:0/1077543491 learned_addr learned my addr 172.21.15.114:0/1077543491 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.616+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff760160600 0x7ff760158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.616+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff760160a10 con 0x7ff760072d50 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.616+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7600c42e0 con 0x7ff760072890 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.616+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff760160b90 con 0x7ff760160600 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.617+0000 7ff75fe00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760072d50 0x7ff7601f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:48.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.617+0000 7ff765200640 1 -- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff760160600 msgr2=0x7ff760158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:48.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.617+0000 7ff765200640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff760160600 0x7ff760158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:48.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.617+0000 7ff765200640 1 -- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760072d50 msgr2=0x7ff7601f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:48.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.618+0000 7ff765200640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760072d50 0x7ff7601f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.618+0000 7ff765200640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7601f6a70 con 0x7ff760072890 2024-05-09T00:16:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.618+0000 7ff75fe00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760072d50 0x7ff7601f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:16:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.618+0000 7ff765200640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 0x7ff7601f30a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff75800ba20 tx=0x7ff75800bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.620+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758019070 con 0x7ff760072890 2024-05-09T00:16:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.620+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75800cbe0 con 0x7ff760072890 2024-05-09T00:16:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.620+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758014440 con 0x7ff760072890 2024-05-09T00:16:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.620+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76015f3e0 con 0x7ff760072890 2024-05-09T00:16:48.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.622+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7601f5d30 con 0x7ff760072890 2024-05-09T00:16:48.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.624+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff760077430 con 0x7ff760072890 2024-05-09T00:16:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.630+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff75801c070 con 0x7ff760072890 2024-05-09T00:16:48.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.633+0000 7ff75cc00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff740076320 0x7ff740078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:48.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.633+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7ff758097cc0 con 0x7ff760072890 2024-05-09T00:16:48.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.636+0000 7ff75fe00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff740076320 0x7ff740078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:48.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.640+0000 7ff75fe00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff740076320 0x7ff740078830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff76015e790 tx=0x7ff750008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:48.646+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff758060a40 con 0x7ff760072890 2024-05-09T00:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.189+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7600c4540 con 0x7ff760072890 2024-05-09T00:16:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.192+0000 7ff75cc00640 1 -- 172.21.15.114:0/1077543491 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5672 (secure 0 0 0) 0x7ff758064d40 con 0x7ff760072890 2024-05-09T00:16:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:49.193 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 51 2024-05-09T00:16:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.209+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff740076320 msgr2=0x7ff740078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.209+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff740076320 0x7ff740078830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff76015e790 tx=0x7ff750008040 comp rx=0 tx=0).stop 2024-05-09T00:16:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.209+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 msgr2=0x7ff7601f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.209+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 0x7ff7601f30a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff75800ba20 tx=0x7ff75800bee0 comp rx=0 tx=0).stop 2024-05-09T00:16:49.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.214+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 shutdown_connections 2024-05-09T00:16:49.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.214+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff740076320 0x7ff740078830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:49.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.214+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff760160600 0x7ff760158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:49.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.214+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff760072d50 0x7ff7601f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:49.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.214+0000 7ff767c00640 1 --2- 172.21.15.114:0/1077543491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff760072890 0x7ff7601f30a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:49.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.214+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 >> 172.21.15.114:0/1077543491 conn(0x7ff76006c680 msgr2=0x7ff76015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:49.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.216+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 shutdown_connections 2024-05-09T00:16:49.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:49.216+0000 7ff767c00640 1 -- 172.21.15.114:0/1077543491 wait complete. 2024-05-09T00:16:49.285 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=4960 2024-05-09T00:16:49.285 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.c 2024-05-09T00:16:52.286 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2024-05-09T00:16:52.287 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T00:16:52.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T00:16:52.296 INFO:tasks.ceph.mds.c:Started 2024-05-09T00:16:52.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:16:52.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.787+0000 7fe32a000640 1 Processor -- start 2024-05-09T00:16:52.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.789+0000 7fe32a000640 1 -- start start 2024-05-09T00:16:52.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.794+0000 7fe32a000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe31c0d4600 0x7fe31c04b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:52.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.794+0000 7fe32a000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00bc30 0x7fe31c0d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:52.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.795+0000 7fe323400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe31c0d4600 0x7fe31c04b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:52.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.795+0000 7fe323400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe31c0d4600 0x7fe31c04b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:35812/0 (socket says 172.21.15.114:35812) 2024-05-09T00:16:52.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.795+0000 7fe323400640 1 -- 172.21.15.114:0/4048507121 learned_addr learned my addr 172.21.15.114:0/4048507121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.795+0000 7fe322a00640 1 --2- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00bc30 0x7fe31c0d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.796+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c0db0c0 con 0x7fe31c006d80 2024-05-09T00:16:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.796+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe31c0319d0 con 0x7fe31c0d4600 2024-05-09T00:16:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.796+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c031260 con 0x7fe31c00bc30 2024-05-09T00:16:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.798+0000 7fe322000640 1 -- 172.21.15.114:0/4048507121 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856850904 0 0) 0x7fe31c0db0c0 con 0x7fe31c006d80 2024-05-09T00:16:52.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.799+0000 7fe323400640 1 -- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00bc30 msgr2=0x7fe31c0d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:16:52.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.799+0000 7fe323400640 1 --2- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00bc30 0x7fe31c0d6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:52.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.799+0000 7fe323400640 1 -- 172.21.15.114:0/4048507121 >> v1:172.21.15.114:6789/0 conn(0x7fe31c006d80 legacy=0x7fe31c049ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:52.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.799+0000 7fe323400640 1 -- 172.21.15.114:0/4048507121 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c0dad50 con 0x7fe31c0d4600 2024-05-09T00:16:52.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.802+0000 7fe323400640 1 --2- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c0d4600 0x7fe31c04b560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe318009870 tx=0x7fe31802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b66d2a7c9859ccb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.803+0000 7fe322000640 1 -- 172.21.15.114:0/4048507121 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318037070 con 0x7fe31c0d4600 2024-05-09T00:16:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.803+0000 7fe322000640 1 -- 172.21.15.114:0/4048507121 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe318032440 con 0x7fe31c0d4600 2024-05-09T00:16:52.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.803+0000 7fe322000640 1 -- 172.21.15.114:0/4048507121 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318037070 con 0x7fe31c0d4600 2024-05-09T00:16:52.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.805+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c0d4600 msgr2=0x7fe31c04b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:52.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.805+0000 7fe32a000640 1 --2- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c0d4600 0x7fe31c04b560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe318009870 tx=0x7fe31802a180 comp rx=0 tx=0).stop 2024-05-09T00:16:52.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.806+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 shutdown_connections 2024-05-09T00:16:52.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.806+0000 7fe32a000640 1 --2- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00bc30 0x7fe31c0d6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:52.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.806+0000 7fe32a000640 1 --2- 172.21.15.114:0/4048507121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c0d4600 0x7fe31c04b560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:52.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.806+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 >> 172.21.15.114:0/4048507121 conn(0x7fe31c006260 msgr2=0x7fe31c006670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:52.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.807+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 shutdown_connections 2024-05-09T00:16:52.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.807+0000 7fe32a000640 1 -- 172.21.15.114:0/4048507121 wait complete. 2024-05-09T00:16:52.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.811+0000 7fe32a000640 1 Processor -- start 2024-05-09T00:16:52.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.812+0000 7fe32a000640 1 -- start start 2024-05-09T00:16:52.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.814+0000 7fe32a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c006d80 0x7fe31c16c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:52.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.814+0000 7fe32a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 0x7fe31c03f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:52.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.814+0000 7fe32a000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00b5c0 0x7fe31c1706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:52.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.814+0000 7fe32a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c048470 con 0x7fe31c00bc30 2024-05-09T00:16:52.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.814+0000 7fe32a000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0482f0 con 0x7fe31c006d80 2024-05-09T00:16:52.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.814+0000 7fe32a000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c0d7190 con 0x7fe31c00b5c0 2024-05-09T00:16:52.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.815+0000 7fe322a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 0x7fe31c03f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:52.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.816+0000 7fe322a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 0x7fe31c03f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54244/0 (socket says 172.21.15.114:54244) 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.816+0000 7fe322a00640 1 -- 172.21.15.114:0/3183443114 learned_addr learned my addr 172.21.15.114:0/3183443114 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.816+0000 7fe328a00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00b5c0 0x7fe31c1706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.817+0000 7fe322a00640 1 -- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00b5c0 msgr2=0x7fe31c1706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.817+0000 7fe322a00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00b5c0 0x7fe31c1706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.818+0000 7fe323400640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c006d80 0x7fe31c16c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.818+0000 7fe322a00640 1 -- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c006d80 msgr2=0x7fe31c16c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:52.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.818+0000 7fe322a00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c006d80 0x7fe31c16c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:52.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.818+0000 7fe322a00640 1 -- 172.21.15.114:0/3183443114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c0d2370 con 0x7fe31c00bc30 2024-05-09T00:16:52.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.818+0000 7fe323400640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c006d80 0x7fe31c16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:52.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.819+0000 7fe322a00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 0x7fe31c03f8e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe31000e8a0 tx=0x7fe31000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:52.818 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-05-09T00:16:52.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.819+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310017070 con 0x7fe31c00bc30 2024-05-09T00:16:52.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.820+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31000ee90 con 0x7fe31c00bc30 2024-05-09T00:16:52.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.820+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31000cb60 con 0x7fe31c00bc30 2024-05-09T00:16:52.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.822+0000 7fe32a000640 1 -- 172.21.15.114:0/3183443114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c0d2650 con 0x7fe31c00bc30 2024-05-09T00:16:52.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.823+0000 7fe32a000640 1 -- 172.21.15.114:0/3183443114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c0d29b0 con 0x7fe31c00bc30 2024-05-09T00:16:52.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.826+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c005740 con 0x7fe31c00bc30 2024-05-09T00:16:52.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.829+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe31001a070 con 0x7fe31c00bc30 2024-05-09T00:16:52.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.831+0000 7fe317400640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe304076300 0x7fe304078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:16:52.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.831+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7fe310097d50 con 0x7fe31c00bc30 2024-05-09T00:16:52.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.835+0000 7fe323400640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe304076300 0x7fe304078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.839+0000 7fe323400640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe304076300 0x7fe304078810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe318034000 tx=0x7fe31802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:52.844+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe3100609e0 con 0x7fe31c00bc30 2024-05-09T00:16:53.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.356+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31c007990 con 0x7fe31c00bc30 2024-05-09T00:16:53.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.361+0000 7fe317400640 1 -- 172.21.15.114:0/3183443114 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7fe310064ce0 con 0x7fe31c00bc30 2024-05-09T00:16:53.363 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:16:53.365 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:16:53.368 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:16:53.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.371+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe304076300 msgr2=0x7fe304078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:53.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.371+0000 7fe314c00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe304076300 0x7fe304078810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe318034000 tx=0x7fe31802e000 comp rx=0 tx=0).stop 2024-05-09T00:16:53.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.371+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 msgr2=0x7fe31c03f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:53.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.371+0000 7fe314c00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 0x7fe31c03f8e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe31000e8a0 tx=0x7fe31000ed60 comp rx=0 tx=0).stop 2024-05-09T00:16:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.374+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 shutdown_connections 2024-05-09T00:16:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.374+0000 7fe314c00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe304076300 0x7fe304078810 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.374+0000 7fe314c00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe31c00b5c0 0x7fe31c1706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.374+0000 7fe314c00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31c00bc30 0x7fe31c03f8e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.374+0000 7fe314c00640 1 --2- 172.21.15.114:0/3183443114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe31c006d80 0x7fe31c16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:16:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.374+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 >> 172.21.15.114:0/3183443114 conn(0x7fe31c006260 msgr2=0x7fe31c00a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:53.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.380+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 shutdown_connections 2024-05-09T00:16:53.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:16:53.380+0000 7fe314c00640 1 -- 172.21.15.114:0/3183443114 wait complete. 2024-05-09T00:16:53.432 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2024-05-09T00:16:53.432 INFO:tasks.mds_thrash.fs.[a]:waiting for 78 secs before thrashing 2024-05-09T00:17:09.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:09.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.792+0000 7f1b2e000640 1 Processor -- start 2024-05-09T00:17:09.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.792+0000 7f1b2e000640 1 -- start start 2024-05-09T00:17:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.795+0000 7f1b2e000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b280c31b0 0x7f1b28158e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.795+0000 7f1b2e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280740e0 0x7f1b280c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.796+0000 7f1b27400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b280c31b0 0x7f1b28158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.796+0000 7f1b27400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b280c31b0 0x7f1b28158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:34774/0 (socket says 172.21.15.114:34774) 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.799+0000 7f1b27400640 1 -- 172.21.15.114:0/3172423092 learned_addr learned my addr 172.21.15.114:0/3172423092 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.796+0000 7f1b26a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1b280735c0 0x7f1b280739d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38404/0 (socket says 172.21.15.114:38404) 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.799+0000 7f1b27e00640 1 --2- 172.21.15.114:0/3172423092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280740e0 0x7f1b280c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.799+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b28159340 con 0x7f1b280735c0 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.799+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2815c620 con 0x7f1b280c31b0 2024-05-09T00:17:09.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.799+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2815ba10 con 0x7f1b280740e0 2024-05-09T00:17:09.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.799+0000 7f1b27e00640 1 -- 172.21.15.114:0/3172423092 >> v2:172.21.15.153:3300/0 conn(0x7f1b280c31b0 msgr2=0x7f1b28158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:09.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.800+0000 7f1b27e00640 1 --2- 172.21.15.114:0/3172423092 >> v2:172.21.15.153:3300/0 conn(0x7f1b280c31b0 0x7f1b28158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:09.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.800+0000 7f1b27e00640 1 -- 172.21.15.114:0/3172423092 >> v1:172.21.15.114:6789/0 conn(0x7f1b280735c0 legacy=0x7f1b280739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.800+0000 7f1b27e00640 1 -- 172.21.15.114:0/3172423092 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2815bcf0 con 0x7f1b280740e0 2024-05-09T00:17:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.808+0000 7f1b27e00640 1 --2- 172.21.15.114:0/3172423092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280740e0 0x7f1b280c5a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b140097a0 tx=0x7f1b1402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b7bdbc41366319 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:09.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.808+0000 7f1b26000640 1 -- 172.21.15.114:0/3172423092 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14037070 con 0x7f1b280740e0 2024-05-09T00:17:09.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.810+0000 7f1b26000640 1 -- 172.21.15.114:0/3172423092 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b14032440 con 0x7f1b280740e0 2024-05-09T00:17:09.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.811+0000 7f1b26000640 1 -- 172.21.15.114:0/3172423092 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14032810 con 0x7f1b280740e0 2024-05-09T00:17:09.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.817+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280740e0 msgr2=0x7f1b280c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:09.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.818+0000 7f1b2e000640 1 --2- 172.21.15.114:0/3172423092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280740e0 0x7f1b280c5a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b140097a0 tx=0x7f1b1402a180 comp rx=0 tx=0).stop 2024-05-09T00:17:09.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.822+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 shutdown_connections 2024-05-09T00:17:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.822+0000 7f1b2e000640 1 --2- 172.21.15.114:0/3172423092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280740e0 0x7f1b280c5a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.822+0000 7f1b2e000640 1 --2- 172.21.15.114:0/3172423092 >> v2:172.21.15.153:3300/0 conn(0x7f1b280c31b0 0x7f1b28158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.822+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 >> 172.21.15.114:0/3172423092 conn(0x7f1b2806c680 msgr2=0x7f1b2806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.823+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 shutdown_connections 2024-05-09T00:17:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.824+0000 7f1b2e000640 1 -- 172.21.15.114:0/3172423092 wait complete. 2024-05-09T00:17:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.830+0000 7f1b2e000640 1 Processor -- start 2024-05-09T00:17:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.832+0000 7f1b2e000640 1 -- start start 2024-05-09T00:17:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.848+0000 7f1b2e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 0x7f1b281573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b2e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b280c31b0 0x7f1b281f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b2e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b280c2050 0x7f1b281f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b2e000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280c5fd0 con 0x7f1b280c31b0 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b2e000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2815c2b0 con 0x7f1b280c2050 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b2e000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280c6150 con 0x7f1b280735c0 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b27400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 0x7f1b281573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b27400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 0x7f1b281573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:48098/0 (socket says 172.21.15.114:48098) 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.849+0000 7f1b27400640 1 -- 172.21.15.114:0/77291392 learned_addr learned my addr 172.21.15.114:0/77291392 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.851+0000 7f1b27400640 1 -- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b280c2050 msgr2=0x7f1b281f2c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.851+0000 7f1b27400640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b280c2050 0x7f1b281f2c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.851+0000 7f1b27400640 1 -- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b280c31b0 msgr2=0x7f1b281f2700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.851+0000 7f1b27400640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b280c31b0 0x7f1b281f2700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.851+0000 7f1b27400640 1 -- 172.21.15.114:0/77291392 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b280af2c0 con 0x7f1b280735c0 2024-05-09T00:17:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.852+0000 7f1b27400640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 0x7f1b281573a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009c90 tx=0x7f1b2000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.853+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000cda0 con 0x7f1b280735c0 2024-05-09T00:17:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.853+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b20019070 con 0x7f1b280735c0 2024-05-09T00:17:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.853+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b200146c0 con 0x7f1b280735c0 2024-05-09T00:17:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.859+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b280adf70 con 0x7f1b280735c0 2024-05-09T00:17:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.859+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b281f31d0 con 0x7f1b280735c0 2024-05-09T00:17:09.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.869+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b20005d10 con 0x7f1b280735c0 2024-05-09T00:17:09.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.871+0000 7f1b1f400640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b08076350 0x7f1b08078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:09.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.873+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b28077430 con 0x7f1b280735c0 2024-05-09T00:17:09.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.874+0000 7f1b26a00640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b08076350 0x7f1b08078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.876+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7f1b2005d1a0 con 0x7f1b280735c0 2024-05-09T00:17:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.876+0000 7f1b26a00640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b08076350 0x7f1b08078860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000f60 tx=0x7f1b18007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:09.889+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b20010040 con 0x7f1b280735c0 2024-05-09T00:17:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.549+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b280c2f90 con 0x7f1b280735c0 2024-05-09T00:17:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.553+0000 7f1b1f400640 1 -- 172.21.15.114:0/77291392 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7f1b200612b0 con 0x7f1b280735c0 2024-05-09T00:17:10.553 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:10.553 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:17:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b08076350 msgr2=0x7f1b08078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b08076350 0x7f1b08078860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000f60 tx=0x7f1b18007a00 comp rx=0 tx=0).stop 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 msgr2=0x7f1b281573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 0x7f1b281573a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009c90 tx=0x7f1b2000c490 comp rx=0 tx=0).stop 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 shutdown_connections 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1b08076350 0x7f1b08078860 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000f60 tx=0x7f1b18007a00 comp rx=0 tx=0).stop 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b280c2050 0x7f1b281f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b280c31b0 0x7f1b281f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.565+0000 7f1b2e000640 1 --2- 172.21.15.114:0/77291392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b280735c0 0x7f1b281573a0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009c90 tx=0x7f1b2000c490 comp rx=0 tx=0).stop 2024-05-09T00:17:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.566+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 >> 172.21.15.114:0/77291392 conn(0x7f1b2806c680 msgr2=0x7f1b28075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.574+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 shutdown_connections 2024-05-09T00:17:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:10.576+0000 7f1b2e000640 1 -- 172.21.15.114:0/77291392 wait complete. 2024-05-09T00:17:10.629 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2024-05-09T00:17:10.630 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T00:17:10.630 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:17:10.704 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T00:17:10.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:11.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.189+0000 7fe734e00640 1 Processor -- start 2024-05-09T00:17:11.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.191+0000 7fe734e00640 1 -- start start 2024-05-09T00:17:11.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.193+0000 7fe734e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe730155990 0x7fe730158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.194+0000 7fe734e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73015bad0 con 0x7fe7300c8a40 2024-05-09T00:17:11.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.194+0000 7fe734e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73015bdb0 con 0x7fe7300cbc00 2024-05-09T00:17:11.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.194+0000 7fe734e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe730159360 con 0x7fe730155990 2024-05-09T00:17:11.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.194+0000 7fe72de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe7300c8a40 0x7fe7300af240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38420/0 (socket says 172.21.15.114:38420) 2024-05-09T00:17:11.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.194+0000 7fe72de00640 1 -- 172.21.15.114:0/4270793420 learned_addr learned my addr 172.21.15.114:0/4270793420 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.196+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519861622 0 0) 0x7fe73015bad0 con 0x7fe7300c8a40 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.196+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe714003520 con 0x7fe7300c8a40 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140981321 0 0) 0x7fe73015bdb0 con 0x7fe7300cbc00 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe73015bad0 con 0x7fe7300cbc00 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1782897646 0 0) 0x7fe714003520 con 0x7fe7300c8a40 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe730155990 msgr2=0x7fe730158e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe730155990 0x7fe730158e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 >> v1:172.21.15.153:6789/0 conn(0x7fe7300cbc00 legacy=0x7fe7300cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73015c090 con 0x7fe7300c8a40 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fe7200016f0 con 0x7fe7300c8a40 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 >> v1:172.21.15.114:6789/0 conn(0x7fe7300c8a40 legacy=0x7fe7300af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe714004d10 0x7fe714005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140037a0 0x7fe714003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140099b0 0x7fe71400bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe730159360 con 0x7fe714004d10 2024-05-09T00:17:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe71400c440 con 0x7fe7140099b0 2024-05-09T00:17:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.197+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe71400c640 con 0x7fe7140037a0 2024-05-09T00:17:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.198+0000 7fe72e800640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140099b0 0x7fe71400bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.198+0000 7fe72de00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe714004d10 0x7fe714005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.199+0000 7fe72de00640 1 -- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140037a0 msgr2=0x7fe714003c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:17:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.199+0000 7fe72de00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7140037a0 0x7fe714003c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.199+0000 7fe72de00640 1 -- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140099b0 msgr2=0x7fe71400bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.199+0000 7fe72de00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7140099b0 0x7fe71400bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.199+0000 7fe72de00640 1 -- 172.21.15.114:0/4270793420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe714003520 con 0x7fe714004d10 2024-05-09T00:17:11.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.203+0000 7fe72de00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe714004d10 0x7fe714005160 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe720007fd0 tx=0x7fe714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b681bda32725c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:11.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.204+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720007c20 con 0x7fe714004d10 2024-05-09T00:17:11.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.204+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720005ad0 con 0x7fe714004d10 2024-05-09T00:17:11.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.204+0000 7fe72ca00640 1 -- 172.21.15.114:0/4270793420 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720007070 con 0x7fe714004d10 2024-05-09T00:17:11.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.205+0000 7fe734e00640 1 -- 172.21.15.114:0/4270793420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe714004d10 msgr2=0x7fe714005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.205+0000 7fe734e00640 1 --2- 172.21.15.114:0/4270793420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe714004d10 0x7fe714005160 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe720007fd0 tx=0x7fe714005830 comp rx=0 tx=0).stop 2024-05-09T00:17:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.205+0000 7fe72e800640 1 -- 172.21.15.114:0/4270793420 reap_dead start 2024-05-09T00:17:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.205+0000 7fe734e00640 1 -- 172.21.15.114:0/4270793420 shutdown_connections 2024-05-09T00:17:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.205+0000 7fe734e00640 1 -- 172.21.15.114:0/4270793420 >> 172.21.15.114:0/4270793420 conn(0x7fe730068fd0 msgr2=0x7fe7300cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.207+0000 7fe734e00640 1 -- 172.21.15.114:0/4270793420 shutdown_connections 2024-05-09T00:17:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.207+0000 7fe734e00640 1 -- 172.21.15.114:0/4270793420 wait complete. 2024-05-09T00:17:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.213+0000 7fe734e00640 1 Processor -- start 2024-05-09T00:17:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.214+0000 7fe734e00640 1 -- start start 2024-05-09T00:17:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.216+0000 7fe734e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe714004d10 0x7fe7300726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.218+0000 7fe734e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 0x7fe7301569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.218+0000 7fe734e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe730156f20 0x7fe730153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.218+0000 7fe734e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe730155da0 con 0x7fe730156f20 2024-05-09T00:17:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.218+0000 7fe734e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe73015c650 con 0x7fe730073300 2024-05-09T00:17:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.218+0000 7fe734e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe7300af950 con 0x7fe714004d10 2024-05-09T00:17:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.219+0000 7fe72d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 0x7fe7301569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.219+0000 7fe72d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 0x7fe7301569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:34788/0 (socket says 172.21.15.114:34788) 2024-05-09T00:17:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.219+0000 7fe72d400640 1 -- 172.21.15.114:0/2416147986 learned_addr learned my addr 172.21.15.114:0/2416147986 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72d400640 1 -- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe714004d10 msgr2=0x7fe7300726f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72d400640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe714004d10 0x7fe7300726f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72d400640 1 -- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe730156f20 msgr2=0x7fe730153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72e800640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe730156f20 0x7fe730153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72d400640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe730156f20 0x7fe730153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72d400640 1 -- 172.21.15.114:0/2416147986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe730073aa0 con 0x7fe730073300 2024-05-09T00:17:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.221+0000 7fe72e800640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe730156f20 0x7fe730153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:11.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.226+0000 7fe72d400640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 0x7fe7301569e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b470 tx=0x7fe71c00b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:11.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.226+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011830 con 0x7fe730073300 2024-05-09T00:17:11.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.226+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7300c2d60 con 0x7fe730073300 2024-05-09T00:17:11.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.227+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7300c3320 con 0x7fe730073300 2024-05-09T00:17:11.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.229+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe730077430 con 0x7fe730073300 2024-05-09T00:17:11.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.231+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c016070 con 0x7fe730073300 2024-05-09T00:17:11.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.231+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011830 con 0x7fe730073300 2024-05-09T00:17:11.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.247+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe71c0119d0 con 0x7fe730073300 2024-05-09T00:17:11.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.250+0000 7fe726000640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe710076700 0x7fe710078c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:11.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.255+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7fe71c011630 con 0x7fe730073300 2024-05-09T00:17:11.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.257+0000 7fe72de00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe710076700 0x7fe710078c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:11.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.258+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe71c098130 con 0x7fe730073300 2024-05-09T00:17:11.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.261+0000 7fe72de00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe710076700 0x7fe710078c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe720032000 tx=0x7fe72002d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.798+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7300cb8e0 con 0x7fe730073300 2024-05-09T00:17:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.801+0000 7fe726000640 1 -- 172.21.15.114:0/2416147986 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7fe71c061190 con 0x7fe730073300 2024-05-09T00:17:11.801 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:11.801 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:17:11.802 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:17:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe710076700 msgr2=0x7fe710078c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe710076700 0x7fe710078c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe720032000 tx=0x7fe72002d000 comp rx=0 tx=0).stop 2024-05-09T00:17:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 msgr2=0x7fe7301569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 0x7fe7301569e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b470 tx=0x7fe71c00b930 comp rx=0 tx=0).stop 2024-05-09T00:17:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 shutdown_connections 2024-05-09T00:17:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe710076700 0x7fe710078c10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe730156f20 0x7fe730153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe730073300 0x7fe7301569e0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b470 tx=0x7fe71c00b930 comp rx=0 tx=0).stop 2024-05-09T00:17:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 --2- 172.21.15.114:0/2416147986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe714004d10 0x7fe7300726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.807+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 >> 172.21.15.114:0/2416147986 conn(0x7fe730068fd0 msgr2=0x7fe73015acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.810+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 shutdown_connections 2024-05-09T00:17:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:11.810+0000 7fe734e00640 1 -- 172.21.15.114:0/2416147986 wait complete. 2024-05-09T00:17:11.865 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:17:13.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:14.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.335+0000 7fb9bee00640 1 Processor -- start 2024-05-09T00:17:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.336+0000 7fb9bee00640 1 -- start start 2024-05-09T00:17:14.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.341+0000 7fb9bee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b806eb60 0x7fb9b815fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:14.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.341+0000 7fb9bee00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9b8156680 0x7fb9b8160060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.343+0000 7fb9bee00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b806e200 con 0x7fb9b80c3d10 2024-05-09T00:17:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.343+0000 7fb9bee00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b806fc30 con 0x7fb9b8156680 2024-05-09T00:17:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.343+0000 7fb9bee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b8072cf0 con 0x7fb9b806eb60 2024-05-09T00:17:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.344+0000 7fb9bce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb9b80c3d10 0x7fb9b80c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38424/0 (socket says 172.21.15.114:38424) 2024-05-09T00:17:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.344+0000 7fb9bce00640 1 -- 172.21.15.114:0/1278627395 learned_addr learned my addr 172.21.15.114:0/1278627395 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:17:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.344+0000 7fb9b7400640 1 --2- 172.21.15.114:0/1278627395 >> v2:172.21.15.114:3300/0 conn(0x7fb9b8156680 0x7fb9b8160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:14.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.346+0000 7fb9b7e00640 1 --2- 172.21.15.114:0/1278627395 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b806eb60 0x7fb9b815fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:14.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.347+0000 7fb9b7400640 1 -- 172.21.15.114:0/1278627395 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b806eb60 msgr2=0x7fb9b815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:14.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.347+0000 7fb9b6a00640 1 -- 172.21.15.114:0/1278627395 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584573556 0 0) 0x7fb9b806e200 con 0x7fb9b80c3d10 2024-05-09T00:17:14.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.347+0000 7fb9b7400640 1 --2- 172.21.15.114:0/1278627395 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b806eb60 0x7fb9b815fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.347+0000 7fb9b7400640 1 -- 172.21.15.114:0/1278627395 >> v1:172.21.15.114:6789/0 conn(0x7fb9b80c3d10 legacy=0x7fb9b80c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.348+0000 7fb9b7400640 1 -- 172.21.15.114:0/1278627395 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b8072fd0 con 0x7fb9b8156680 2024-05-09T00:17:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.351+0000 7fb9b7400640 1 --2- 172.21.15.114:0/1278627395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8156680 0x7fb9b8160060 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb9b806fdb0 tx=0x7fb9a402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ee7fee2e6a17ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.352+0000 7fb9b6a00640 1 -- 172.21.15.114:0/1278627395 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4037070 con 0x7fb9b8156680 2024-05-09T00:17:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.353+0000 7fb9b6a00640 1 -- 172.21.15.114:0/1278627395 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a402ae50 con 0x7fb9b8156680 2024-05-09T00:17:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.353+0000 7fb9b6a00640 1 -- 172.21.15.114:0/1278627395 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4032660 con 0x7fb9b8156680 2024-05-09T00:17:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.355+0000 7fb9bee00640 1 -- 172.21.15.114:0/1278627395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8156680 msgr2=0x7fb9b8160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.355+0000 7fb9bee00640 1 --2- 172.21.15.114:0/1278627395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8156680 0x7fb9b8160060 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb9b806fdb0 tx=0x7fb9a402a100 comp rx=0 tx=0).stop 2024-05-09T00:17:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.357+0000 7fb9bee00640 1 -- 172.21.15.114:0/1278627395 shutdown_connections 2024-05-09T00:17:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.357+0000 7fb9bee00640 1 --2- 172.21.15.114:0/1278627395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8156680 0x7fb9b8160060 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.357+0000 7fb9bee00640 1 --2- 172.21.15.114:0/1278627395 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b806eb60 0x7fb9b815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.357+0000 7fb9bee00640 1 -- 172.21.15.114:0/1278627395 >> 172.21.15.114:0/1278627395 conn(0x7fb9b80c9310 msgr2=0x7fb9b80c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.358+0000 7fb9bee00640 1 -- 172.21.15.114:0/1278627395 shutdown_connections 2024-05-09T00:17:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.358+0000 7fb9bee00640 1 -- 172.21.15.114:0/1278627395 wait complete. 2024-05-09T00:17:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.364+0000 7fb9bee00640 1 Processor -- start 2024-05-09T00:17:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.364+0000 7fb9bee00640 1 -- start start 2024-05-09T00:17:14.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.368+0000 7fb9bee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 0x7fb9b8150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:14.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.369+0000 7fb9bee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b80c3d10 0x7fb9b815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.369+0000 7fb9bee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9b8156680 0x7fb9b80adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9bee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b80c4830 con 0x7fb9b806eb60 2024-05-09T00:17:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 0x7fb9b8150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 0x7fb9b8150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42606/0 (socket says 172.21.15.114:42606) 2024-05-09T00:17:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9b7e00640 1 -- 172.21.15.114:0/2121057548 learned_addr learned my addr 172.21.15.114:0/2121057548 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b81605a0 con 0x7fb9b8156680 2024-05-09T00:17:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b80727a0 con 0x7fb9b80c3d10 2024-05-09T00:17:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.370+0000 7fb9bce00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9b8156680 0x7fb9b80adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.371+0000 7fb9b7400640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b80c3d10 0x7fb9b815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.371+0000 7fb9b7e00640 1 -- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b80c3d10 msgr2=0x7fb9b815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.371+0000 7fb9b7e00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b80c3d10 0x7fb9b815cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.371+0000 7fb9b7e00640 1 -- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9b8156680 msgr2=0x7fb9b80adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.371+0000 7fb9b7e00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9b8156680 0x7fb9b80adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.371+0000 7fb9b7e00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b81512c0 con 0x7fb9b806eb60 2024-05-09T00:17:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.372+0000 7fb9b7e00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 0x7fb9b8150ae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800d5d0 tx=0x7fb9a800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.373+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8004240 con 0x7fb9b806eb60 2024-05-09T00:17:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.373+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a80043e0 con 0x7fb9b806eb60 2024-05-09T00:17:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.373+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8003810 con 0x7fb9b806eb60 2024-05-09T00:17:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.373+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b8158320 con 0x7fb9b806eb60 2024-05-09T00:17:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.373+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b81588e0 con 0x7fb9b806eb60 2024-05-09T00:17:14.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.379+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb9a80039b0 con 0x7fb9b806eb60 2024-05-09T00:17:14.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.381+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b8078430 con 0x7fb9b806eb60 2024-05-09T00:17:14.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.382+0000 7fb9afe00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9980762d0 0x7fb9980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:14.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.383+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7fb9a80980a0 con 0x7fb9b806eb60 2024-05-09T00:17:14.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.386+0000 7fb9b7400640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9980762d0 0x7fb9980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:14.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.392+0000 7fb9b7400640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9980762d0 0x7fb9980787e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4034000 tx=0x7fb9a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:14.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:14.393+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb9a8061260 con 0x7fb9b806eb60 2024-05-09T00:17:15.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.045+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9b806f000 con 0x7fb9b806eb60 2024-05-09T00:17:15.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.048+0000 7fb9afe00640 1 -- 172.21.15.114:0/2121057548 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7fb9a8061260 con 0x7fb9b806eb60 2024-05-09T00:17:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:15.056 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:17:15.056 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:17:15.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.060+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9980762d0 msgr2=0x7fb9980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:15.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.060+0000 7fb9bee00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9980762d0 0x7fb9980787e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4034000 tx=0x7fb9a402e000 comp rx=0 tx=0).stop 2024-05-09T00:17:15.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.060+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 msgr2=0x7fb9b8150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.060+0000 7fb9bee00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 0x7fb9b8150ae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800d5d0 tx=0x7fb9a800da90 comp rx=0 tx=0).stop 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.061+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 shutdown_connections 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.061+0000 7fb9bee00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9980762d0 0x7fb9980787e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.061+0000 7fb9bee00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9b8156680 0x7fb9b80adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.061+0000 7fb9bee00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9b80c3d10 0x7fb9b815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.061+0000 7fb9bee00640 1 --2- 172.21.15.114:0/2121057548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b806eb60 0x7fb9b8150ae0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.061+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 >> 172.21.15.114:0/2121057548 conn(0x7fb9b80c9310 msgr2=0x7fb9b8153830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:15.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.063+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 shutdown_connections 2024-05-09T00:17:15.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:15.063+0000 7fb9bee00640 1 -- 172.21.15.114:0/2121057548 wait complete. 2024-05-09T00:17:15.115 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:17:15.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:17:15.367 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:17:17.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:17.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.618+0000 7fb100a00640 1 Processor -- start 2024-05-09T00:17:17.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.618+0000 7fb100a00640 1 -- start start 2024-05-09T00:17:17.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.623+0000 7fb100a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc072d50 0x7fb0fc0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.624+0000 7fb100a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0fc072890 0x7fb0fc159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.625+0000 7fb100a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0fc0c4ca0 con 0x7fb0fc160600 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.625+0000 7fb100a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb0fc160170 con 0x7fb0fc072890 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.625+0000 7fb100a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0fc15a190 con 0x7fb0fc072d50 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.626+0000 7fb0f9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0fc072890 0x7fb0fc159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.626+0000 7fb0f9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0fc072890 0x7fb0fc159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42612/0 (socket says 172.21.15.114:42612) 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.626+0000 7fb0f9400640 1 -- 172.21.15.114:0/1988449238 learned_addr learned my addr 172.21.15.114:0/1988449238 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.626+0000 7fb0f9e00640 1 --2- 172.21.15.114:0/1988449238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc072d50 0x7fb0fc0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.627+0000 7fb0f9400640 1 -- 172.21.15.114:0/1988449238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc072d50 msgr2=0x7fb0fc0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.627+0000 7fb0f9400640 1 --2- 172.21.15.114:0/1988449238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc072d50 0x7fb0fc0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.627+0000 7fb0f9400640 1 -- 172.21.15.114:0/1988449238 >> v1:172.21.15.114:6789/0 conn(0x7fb0fc160600 legacy=0x7fb0fc0c6050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:17:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.627+0000 7fb0f9400640 1 -- 172.21.15.114:0/1988449238 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0fc15fe20 con 0x7fb0fc072890 2024-05-09T00:17:17.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.629+0000 7fb0f9400640 1 --2- 172.21.15.114:0/1988449238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072890 0x7fb0fc159c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5cc6032a288d87 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:17.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.630+0000 7fb0f8a00640 1 -- 172.21.15.114:0/1988449238 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8037070 con 0x7fb0fc072890 2024-05-09T00:17:17.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.630+0000 7fb0f8a00640 1 -- 172.21.15.114:0/1988449238 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e8032440 con 0x7fb0fc072890 2024-05-09T00:17:17.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.630+0000 7fb0f8a00640 1 -- 172.21.15.114:0/1988449238 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80327f0 con 0x7fb0fc072890 2024-05-09T00:17:17.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.631+0000 7fb100a00640 1 -- 172.21.15.114:0/1988449238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072890 msgr2=0x7fb0fc159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:17.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.631+0000 7fb100a00640 1 --2- 172.21.15.114:0/1988449238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072890 0x7fb0fc159c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e802a150 comp rx=0 tx=0).stop 2024-05-09T00:17:17.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.631+0000 7fb100a00640 1 -- 172.21.15.114:0/1988449238 shutdown_connections 2024-05-09T00:17:17.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.632+0000 7fb100a00640 1 --2- 172.21.15.114:0/1988449238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072890 0x7fb0fc159c50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:17.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.632+0000 7fb100a00640 1 --2- 172.21.15.114:0/1988449238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc072d50 0x7fb0fc0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:17.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.632+0000 7fb100a00640 1 -- 172.21.15.114:0/1988449238 >> 172.21.15.114:0/1988449238 conn(0x7fb0fc06c680 msgr2=0x7fb0fc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:17.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.632+0000 7fb100a00640 1 -- 172.21.15.114:0/1988449238 shutdown_connections 2024-05-09T00:17:17.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.632+0000 7fb100a00640 1 -- 172.21.15.114:0/1988449238 wait complete. 2024-05-09T00:17:17.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.636+0000 7fb100a00640 1 Processor -- start 2024-05-09T00:17:17.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.636+0000 7fb100a00640 1 -- start start 2024-05-09T00:17:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.638+0000 7fb100a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc072890 0x7fb0fc15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.638+0000 7fb100a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 0x7fb0fc1e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:17.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.638+0000 7fb100a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc160600 0x7fb0fc152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.638+0000 7fb100a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc0c42e0 con 0x7fb0fc072d50 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.638+0000 7fb100a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc15d490 con 0x7fb0fc072890 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.638+0000 7fb100a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0fc0c6760 con 0x7fb0fc160600 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.641+0000 7fb0f9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 0x7fb0fc1e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.641+0000 7fb0f9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 0x7fb0fc1e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42620/0 (socket says 172.21.15.114:42620) 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.641+0000 7fb0f9400640 1 -- 172.21.15.114:0/1746716984 learned_addr learned my addr 172.21.15.114:0/1746716984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.641+0000 7fb0f9e00640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc072890 0x7fb0fc15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.641+0000 7fb0fa800640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc160600 0x7fb0fc152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.643+0000 7fb0f9400640 1 -- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc160600 msgr2=0x7fb0fc152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.643+0000 7fb0f9400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc160600 0x7fb0fc152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.644+0000 7fb0f9400640 1 -- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc072890 msgr2=0x7fb0fc15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.644+0000 7fb0f9400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc072890 0x7fb0fc15e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:17.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.644+0000 7fb0f9400640 1 -- 172.21.15.114:0/1746716984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0fc1f3110 con 0x7fb0fc072d50 2024-05-09T00:17:17.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.644+0000 7fb0fa800640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc160600 0x7fb0fc152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:17.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.644+0000 7fb0f9e00640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc072890 0x7fb0fc15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:17:17.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.646+0000 7fb0f9400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 0x7fb0fc1e5f80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80090b0 tx=0x7fb0e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:17.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.647+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8037040 con 0x7fb0fc072d50 2024-05-09T00:17:17.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.648+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e80325f0 con 0x7fb0fc072d50 2024-05-09T00:17:17.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.648+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80329c0 con 0x7fb0fc072d50 2024-05-09T00:17:17.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.650+0000 7fb100a00640 1 -- 172.21.15.114:0/1746716984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0fc1e84f0 con 0x7fb0fc072d50 2024-05-09T00:17:17.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.651+0000 7fb100a00640 1 -- 172.21.15.114:0/1746716984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0fc1e8ab0 con 0x7fb0fc072d50 2024-05-09T00:17:17.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.653+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0fc077430 con 0x7fb0fc072d50 2024-05-09T00:17:17.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.656+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb0e8032b60 con 0x7fb0fc072d50 2024-05-09T00:17:17.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.658+0000 7fb0f2000640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0dc076320 0x7fb0dc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:17.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.659+0000 7fb0f9e00640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0dc076320 0x7fb0dc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:17.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.660+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7fb0e80bc060 con 0x7fb0fc072d50 2024-05-09T00:17:17.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.661+0000 7fb0f9e00640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0dc076320 0x7fb0dc078830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc071e10 tx=0x7fb0ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:17.666+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0e8080de0 con 0x7fb0fc072d50 2024-05-09T00:17:18.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.224+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0fc1f2e90 con 0x7fb0fc072d50 2024-05-09T00:17:18.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.225+0000 7fb0f2000640 1 -- 172.21.15.114:0/1746716984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7fb0fc1f2e90 con 0x7fb0fc072d50 2024-05-09T00:17:18.227 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:18.227 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:17:18.228 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:17:18.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.230+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0dc076320 msgr2=0x7fb0dc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:18.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.230+0000 7fb0e7400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0dc076320 0x7fb0dc078830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc071e10 tx=0x7fb0ec008040 comp rx=0 tx=0).stop 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.230+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 msgr2=0x7fb0fc1e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.230+0000 7fb0e7400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 0x7fb0fc1e5f80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80090b0 tx=0x7fb0e80046c0 comp rx=0 tx=0).stop 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 shutdown_connections 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0dc076320 0x7fb0dc078830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc160600 0x7fb0fc152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0fc072d50 0x7fb0fc1e5f80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:18.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 --2- 172.21.15.114:0/1746716984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc072890 0x7fb0fc15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:18.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 >> 172.21.15.114:0/1746716984 conn(0x7fb0fc06c680 msgr2=0x7fb0fc15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:18.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 shutdown_connections 2024-05-09T00:17:18.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:18.231+0000 7fb0e7400640 1 -- 172.21.15.114:0/1746716984 wait complete. 2024-05-09T00:17:18.277 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:17:20.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.783+0000 7f468f800640 1 Processor -- start 2024-05-09T00:17:20.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.783+0000 7f468f800640 1 -- start start 2024-05-09T00:17:20.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.786+0000 7f468f800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4688160600 0x7f46880c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.786+0000 7f468f800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468815fe20 con 0x7f4688072d50 2024-05-09T00:17:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.786+0000 7f468f800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468815d1b0 con 0x7f4688072890 2024-05-09T00:17:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.786+0000 7f468f800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4688160170 con 0x7f4688160600 2024-05-09T00:17:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.786+0000 7f4687e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4688072890 0x7f4688159c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:59290/0 (socket says 172.21.15.114:59290) 2024-05-09T00:17:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.787+0000 7f4687e00640 1 -- 172.21.15.114:0/2881293553 learned_addr learned my addr 172.21.15.114:0/2881293553 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:17:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.787+0000 7f468d800640 1 --2- 172.21.15.114:0/2881293553 >> v2:172.21.15.114:3300/0 conn(0x7f4688160600 0x7f46880c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:20.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.787+0000 7f468d800640 1 -- 172.21.15.114:0/2881293553 >> v1:172.21.15.153:6789/0 conn(0x7f4688072890 legacy=0x7f4688159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:20.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.787+0000 7f468d800640 1 -- 172.21.15.114:0/2881293553 >> v1:172.21.15.114:6789/0 conn(0x7f4688072d50 legacy=0x7f46880c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:20.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.787+0000 7f468d800640 1 -- 172.21.15.114:0/2881293553 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468815d490 con 0x7f4688160600 2024-05-09T00:17:20.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.790+0000 7f468d800640 1 --2- 172.21.15.114:0/2881293553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688160600 0x7f46880c6050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4674009720 tx=0x7f4674029f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de4fe05922f4286 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:20.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.791+0000 7f4687400640 1 -- 172.21.15.114:0/2881293553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674037070 con 0x7f4688160600 2024-05-09T00:17:20.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.791+0000 7f4687400640 1 -- 172.21.15.114:0/2881293553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467402ac90 con 0x7f4688160600 2024-05-09T00:17:20.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.792+0000 7f4687400640 1 -- 172.21.15.114:0/2881293553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674032660 con 0x7f4688160600 2024-05-09T00:17:20.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.792+0000 7f468f800640 1 -- 172.21.15.114:0/2881293553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688160600 msgr2=0x7f46880c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:20.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.792+0000 7f468f800640 1 --2- 172.21.15.114:0/2881293553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688160600 0x7f46880c6050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4674009720 tx=0x7f4674029f80 comp rx=0 tx=0).stop 2024-05-09T00:17:20.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.792+0000 7f468f800640 1 -- 172.21.15.114:0/2881293553 shutdown_connections 2024-05-09T00:17:20.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.792+0000 7f468f800640 1 --2- 172.21.15.114:0/2881293553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688160600 0x7f46880c6050 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:20.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.792+0000 7f468f800640 1 -- 172.21.15.114:0/2881293553 >> 172.21.15.114:0/2881293553 conn(0x7f468806c680 msgr2=0x7f468806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:20.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.796+0000 7f468f800640 1 -- 172.21.15.114:0/2881293553 shutdown_connections 2024-05-09T00:17:20.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.796+0000 7f468f800640 1 -- 172.21.15.114:0/2881293553 wait complete. 2024-05-09T00:17:20.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.800+0000 7f468f800640 1 Processor -- start 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.800+0000 7f468f800640 1 -- start start 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.802+0000 7f468f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 0x7f468815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.802+0000 7f468f800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688072d50 0x7f4688157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.802+0000 7f468f800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4688160600 0x7f46880ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.802+0000 7f468f800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4688160b90 con 0x7f4688072890 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.802+0000 7f468f800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4688160a10 con 0x7f4688072d50 2024-05-09T00:17:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.802+0000 7f468f800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f46880c6590 con 0x7f4688160600 2024-05-09T00:17:20.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.803+0000 7f468ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 0x7f468815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:20.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.803+0000 7f468ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 0x7f468815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43254/0 (socket says 172.21.15.114:43254) 2024-05-09T00:17:20.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.804+0000 7f468ce00640 1 -- 172.21.15.114:0/3072223960 learned_addr learned my addr 172.21.15.114:0/3072223960 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:20.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.804+0000 7f468d800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4688160600 0x7f46880ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:20.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.805+0000 7f468ce00640 1 -- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4688160600 msgr2=0x7f46880ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:20.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.805+0000 7f468ce00640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4688160600 0x7f46880ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.805+0000 7f468ce00640 1 -- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688072d50 msgr2=0x7f4688157d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:17:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.805+0000 7f468ce00640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688072d50 0x7f4688157d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.805+0000 7f468ce00640 1 -- 172.21.15.114:0/3072223960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468814eb70 con 0x7f4688072890 2024-05-09T00:17:20.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.806+0000 7f468ce00640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 0x7f468815d860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f468000ba10 tx=0x7f468000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:20.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.808+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680019070 con 0x7f4688072890 2024-05-09T00:17:20.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.808+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468000cbd0 con 0x7f4688072890 2024-05-09T00:17:20.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.808+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680014440 con 0x7f4688072890 2024-05-09T00:17:20.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.808+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46880ac710 con 0x7f4688072890 2024-05-09T00:17:20.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.808+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46881f3500 con 0x7f4688072890 2024-05-09T00:17:20.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.811+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4688077430 con 0x7f4688072890 2024-05-09T00:17:20.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.813+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46800145e0 con 0x7f4688072890 2024-05-09T00:17:20.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.815+0000 7f4684c00640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4668076300 0x7f4668078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:20.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.818+0000 7f4687e00640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4668076300 0x7f4668078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:20.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.819+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7f468005cad0 con 0x7f4688072890 2024-05-09T00:17:20.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.821+0000 7f4687e00640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4668076300 0x7f4668078810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4678007fd0 tx=0x7f4678007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:20.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:20.827+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4680060be0 con 0x7f4688072890 2024-05-09T00:17:21.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.407+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46880c4540 con 0x7f4688072890 2024-05-09T00:17:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.412+0000 7f4684c00640 1 -- 172.21.15.114:0/3072223960 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7f4680060be0 con 0x7f4688072890 2024-05-09T00:17:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:21.420 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:17:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:17:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.422+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4668076300 msgr2=0x7f4668078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.422+0000 7f468f800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4668076300 0x7f4668078810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4678007fd0 tx=0x7f4678007980 comp rx=0 tx=0).stop 2024-05-09T00:17:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.422+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 msgr2=0x7f468815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.422+0000 7f468f800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 0x7f468815d860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f468000ba10 tx=0x7f468000bed0 comp rx=0 tx=0).stop 2024-05-09T00:17:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.423+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 shutdown_connections 2024-05-09T00:17:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.423+0000 7f468f800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4668076300 0x7f4668078810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.423+0000 7f468f800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4688160600 0x7f46880ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.423+0000 7f468f800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688072d50 0x7f4688157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.423+0000 7f468f800640 1 --2- 172.21.15.114:0/3072223960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4688072890 0x7f468815d860 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.423+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 >> 172.21.15.114:0/3072223960 conn(0x7f468806c680 msgr2=0x7f4688159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:21.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.424+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 shutdown_connections 2024-05-09T00:17:21.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:21.424+0000 7f468f800640 1 -- 172.21.15.114:0/3072223960 wait complete. 2024-05-09T00:17:21.473 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:17:23.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.014+0000 7fe98a800640 1 Processor -- start 2024-05-09T00:17:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.014+0000 7fe98a800640 1 -- start start 2024-05-09T00:17:24.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.017+0000 7fe98a800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe9840af570 0x7fe984154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.017+0000 7fe98a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840c5bb0 0x7fe984157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.017+0000 7fe98a800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9840748f0 con 0x7fe9840706c0 2024-05-09T00:17:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.017+0000 7fe98a800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe9841553e0 con 0x7fe9840af570 2024-05-09T00:17:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.017+0000 7fe98a800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe984154420 con 0x7fe9840c5bb0 2024-05-09T00:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.020+0000 7fe983400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe9840af570 0x7fe984154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.020+0000 7fe983400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe9840af570 0x7fe984154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:56198/0 (socket says 172.21.15.114:56198) 2024-05-09T00:17:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.020+0000 7fe983400640 1 -- 172.21.15.114:0/2185180419 learned_addr learned my addr 172.21.15.114:0/2185180419 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:24.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.022+0000 7fe983e00640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840c5bb0 0x7fe984157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.022+0000 7fe983400640 1 -- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840c5bb0 msgr2=0x7fe984157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.022+0000 7fe983400640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840c5bb0 0x7fe984157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.022+0000 7fe983400640 1 -- 172.21.15.114:0/2185180419 >> v1:172.21.15.153:6789/0 conn(0x7fe9840706c0 legacy=0x7fe9840c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.022+0000 7fe983400640 1 -- 172.21.15.114:0/2185180419 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe984073430 con 0x7fe9840af570 2024-05-09T00:17:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.023+0000 7fe983e00640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840c5bb0 0x7fe984157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:24.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.024+0000 7fe983400640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840af570 0x7fe984154ea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009e50 tx=0x7fe97c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5ae7cb22e42df2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.024+0000 7fe982000640 1 -- 172.21.15.114:0/2185180419 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c036070 con 0x7fe9840af570 2024-05-09T00:17:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.024+0000 7fe982000640 1 -- 172.21.15.114:0/2185180419 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c031600 con 0x7fe9840af570 2024-05-09T00:17:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.024+0000 7fe982000640 1 -- 172.21.15.114:0/2185180419 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0319d0 con 0x7fe9840af570 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.028+0000 7fe98a800640 1 -- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840af570 msgr2=0x7fe984154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.028+0000 7fe98a800640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840af570 0x7fe984154ea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009e50 tx=0x7fe97c02a610 comp rx=0 tx=0).stop 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.028+0000 7fe98a800640 1 -- 172.21.15.114:0/2185180419 shutdown_connections 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.028+0000 7fe98a800640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840c5bb0 0x7fe984157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.028+0000 7fe98a800640 1 --2- 172.21.15.114:0/2185180419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840af570 0x7fe984154ea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.028+0000 7fe98a800640 1 -- 172.21.15.114:0/2185180419 >> 172.21.15.114:0/2185180419 conn(0x7fe98406c680 msgr2=0x7fe98406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.029+0000 7fe98a800640 1 -- 172.21.15.114:0/2185180419 shutdown_connections 2024-05-09T00:17:24.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.029+0000 7fe98a800640 1 -- 172.21.15.114:0/2185180419 wait complete. 2024-05-09T00:17:24.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.033+0000 7fe98a800640 1 Processor -- start 2024-05-09T00:17:24.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.033+0000 7fe98a800640 1 -- start start 2024-05-09T00:17:24.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.036+0000 7fe98a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 0x7fe9840ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:24.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.036+0000 7fe98a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 0x7fe9841f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:24.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.037+0000 7fe983400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 0x7fe9840ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:24.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.037+0000 7fe98a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840c5bb0 0x7fe98414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:24.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.037+0000 7fe98a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe984073130 con 0x7fe9840706c0 2024-05-09T00:17:24.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.037+0000 7fe98a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840c4fe0 con 0x7fe9840c5bb0 2024-05-09T00:17:24.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.037+0000 7fe98a800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe984073710 con 0x7fe9840af570 2024-05-09T00:17:24.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.038+0000 7fe983400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 0x7fe9840ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43256/0 (socket says 172.21.15.114:43256) 2024-05-09T00:17:24.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.038+0000 7fe982a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 0x7fe9841f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:24.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.038+0000 7fe982a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 0x7fe9841f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:57550/0 (socket says 172.21.15.114:57550) 2024-05-09T00:17:24.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.038+0000 7fe982a00640 1 -- 172.21.15.114:0/2617123025 learned_addr learned my addr 172.21.15.114:0/2617123025 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:24.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.040+0000 7fe983400640 1 -- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 msgr2=0x7fe9841f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:24.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.041+0000 7fe983e00640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840c5bb0 0x7fe98414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:24.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.041+0000 7fe983400640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 0x7fe9841f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.041+0000 7fe983400640 1 -- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840c5bb0 msgr2=0x7fe98414fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:24.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.041+0000 7fe983400640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840c5bb0 0x7fe98414fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.042+0000 7fe983400640 1 -- 172.21.15.114:0/2617123025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9841f6840 con 0x7fe9840706c0 2024-05-09T00:17:24.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.042+0000 7fe982a00640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 0x7fe9841f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:17:24.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.043+0000 7fe983e00640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840c5bb0 0x7fe98414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:24.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.047+0000 7fe983400640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 0x7fe9840ae770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe97c030000 tx=0x7fe97c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:24.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.048+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c036050 con 0x7fe9840706c0 2024-05-09T00:17:24.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.048+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c042070 con 0x7fe9840706c0 2024-05-09T00:17:24.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.048+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9841f6ae0 con 0x7fe9840706c0 2024-05-09T00:17:24.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.050+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c007c30 con 0x7fe9840706c0 2024-05-09T00:17:24.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.050+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe984150540 con 0x7fe9840706c0 2024-05-09T00:17:24.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.053+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe984077430 con 0x7fe9840706c0 2024-05-09T00:17:24.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.054+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe97c009470 con 0x7fe9840706c0 2024-05-09T00:17:24.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.056+0000 7fe97b400640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9640763a0 0x7fe9640788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:24.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.056+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7354+0+0 (secure 0 0 0) 0x7fe97c0b8a60 con 0x7fe9840706c0 2024-05-09T00:17:24.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.057+0000 7fe982a00640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9640763a0 0x7fe9640788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:24.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.060+0000 7fe982a00640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9640763a0 0x7fe9640788b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c3b40 tx=0x7fe974009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:24.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.069+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe97c081dc0 con 0x7fe9840706c0 2024-05-09T00:17:24.708 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:24.708 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:15:12.953509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6837/372512194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":372512194},{"type":"v1","addr":"172.21.15.114:6837","nonce":372512194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T00:17:24.708 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 52 2024-05-09T00:17:24.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.705+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe984158880 con 0x7fe9840706c0 2024-05-09T00:17:24.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.707+0000 7fe97b400640 1 -- 172.21.15.114:0/2617123025 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6500 (secure 0 0 0) 0x7fe97c0816c0 con 0x7fe9840706c0 2024-05-09T00:17:24.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.713+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9640763a0 msgr2=0x7fe9640788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:24.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.713+0000 7fe98a800640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9640763a0 0x7fe9640788b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c3b40 tx=0x7fe974009040 comp rx=0 tx=0).stop 2024-05-09T00:17:24.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.713+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 msgr2=0x7fe9840ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:24.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.713+0000 7fe98a800640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 0x7fe9840ae770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe97c030000 tx=0x7fe97c004a40 comp rx=0 tx=0).stop 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 shutdown_connections 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe9640763a0 0x7fe9640788b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840c5bb0 0x7fe98414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9840af570 0x7fe9841f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 --2- 172.21.15.114:0/2617123025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9840706c0 0x7fe9840ae770 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 >> 172.21.15.114:0/2617123025 conn(0x7fe98406c680 msgr2=0x7fe984075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:24.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.714+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 shutdown_connections 2024-05-09T00:17:24.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:24.715+0000 7fe98a800640 1 -- 172.21.15.114:0/2617123025 wait complete. 2024-05-09T00:17:24.766 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T00:17:26.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:27.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.287+0000 7f797f200640 1 Processor -- start 2024-05-09T00:17:27.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.287+0000 7f797f200640 1 -- start start 2024-05-09T00:17:27.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.289+0000 7f797f200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79800701f0 0x7f7980158d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:27.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.289+0000 7f797f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79800c5cb0 0x7f79800c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:27.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.290+0000 7f797f200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79800c5a10 con 0x7f798015bdd0 2024-05-09T00:17:27.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.290+0000 7f797de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79800701f0 0x7f7980158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:27.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.290+0000 7f797de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79800701f0 0x7f7980158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:56220/0 (socket says 172.21.15.114:56220) 2024-05-09T00:17:27.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.290+0000 7f797d400640 1 --2- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79800c5cb0 0x7f79800c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:27.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.290+0000 7f797de00640 1 -- 172.21.15.114:0/4280021731 learned_addr learned my addr 172.21.15.114:0/4280021731 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:27.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.291+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f798006f140 con 0x7f79800701f0 2024-05-09T00:17:27.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.291+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f798006f420 con 0x7f79800c5cb0 2024-05-09T00:17:27.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.291+0000 7f797de00640 1 -- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79800c5cb0 msgr2=0x7f79800c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:27.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.291+0000 7f797de00640 1 --2- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79800c5cb0 0x7f79800c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.291+0000 7f797de00640 1 -- 172.21.15.114:0/4280021731 >> v1:172.21.15.114:6789/0 conn(0x7f798015bdd0 legacy=0x7f798015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:27.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.291+0000 7f797de00640 1 -- 172.21.15.114:0/4280021731 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798006f700 con 0x7f79800701f0 2024-05-09T00:17:27.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.293+0000 7f797de00640 1 --2- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800701f0 0x7f7980158d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7970009870 tx=0x7f797002a310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a36be913758fe1b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:27.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.293+0000 7f797ca00640 1 -- 172.21.15.114:0/4280021731 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970037070 con 0x7f79800701f0 2024-05-09T00:17:27.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.294+0000 7f797ca00640 1 -- 172.21.15.114:0/4280021731 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7970032640 con 0x7f79800701f0 2024-05-09T00:17:27.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.294+0000 7f797ca00640 1 -- 172.21.15.114:0/4280021731 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797002ae60 con 0x7f79800701f0 2024-05-09T00:17:27.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.295+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800701f0 msgr2=0x7f7980158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:27.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.295+0000 7f797f200640 1 --2- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800701f0 0x7f7980158d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7970009870 tx=0x7f797002a310 comp rx=0 tx=0).stop 2024-05-09T00:17:27.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.296+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 shutdown_connections 2024-05-09T00:17:27.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.296+0000 7f797f200640 1 --2- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79800c5cb0 0x7f79800c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.296+0000 7f797f200640 1 --2- 172.21.15.114:0/4280021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800701f0 0x7f7980158d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.296+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 >> 172.21.15.114:0/4280021731 conn(0x7f79800c92e0 msgr2=0x7f79800c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:27.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.297+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 shutdown_connections 2024-05-09T00:17:27.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.297+0000 7f797f200640 1 -- 172.21.15.114:0/4280021731 wait complete. 2024-05-09T00:17:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.301+0000 7f797f200640 1 Processor -- start 2024-05-09T00:17:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.301+0000 7f797f200640 1 -- start start 2024-05-09T00:17:27.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.304+0000 7f797f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79800701f0 0x7f79800aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.305+0000 7f797f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 0x7f79800abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.305+0000 7f797f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800ab3d0 0x7f79800ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:27.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.305+0000 7f797f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7980159250 con 0x7f79800701f0 2024-05-09T00:17:27.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.305+0000 7f797f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f798015b8b0 con 0x7f79800ab3d0 2024-05-09T00:17:27.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.305+0000 7f797f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f798006ed80 con 0x7f798015bdd0 2024-05-09T00:17:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.307+0000 7f797d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 0x7f79800abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.308+0000 7f797d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 0x7f79800abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:57568/0 (socket says 172.21.15.114:57568) 2024-05-09T00:17:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.308+0000 7f797d400640 1 -- 172.21.15.114:0/3741647281 learned_addr learned my addr 172.21.15.114:0/3741647281 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.308+0000 7f797e800640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800ab3d0 0x7f79800ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:27.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.313+0000 7f797d400640 1 -- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800ab3d0 msgr2=0x7f79800ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.315+0000 7f797d400640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800ab3d0 0x7f79800ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.315+0000 7f797d400640 1 -- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79800701f0 msgr2=0x7f79800aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.315+0000 7f797d400640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79800701f0 0x7f79800aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.315+0000 7f797d400640 1 -- 172.21.15.114:0/3741647281 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79800acff0 con 0x7f798015bdd0 2024-05-09T00:17:27.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.316+0000 7f797e800640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800ab3d0 0x7f79800ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:17:27.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.317+0000 7f797d400640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 0x7f79800abf10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f796800d560 tx=0x7f796800da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:27.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.317+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79680125f0 con 0x7f798015bdd0 2024-05-09T00:17:27.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.317+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7980155850 con 0x7f798015bdd0 2024-05-09T00:17:27.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.318+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7968019070 con 0x7f798015bdd0 2024-05-09T00:17:27.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.318+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79680125f0 con 0x7f798015bdd0 2024-05-09T00:17:27.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.318+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79800add90 con 0x7f798015bdd0 2024-05-09T00:17:27.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.323+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7968012790 con 0x7f798015bdd0 2024-05-09T00:17:27.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.325+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7980078350 con 0x7f798015bdd0 2024-05-09T00:17:27.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.326+0000 7f7976000640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f795c0764d0 0x7f795c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:27.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.327+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f7968097b90 con 0x7f798015bdd0 2024-05-09T00:17:27.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.328+0000 7f797de00640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f795c0764d0 0x7f795c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:27.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.331+0000 7f797de00640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f795c0764d0 0x7f795c0789e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7970034000 tx=0x7f797002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:27.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.333+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f79800acff0 con 0x7f798015bdd0 2024-05-09T00:17:27.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.941+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f798015c560 con 0x7f798015bdd0 2024-05-09T00:17:27.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.944+0000 7f7976000640 1 -- 172.21.15.114:0/3741647281 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5667 (secure 0 0 0) 0x7f7968060e30 con 0x7f798015bdd0 2024-05-09T00:17:27.947 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:27.947 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:25.005205+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:17:27.947 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-05-09T00:17:27.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.951+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f795c0764d0 msgr2=0x7f795c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:27.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.951+0000 7f797f200640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f795c0764d0 0x7f795c0789e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7970034000 tx=0x7f797002c000 comp rx=0 tx=0).stop 2024-05-09T00:17:27.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.952+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 msgr2=0x7f79800abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:27.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.952+0000 7f797f200640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 0x7f79800abf10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f796800d560 tx=0x7f796800da20 comp rx=0 tx=0).stop 2024-05-09T00:17:27.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.953+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 shutdown_connections 2024-05-09T00:17:27.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.953+0000 7f797f200640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f795c0764d0 0x7f795c0789e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.953+0000 7f797f200640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79800ab3d0 0x7f79800ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.954+0000 7f797f200640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798015bdd0 0x7f79800abf10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.954+0000 7f797f200640 1 --2- 172.21.15.114:0/3741647281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79800701f0 0x7f79800aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.955+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 >> 172.21.15.114:0/3741647281 conn(0x7f79800c92e0 msgr2=0x7f7980073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.955+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 shutdown_connections 2024-05-09T00:17:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:27.955+0000 7f797f200640 1 -- 172.21.15.114:0/3741647281 wait complete. 2024-05-09T00:17:28.021 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2024-05-09T00:17:28.021 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T00:17:28.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:28.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.638+0000 7f8e5b000640 1 Processor -- start 2024-05-09T00:17:28.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.638+0000 7f8e5b000640 1 -- start start 2024-05-09T00:17:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.642+0000 7f8e5b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e4c046790 0x7f8e4c047230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:28.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.643+0000 7f8e5b000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c007050 0x7f8e4c049920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:28.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.643+0000 7f8e5b000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4c02e9b0 con 0x7f8e4c0d4350 2024-05-09T00:17:28.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.644+0000 7f8e5b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4c046c60 con 0x7f8e4c046790 2024-05-09T00:17:28.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.644+0000 7f8e5b000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c0d7a10 con 0x7f8e4c007050 2024-05-09T00:17:28.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.645+0000 7f8e59000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8e4c0d4350 0x7f8e4c00b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46086/0 (socket says 172.21.15.114:46086) 2024-05-09T00:17:28.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.645+0000 7f8e53e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e4c046790 0x7f8e4c047230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:28.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.645+0000 7f8e53e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e4c046790 0x7f8e4c047230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46850/0 (socket says 172.21.15.114:46850) 2024-05-09T00:17:28.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.645+0000 7f8e53e00640 1 -- 172.21.15.114:0/31374002 learned_addr learned my addr 172.21.15.114:0/31374002 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:28.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.646+0000 7f8e53400640 1 --2- 172.21.15.114:0/31374002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c007050 0x7f8e4c049920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:28.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.648+0000 7f8e53e00640 1 -- 172.21.15.114:0/31374002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c007050 msgr2=0x7f8e4c049920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:28.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.648+0000 7f8e53e00640 1 --2- 172.21.15.114:0/31374002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c007050 0x7f8e4c049920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:28.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.648+0000 7f8e53e00640 1 -- 172.21.15.114:0/31374002 >> v1:172.21.15.114:6789/0 conn(0x7f8e4c0d4350 legacy=0x7f8e4c00b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:28.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.648+0000 7f8e53e00640 1 -- 172.21.15.114:0/31374002 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c0464b0 con 0x7f8e4c046790 2024-05-09T00:17:28.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.651+0000 7f8e53e00640 1 --2- 172.21.15.114:0/31374002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c046790 0x7f8e4c047230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009ad0 tx=0x7f8e4002c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0465a4a548dafa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:28.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.652+0000 7f8e52a00640 1 -- 172.21.15.114:0/31374002 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40038070 con 0x7f8e4c046790 2024-05-09T00:17:28.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.652+0000 7f8e52a00640 1 -- 172.21.15.114:0/31374002 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e40033400 con 0x7f8e4c046790 2024-05-09T00:17:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.652+0000 7f8e52a00640 1 -- 172.21.15.114:0/31374002 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40033810 con 0x7f8e4c046790 2024-05-09T00:17:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.654+0000 7f8e5b000640 1 -- 172.21.15.114:0/31374002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c046790 msgr2=0x7f8e4c047230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.654+0000 7f8e5b000640 1 --2- 172.21.15.114:0/31374002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c046790 0x7f8e4c047230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009ad0 tx=0x7f8e4002c5e0 comp rx=0 tx=0).stop 2024-05-09T00:17:28.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.655+0000 7f8e5b000640 1 -- 172.21.15.114:0/31374002 shutdown_connections 2024-05-09T00:17:28.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.655+0000 7f8e5b000640 1 --2- 172.21.15.114:0/31374002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c007050 0x7f8e4c049920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:28.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.655+0000 7f8e5b000640 1 --2- 172.21.15.114:0/31374002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c046790 0x7f8e4c047230 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:28.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.655+0000 7f8e5b000640 1 -- 172.21.15.114:0/31374002 >> 172.21.15.114:0/31374002 conn(0x7f8e4c0060b0 msgr2=0x7f8e4c0064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:28.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.656+0000 7f8e5b000640 1 -- 172.21.15.114:0/31374002 shutdown_connections 2024-05-09T00:17:28.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.656+0000 7f8e5b000640 1 -- 172.21.15.114:0/31374002 wait complete. 2024-05-09T00:17:28.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.661+0000 7f8e5b000640 1 Processor -- start 2024-05-09T00:17:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.663+0000 7f8e5b000640 1 -- start start 2024-05-09T00:17:28.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.666+0000 7f8e5b000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e4c007050 0x7f8e4c1702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:28.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.666+0000 7f8e5b000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c046790 0x7f8e4c042100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:28.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.666+0000 7f8e5b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 0x7f8e4c0cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.667+0000 7f8e53400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c046790 0x7f8e4c042100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.667+0000 7f8e53400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c046790 0x7f8e4c042100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:34042/0 (socket says 172.21.15.114:34042) 2024-05-09T00:17:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.667+0000 7f8e59000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 0x7f8e4c0cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.667+0000 7f8e59000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 0x7f8e4c0cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46862/0 (socket says 172.21.15.114:46862) 2024-05-09T00:17:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.667+0000 7f8e53400640 1 -- 172.21.15.114:0/2960407091 learned_addr learned my addr 172.21.15.114:0/2960407091 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.668+0000 7f8e5b000640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00bb40 con 0x7f8e4c0d4350 2024-05-09T00:17:28.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.668+0000 7f8e5b000640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00b9c0 con 0x7f8e4c007050 2024-05-09T00:17:28.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.668+0000 7f8e5b000640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c049e60 con 0x7f8e4c046790 2024-05-09T00:17:28.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.669+0000 7f8e59000640 1 -- 172.21.15.114:0/2960407091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c046790 msgr2=0x7f8e4c042100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:28.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.669+0000 7f8e59000640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c046790 0x7f8e4c042100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:28.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.669+0000 7f8e59000640 1 -- 172.21.15.114:0/2960407091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e4c007050 msgr2=0x7f8e4c1702f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:17:28.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.669+0000 7f8e59000640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e4c007050 0x7f8e4c1702f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:28.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.669+0000 7f8e59000640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c044d00 con 0x7f8e4c0d4350 2024-05-09T00:17:28.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.670+0000 7f8e59000640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 0x7f8e4c0cfa50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8e54051ae0 tx=0x7f8e5406ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:28.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.671+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5406e110 con 0x7f8e4c0d4350 2024-05-09T00:17:28.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.671+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5406e2d0 con 0x7f8e4c0d4350 2024-05-09T00:17:28.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.671+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5406c8c0 con 0x7f8e4c0d4350 2024-05-09T00:17:28.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.672+0000 7f8e5b000640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c044fe0 con 0x7f8e4c0d4350 2024-05-09T00:17:28.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.673+0000 7f8e5b000640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c0d0570 con 0x7f8e4c0d4350 2024-05-09T00:17:28.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.679+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e5406ca60 con 0x7f8e4c0d4350 2024-05-09T00:17:28.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.681+0000 7f8e47e00640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8e340762d0 0x7f8e340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:28.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.681+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f8e5411d870 con 0x7f8e4c0d4350 2024-05-09T00:17:28.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.684+0000 7f8e53e00640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8e340762d0 0x7f8e340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:28.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.685+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c005590 con 0x7f8e4c0d4350 2024-05-09T00:17:28.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.686+0000 7f8e53e00640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8e340762d0 0x7f8e340787e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8e40035000 tx=0x7f8e40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:28.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:28.703+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8e540e6450 con 0x7f8e4c0d4350 2024-05-09T00:17:29.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.319+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e4c0074f0 con 0x7f8e4c0d4350 2024-05-09T00:17:29.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.326+0000 7f8e47e00640 1 -- 172.21.15.114:0/2960407091 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5667 (secure 0 0 0) 0x7f8e540ea750 con 0x7f8e4c0d4350 2024-05-09T00:17:29.325 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:29.325 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:25.005205+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:17:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-05-09T00:17:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.333+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8e340762d0 msgr2=0x7f8e340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.334+0000 7f8e45600640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8e340762d0 0x7f8e340787e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8e40035000 tx=0x7f8e40008030 comp rx=0 tx=0).stop 2024-05-09T00:17:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.334+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 msgr2=0x7f8e4c0cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.334+0000 7f8e45600640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 0x7f8e4c0cfa50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8e54051ae0 tx=0x7f8e5406ea70 comp rx=0 tx=0).stop 2024-05-09T00:17:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.335+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 shutdown_connections 2024-05-09T00:17:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.336+0000 7f8e45600640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8e340762d0 0x7f8e340787e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.336+0000 7f8e45600640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4c0d4350 0x7f8e4c0cfa50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.337+0000 7f8e45600640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e4c046790 0x7f8e4c042100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.337+0000 7f8e45600640 1 --2- 172.21.15.114:0/2960407091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e4c007050 0x7f8e4c1702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.337+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 >> 172.21.15.114:0/2960407091 conn(0x7f8e4c0060b0 msgr2=0x7f8e4c0057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:29.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.337+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 shutdown_connections 2024-05-09T00:17:29.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:29.337+0000 7f8e45600640 1 -- 172.21.15.114:0/2960407091 wait complete. 2024-05-09T00:17:29.401 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 53, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 51, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5017": { "addr": "172.21.15.153:6835/1232162808", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6834", "nonce": 1232162808, "type": "v2" }, { "addr": "172.21.15.153:6835", "nonce": 1232162808, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5017, "incarnation": 48, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 14 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:16:46.168266+0000", "qdb_cluster": [ 5017 ], "qdb_leader": 5017, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5017 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 53, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5334": { "addr": "172.21.15.114:6836/2312453128", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 2312453128, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 2312453128, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5334, "incarnation": 53, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:17:25.005205+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5334 } } } ], "standbys": [ { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 31, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:17:31.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.890+0000 7f30d4600640 1 Processor -- start 2024-05-09T00:17:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.890+0000 7f30d4600640 1 -- start start 2024-05-09T00:17:31.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.893+0000 7f30d4600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30cc0ca170 0x7f30cc0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.901+0000 7f30d4600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc072cf0 0x7f30cc1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.901+0000 7f30d4600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30cc0ca7b0 0x7f30cc158700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.901+0000 7f30d4600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc0c9440 con 0x7f30cc0ca170 2024-05-09T00:17:31.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.901+0000 7f30d4600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc0c9ce0 con 0x7f30cc0ca7b0 2024-05-09T00:17:31.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.901+0000 7f30d4600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0cace0 con 0x7f30cc072cf0 2024-05-09T00:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.902+0000 7f30d1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc072cf0 0x7f30cc1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.902+0000 7f30d2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30cc0ca7b0 0x7f30cc158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.902+0000 7f30d2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30cc0ca7b0 0x7f30cc158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:57704/0 (socket says 172.21.15.114:57704) 2024-05-09T00:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.902+0000 7f30d2600640 1 -- 172.21.15.114:0/4025155722 learned_addr learned my addr 172.21.15.114:0/4025155722 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.903+0000 7f30d2600640 1 -- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc072cf0 msgr2=0x7f30cc1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.903+0000 7f30d2600640 1 --2- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc072cf0 0x7f30cc1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.903+0000 7f30d2600640 1 -- 172.21.15.114:0/4025155722 >> v2:172.21.15.114:3300/0 conn(0x7f30cc0ca170 msgr2=0x7f30cc0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.903+0000 7f30d2600640 1 --2- 172.21.15.114:0/4025155722 >> v2:172.21.15.114:3300/0 conn(0x7f30cc0ca170 0x7f30cc0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.903+0000 7f30d2600640 1 -- 172.21.15.114:0/4025155722 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc0c9690 con 0x7f30cc0ca7b0 2024-05-09T00:17:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.905+0000 7f30d2600640 1 --2- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc0ca7b0 0x7f30cc158700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f30cc073800 tx=0x7f30c002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b8873d228b84b5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.906+0000 7f30cbe00640 1 -- 172.21.15.114:0/4025155722 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0037070 con 0x7f30cc0ca7b0 2024-05-09T00:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.907+0000 7f30cbe00640 1 -- 172.21.15.114:0/4025155722 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0032440 con 0x7f30cc0ca7b0 2024-05-09T00:17:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.908+0000 7f30cbe00640 1 -- 172.21.15.114:0/4025155722 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0032850 con 0x7f30cc0ca7b0 2024-05-09T00:17:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.910+0000 7f30d4600640 1 -- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc0ca7b0 msgr2=0x7f30cc158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.910+0000 7f30d4600640 1 --2- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc0ca7b0 0x7f30cc158700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f30cc073800 tx=0x7f30c002a180 comp rx=0 tx=0).stop 2024-05-09T00:17:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.911+0000 7f30d4600640 1 -- 172.21.15.114:0/4025155722 shutdown_connections 2024-05-09T00:17:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.911+0000 7f30d4600640 1 --2- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc0ca7b0 0x7f30cc158700 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.911+0000 7f30d4600640 1 --2- 172.21.15.114:0/4025155722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc072cf0 0x7f30cc1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.911+0000 7f30d4600640 1 --2- 172.21.15.114:0/4025155722 >> v2:172.21.15.114:3300/0 conn(0x7f30cc0ca170 0x7f30cc0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.911+0000 7f30d4600640 1 -- 172.21.15.114:0/4025155722 >> 172.21.15.114:0/4025155722 conn(0x7f30cc0cbb70 msgr2=0x7f30cc0ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.915+0000 7f30d4600640 1 -- 172.21.15.114:0/4025155722 shutdown_connections 2024-05-09T00:17:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.915+0000 7f30d4600640 1 -- 172.21.15.114:0/4025155722 wait complete. 2024-05-09T00:17:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.919+0000 7f30d4600640 1 Processor -- start 2024-05-09T00:17:31.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.919+0000 7f30d4600640 1 -- start start 2024-05-09T00:17:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.922+0000 7f30d4600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc072cf0 0x7f30cc154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.923+0000 7f30d4600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc0ca7b0 0x7f30cc153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.923+0000 7f30d4600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30cc153650 0x7f30cc157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.923+0000 7f30d1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc072cf0 0x7f30cc154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:31.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.924+0000 7f30d1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc072cf0 0x7f30cc154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:57714/0 (socket says 172.21.15.114:57714) 2024-05-09T00:17:31.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.925+0000 7f30d1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc0ca7b0 0x7f30cc153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:31.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.925+0000 7f30d1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc0ca7b0 0x7f30cc153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:34060/0 (socket says 172.21.15.114:34060) 2024-05-09T00:17:31.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.925+0000 7f30d2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30cc153650 0x7f30cc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.925+0000 7f30d1c00640 1 -- 172.21.15.114:0/2399397321 learned_addr learned my addr 172.21.15.114:0/2399397321 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.926+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc06f510 con 0x7f30cc153650 2024-05-09T00:17:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.926+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc06f390 con 0x7f30cc072cf0 2024-05-09T00:17:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.926+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0c4eb0 con 0x7f30cc0ca7b0 2024-05-09T00:17:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.927+0000 7f30d2600640 1 -- 172.21.15.114:0/2399397321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc0ca7b0 msgr2=0x7f30cc153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.927+0000 7f30d2600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc0ca7b0 0x7f30cc153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.927+0000 7f30d2600640 1 -- 172.21.15.114:0/2399397321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc072cf0 msgr2=0x7f30cc154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.927+0000 7f30d2600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc072cf0 0x7f30cc154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.927+0000 7f30d2600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc1549d0 con 0x7f30cc153650 2024-05-09T00:17:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.929+0000 7f30d2600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30cc153650 0x7f30cc157520 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f30c0031000 tx=0x7f30c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:31.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.930+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0041020 con 0x7f30cc153650 2024-05-09T00:17:31.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.930+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc154f80 con 0x7f30cc153650 2024-05-09T00:17:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.930+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc156ab0 con 0x7f30cc153650 2024-05-09T00:17:31.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.931+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0032440 con 0x7f30cc153650 2024-05-09T00:17:31.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.940+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0041020 con 0x7f30cc153650 2024-05-09T00:17:31.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.940+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8005290 con 0x7f30cc153650 2024-05-09T00:17:31.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.941+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30c0044020 con 0x7f30cc153650 2024-05-09T00:17:31.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.943+0000 7f30c9600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f30ac0764d0 0x7f30ac0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:31.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.948+0000 7f30d1c00640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f30ac0764d0 0x7f30ac0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:31.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.948+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f30c00b8260 con 0x7f30cc153650 2024-05-09T00:17:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.956+0000 7f30d1c00640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f30ac0764d0 0x7f30ac0789e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30b80099a0 tx=0x7f30b8006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:31.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:31.964+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30c0080e30 con 0x7f30cc153650 2024-05-09T00:17:32.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.532+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30a8005850 con 0x7f30cc153650 2024-05-09T00:17:32.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.533+0000 7f30c9600640 1 -- 172.21.15.114:0/2399397321 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5667 (secure 0 0 0) 0x7f30c0085130 con 0x7f30cc153650 2024-05-09T00:17:32.532 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:32.532 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:25.005205+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:17:32.532 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-05-09T00:17:32.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f30ac0764d0 msgr2=0x7f30ac0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:32.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f30ac0764d0 0x7f30ac0789e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30b80099a0 tx=0x7f30b8006f90 comp rx=0 tx=0).stop 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30cc153650 msgr2=0x7f30cc157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30cc153650 0x7f30cc157520 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f30c0031000 tx=0x7f30c00046c0 comp rx=0 tx=0).stop 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 shutdown_connections 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f30ac0764d0 0x7f30ac0789e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30cc153650 0x7f30cc157520 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30cc0ca7b0 0x7f30cc153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 --2- 172.21.15.114:0/2399397321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30cc072cf0 0x7f30cc154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 >> 172.21.15.114:0/2399397321 conn(0x7f30cc0cbb70 msgr2=0x7f30cc070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:32.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 shutdown_connections 2024-05-09T00:17:32.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:32.540+0000 7f30d4600640 1 -- 172.21.15.114:0/2399397321 wait complete. 2024-05-09T00:17:32.602 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:17:34.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:35.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.019+0000 7f1387e00640 1 Processor -- start 2024-05-09T00:17:35.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.020+0000 7f1387e00640 1 -- start start 2024-05-09T00:17:35.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.022+0000 7f1387e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880cb7d0 0x7f13881639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:35.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.022+0000 7f1387e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1388158050 con 0x7f138806de70 2024-05-09T00:17:35.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.022+0000 7f1387e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1388158f40 con 0x7f13880c8870 2024-05-09T00:17:35.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.022+0000 7f1387e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f13881583a0 con 0x7f13880cb7d0 2024-05-09T00:17:35.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.023+0000 7f1386000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f138806de70 0x7f138806cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46102/0 (socket says 172.21.15.114:46102) 2024-05-09T00:17:35.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.023+0000 7f1386000640 1 -- 172.21.15.114:0/2769230199 learned_addr learned my addr 172.21.15.114:0/2769230199 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:17:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.025+0000 7f1387400640 1 --2- 172.21.15.114:0/2769230199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880cb7d0 0x7f13881639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:35.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.027+0000 7f1385600640 1 -- 172.21.15.114:0/2769230199 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 311470221 0 0) 0x7f1388158050 con 0x7f138806de70 2024-05-09T00:17:35.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.027+0000 7f1385600640 1 -- 172.21.15.114:0/2769230199 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f136c003520 con 0x7f138806de70 2024-05-09T00:17:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.027+0000 7f1387400640 1 -- 172.21.15.114:0/2769230199 >> v1:172.21.15.153:6789/0 conn(0x7f13880c8870 legacy=0x7f1388158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.027+0000 7f1387400640 1 -- 172.21.15.114:0/2769230199 >> v1:172.21.15.114:6789/0 conn(0x7f138806de70 legacy=0x7f138806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.027+0000 7f1387400640 1 -- 172.21.15.114:0/2769230199 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880c7f70 con 0x7f13880cb7d0 2024-05-09T00:17:35.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.031+0000 7f1387400640 1 --2- 172.21.15.114:0/2769230199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880cb7d0 0x7f13881639e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1380009dc0 tx=0x7f138002a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3d37e8494e31509 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:35.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.032+0000 7f1385600640 1 -- 172.21.15.114:0/2769230199 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380007740 con 0x7f13880cb7d0 2024-05-09T00:17:35.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.033+0000 7f1385600640 1 -- 172.21.15.114:0/2769230199 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13800078e0 con 0x7f13880cb7d0 2024-05-09T00:17:35.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.033+0000 7f1385600640 1 -- 172.21.15.114:0/2769230199 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380007cb0 con 0x7f13880cb7d0 2024-05-09T00:17:35.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.035+0000 7f1387e00640 1 -- 172.21.15.114:0/2769230199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880cb7d0 msgr2=0x7f13881639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:35.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.035+0000 7f1387e00640 1 --2- 172.21.15.114:0/2769230199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880cb7d0 0x7f13881639e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1380009dc0 tx=0x7f138002a480 comp rx=0 tx=0).stop 2024-05-09T00:17:35.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.035+0000 7f1387e00640 1 -- 172.21.15.114:0/2769230199 shutdown_connections 2024-05-09T00:17:35.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.035+0000 7f1387e00640 1 --2- 172.21.15.114:0/2769230199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880cb7d0 0x7f13881639e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.035+0000 7f1387e00640 1 -- 172.21.15.114:0/2769230199 >> 172.21.15.114:0/2769230199 conn(0x7f13880cd650 msgr2=0x7f13880cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:35.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.042+0000 7f1387e00640 1 -- 172.21.15.114:0/2769230199 shutdown_connections 2024-05-09T00:17:35.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.042+0000 7f1387e00640 1 -- 172.21.15.114:0/2769230199 wait complete. 2024-05-09T00:17:35.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.047+0000 7f1387e00640 1 Processor -- start 2024-05-09T00:17:35.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.048+0000 7f1387e00640 1 -- start start 2024-05-09T00:17:35.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.051+0000 7f1387e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 0x7f13881fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:35.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.051+0000 7f1387e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 0x7f1388153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:35.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.052+0000 7f1387e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1388151900 0x7f13881523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:35.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.052+0000 7f1386a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 0x7f13881fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:35.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.052+0000 7f1386a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 0x7f13881fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:57722/0 (socket says 172.21.15.114:57722) 2024-05-09T00:17:35.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.052+0000 7f1386000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 0x7f1388153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:35.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.053+0000 7f1386000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 0x7f1388153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46890/0 (socket says 172.21.15.114:46890) 2024-05-09T00:17:35.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.053+0000 7f1386a00640 1 -- 172.21.15.114:0/3035535027 learned_addr learned my addr 172.21.15.114:0/3035535027 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.053+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f138806d490 con 0x7f13880cb7d0 2024-05-09T00:17:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.053+0000 7f1387400640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1388151900 0x7f13881523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.053+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f138806d310 con 0x7f138806de70 2024-05-09T00:17:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.054+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f13880ccef0 con 0x7f1388151900 2024-05-09T00:17:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.055+0000 7f1386000640 1 -- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1388151900 msgr2=0x7f13881523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.055+0000 7f1386000640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1388151900 0x7f13881523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.055+0000 7f1386000640 1 -- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 msgr2=0x7f13881fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.055+0000 7f1386000640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 0x7f13881fb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.055+0000 7f1386000640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13881eddb0 con 0x7f13880cb7d0 2024-05-09T00:17:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.056+0000 7f1387400640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1388151900 0x7f13881523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.057+0000 7f1386000640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 0x7f1388153700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f137400c780 tx=0x7f137400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.057+0000 7f1386a00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 0x7f13881fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.058+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374018070 con 0x7f13880cb7d0 2024-05-09T00:17:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.058+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13740070d0 con 0x7f13880cb7d0 2024-05-09T00:17:35.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.058+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13881ee090 con 0x7f13880cb7d0 2024-05-09T00:17:35.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.058+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13881ee650 con 0x7f13880cb7d0 2024-05-09T00:17:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.062+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1388078350 con 0x7f13880cb7d0 2024-05-09T00:17:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.063+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13740074c0 con 0x7f13880cb7d0 2024-05-09T00:17:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.075+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f137401b070 con 0x7f13880cb7d0 2024-05-09T00:17:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.080+0000 7f137ea00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f13680763a0 0x7f13680788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.080+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f1374097470 con 0x7f13880cb7d0 2024-05-09T00:17:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.083+0000 7f1386a00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f13680763a0 0x7f13680788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:35.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.085+0000 7f1386a00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f13680763a0 0x7f13680788b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1378003f00 tx=0x7f1378009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.086+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1374022020 con 0x7f13880cb7d0 2024-05-09T00:17:35.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.658+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13880cc0b0 con 0x7f13880cb7d0 2024-05-09T00:17:35.659 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:35.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.660+0000 7f137ea00640 1 -- 172.21.15.114:0/3035535027 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5668 (secure 0 0 0) 0x7f1374060710 con 0x7f13880cb7d0 2024-05-09T00:17:35.660 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:34.605746+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:17:35.661 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2024-05-09T00:17:35.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f13680763a0 msgr2=0x7f13680788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f13680763a0 0x7f13680788b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1378003f00 tx=0x7f1378009040 comp rx=0 tx=0).stop 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 msgr2=0x7f1388153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 0x7f1388153700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f137400c780 tx=0x7f137400cc40 comp rx=0 tx=0).stop 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 shutdown_connections 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f13680763a0 0x7f13680788b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1388151900 0x7f13881523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13880cb7d0 0x7f1388153700 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 --2- 172.21.15.114:0/3035535027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138806de70 0x7f13881fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:35.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.667+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 >> 172.21.15.114:0/3035535027 conn(0x7f13880cd650 msgr2=0x7f13880acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:35.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.668+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 shutdown_connections 2024-05-09T00:17:35.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:35.668+0000 7f1387e00640 1 -- 172.21.15.114:0/3035535027 wait complete. 2024-05-09T00:17:35.712 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:17:37.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.261+0000 7f4875200640 1 Processor -- start 2024-05-09T00:17:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.261+0000 7f4875200640 1 -- start start 2024-05-09T00:17:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.262+0000 7f4875200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48700c4300 0x7f4870159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.263+0000 7f4875200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f48700c60f0 0x7f48700c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.263+0000 7f4875200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4870160820 con 0x7f487015c780 2024-05-09T00:17:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.263+0000 7f4875200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f48700c4f20 con 0x7f48700c4300 2024-05-09T00:17:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.263+0000 7f4875200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f48700c5680 con 0x7f48700c60f0 2024-05-09T00:17:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.264+0000 7f486d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f487015c780 0x7f4870072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46644/0 (socket says 172.21.15.114:46644) 2024-05-09T00:17:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.264+0000 7f486d400640 1 -- 172.21.15.114:0/1844874159 learned_addr learned my addr 172.21.15.114:0/1844874159 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:17:38.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.266+0000 7f486de00640 1 --2- 172.21.15.114:0/1844874159 >> v2:172.21.15.114:3300/0 conn(0x7f48700c4300 0x7f4870159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.266+0000 7f486ca00640 1 -- 172.21.15.114:0/1844874159 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451705793 0 0) 0x7f4870160820 con 0x7f487015c780 2024-05-09T00:17:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.266+0000 7f486ca00640 1 -- 172.21.15.114:0/1844874159 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4854003520 con 0x7f487015c780 2024-05-09T00:17:38.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.266+0000 7f486de00640 1 -- 172.21.15.114:0/1844874159 >> v2:172.21.15.153:3300/0 conn(0x7f48700c60f0 msgr2=0x7f48700c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:38.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.266+0000 7f486de00640 1 --2- 172.21.15.114:0/1844874159 >> v2:172.21.15.153:3300/0 conn(0x7f48700c60f0 0x7f48700c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.267+0000 7f486de00640 1 -- 172.21.15.114:0/1844874159 >> v1:172.21.15.114:6789/0 conn(0x7f487015c780 legacy=0x7f4870072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:38.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.267+0000 7f486de00640 1 -- 172.21.15.114:0/1844874159 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4870160b00 con 0x7f48700c4300 2024-05-09T00:17:38.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.269+0000 7f486de00640 1 --2- 172.21.15.114:0/1844874159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f4870159dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f487006d740 tx=0x7f485c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e98a1bcf2e2d8ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:38.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.270+0000 7f486ca00640 1 -- 172.21.15.114:0/1844874159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c037070 con 0x7f48700c4300 2024-05-09T00:17:38.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.270+0000 7f486ca00640 1 -- 172.21.15.114:0/1844874159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c02ad50 con 0x7f48700c4300 2024-05-09T00:17:38.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.270+0000 7f486ca00640 1 -- 172.21.15.114:0/1844874159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c032660 con 0x7f48700c4300 2024-05-09T00:17:38.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.273+0000 7f4875200640 1 -- 172.21.15.114:0/1844874159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 msgr2=0x7f4870159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:38.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.273+0000 7f4875200640 1 --2- 172.21.15.114:0/1844874159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f4870159dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f487006d740 tx=0x7f485c02a000 comp rx=0 tx=0).stop 2024-05-09T00:17:38.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.273+0000 7f4875200640 1 -- 172.21.15.114:0/1844874159 shutdown_connections 2024-05-09T00:17:38.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.273+0000 7f4875200640 1 --2- 172.21.15.114:0/1844874159 >> v2:172.21.15.153:3300/0 conn(0x7f48700c60f0 0x7f48700c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.273+0000 7f4875200640 1 --2- 172.21.15.114:0/1844874159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f4870159dc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.273+0000 7f4875200640 1 -- 172.21.15.114:0/1844874159 >> 172.21.15.114:0/1844874159 conn(0x7f487006c680 msgr2=0x7f487006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.274+0000 7f4875200640 1 -- 172.21.15.114:0/1844874159 shutdown_connections 2024-05-09T00:17:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.274+0000 7f4875200640 1 -- 172.21.15.114:0/1844874159 wait complete. 2024-05-09T00:17:38.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.295+0000 7f4875200640 1 Processor -- start 2024-05-09T00:17:38.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.297+0000 7f4875200640 1 -- start start 2024-05-09T00:17:38.310 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-05-09T00:17:38.302+0000 7feaf1000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:17:38.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.312+0000 7f4875200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f48701557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:38.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.313+0000 7f4875200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48700c60f0 0x7f48701f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.313+0000 7f486de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f48701557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.313+0000 7f486de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f48701557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47198/0 (socket says 172.21.15.114:47198) 2024-05-09T00:17:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.313+0000 7f486de00640 1 -- 172.21.15.114:0/955341490 learned_addr learned my addr 172.21.15.114:0/955341490 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.313+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487015c780 0x7f4870152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:38.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.314+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f48700c49c0 con 0x7f48700c4300 2024-05-09T00:17:38.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.314+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48700c5170 con 0x7f487015c780 2024-05-09T00:17:38.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.314+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f48700c4b40 con 0x7f48700c60f0 2024-05-09T00:17:38.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.317+0000 7f486de00640 1 -- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48700c60f0 msgr2=0x7f48701f2be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:17:38.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.319+0000 7f486d400640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48700c60f0 0x7f48701f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:38.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.320+0000 7f486e800640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487015c780 0x7f4870152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.324+0000 7f486de00640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48700c60f0 0x7f48701f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.324+0000 7f486de00640 1 -- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487015c780 msgr2=0x7f4870152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.324+0000 7f486de00640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487015c780 0x7f4870152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.324+0000 7f486de00640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48701f6710 con 0x7f48700c4300 2024-05-09T00:17:38.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.325+0000 7f486de00640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f48701557f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f485c009890 tx=0x7f485c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:38.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.330+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c042020 con 0x7f48700c4300 2024-05-09T00:17:38.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.330+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c03d670 con 0x7f48700c4300 2024-05-09T00:17:38.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.330+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4870153d90 con 0x7f48700c4300 2024-05-09T00:17:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.331+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48700af6c0 con 0x7f48700c4300 2024-05-09T00:17:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.334+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48701f6c10 con 0x7f48700c4300 2024-05-09T00:17:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.336+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c037040 con 0x7f48700c4300 2024-05-09T00:17:38.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.341+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f485c045020 con 0x7f48700c4300 2024-05-09T00:17:38.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.342+0000 7f4866000640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4850076350 0x7f4850078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:38.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.346+0000 7f486d400640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4850076350 0x7f4850078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:38.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.346+0000 7f486d400640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4850076350 0x7f4850078860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4860000f60 tx=0x7f4860009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:38.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.351+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f485c07d110 con 0x7f48700c4300 2024-05-09T00:17:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.367+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48701f6c10 con 0x7f48700c4300 2024-05-09T00:17:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.912+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4870077430 con 0x7f48700c4300 2024-05-09T00:17:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.913+0000 7f4866000640 1 -- 172.21.15.114:0/955341490 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5675 (secure 0 0 0) 0x7f485c081220 con 0x7f48700c4300 2024-05-09T00:17:38.915 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:38.915 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:17:38.916 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 56 2024-05-09T00:17:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4850076350 msgr2=0x7f4850078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4850076350 0x7f4850078860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4860000f60 tx=0x7f4860009040 comp rx=0 tx=0).stop 2024-05-09T00:17:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 msgr2=0x7f48701557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f48701557f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f485c009890 tx=0x7f485c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 shutdown_connections 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4850076350 0x7f4850078860 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487015c780 0x7f4870152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48700c60f0 0x7f48701f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 --2- 172.21.15.114:0/955341490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48700c4300 0x7f48701557f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.919+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 >> 172.21.15.114:0/955341490 conn(0x7f487006c680 msgr2=0x7f4870075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.922+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 shutdown_connections 2024-05-09T00:17:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:38.922+0000 7f4875200640 1 -- 172.21.15.114:0/955341490 wait complete. 2024-05-09T00:17:38.969 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=4888 2024-05-09T00:17:38.969 INFO:tasks.mds_thrash.fs.[b]:waiting for 2 secs before reviving mds.a 2024-05-09T00:17:40.969 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2024-05-09T00:17:40.970 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T00:17:40.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T00:17:40.980 INFO:tasks.ceph.mds.a:Started 2024-05-09T00:17:40.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:17:41.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.483+0000 7f4f27200640 1 Processor -- start 2024-05-09T00:17:41.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.483+0000 7f4f27200640 1 -- start start 2024-05-09T00:17:41.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.486+0000 7f4f27200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f18048d20 0x7f4f180d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:41.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.486+0000 7f4f27200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f1804bf90 0x7f4f1804c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:41.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.486+0000 7f4f27200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f180d95b0 con 0x7f4f180d91a0 2024-05-09T00:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.486+0000 7f4f27200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4f180dbd10 con 0x7f4f1804bf90 2024-05-09T00:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.486+0000 7f4f27200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f180dbf60 con 0x7f4f18048d20 2024-05-09T00:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.487+0000 7f4f1f400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4f180d91a0 0x7f4f1800a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:39134/0 (socket says 172.21.15.114:39134) 2024-05-09T00:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.487+0000 7f4f1f400640 1 -- 172.21.15.114:0/1953401043 learned_addr learned my addr 172.21.15.114:0/1953401043 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.488+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/1953401043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f18048d20 0x7f4f180d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.488+0000 7f4f25200640 1 --2- 172.21.15.114:0/1953401043 >> v2:172.21.15.114:3300/0 conn(0x7f4f1804bf90 0x7f4f1804c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:41.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.488+0000 7f4f25200640 1 -- 172.21.15.114:0/1953401043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f18048d20 msgr2=0x7f4f180d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:17:41.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.488+0000 7f4f25200640 1 --2- 172.21.15.114:0/1953401043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f18048d20 0x7f4f180d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:41.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.489+0000 7f4f25200640 1 -- 172.21.15.114:0/1953401043 >> v1:172.21.15.153:6789/0 conn(0x7f4f180d91a0 legacy=0x7f4f1800a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:41.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.489+0000 7f4f25200640 1 -- 172.21.15.114:0/1953401043 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f180dc240 con 0x7f4f1804bf90 2024-05-09T00:17:41.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.491+0000 7f4f25200640 1 --2- 172.21.15.114:0/1953401043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1804bf90 0x7f4f1804c3a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4f2006b2b0 tx=0x7f4f200a7cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6875889cd6e34621 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.492+0000 7f4f1ea00640 1 -- 172.21.15.114:0/1953401043 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200b5070 con 0x7f4f1804bf90 2024-05-09T00:17:41.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.492+0000 7f4f1ea00640 1 -- 172.21.15.114:0/1953401043 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200a88d0 con 0x7f4f1804bf90 2024-05-09T00:17:41.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.492+0000 7f4f1ea00640 1 -- 172.21.15.114:0/1953401043 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200b5070 con 0x7f4f1804bf90 2024-05-09T00:17:41.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.494+0000 7f4f27200640 1 -- 172.21.15.114:0/1953401043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1804bf90 msgr2=0x7f4f1804c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:41.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.494+0000 7f4f27200640 1 --2- 172.21.15.114:0/1953401043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1804bf90 0x7f4f1804c3a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4f2006b2b0 tx=0x7f4f200a7cd0 comp rx=0 tx=0).stop 2024-05-09T00:17:41.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.494+0000 7f4f27200640 1 -- 172.21.15.114:0/1953401043 shutdown_connections 2024-05-09T00:17:41.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.495+0000 7f4f27200640 1 --2- 172.21.15.114:0/1953401043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1804bf90 0x7f4f1804c3a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:41.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.495+0000 7f4f27200640 1 --2- 172.21.15.114:0/1953401043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f18048d20 0x7f4f180d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:41.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.495+0000 7f4f27200640 1 -- 172.21.15.114:0/1953401043 >> 172.21.15.114:0/1953401043 conn(0x7f4f1804aa00 msgr2=0x7f4f1804ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:41.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.496+0000 7f4f27200640 1 -- 172.21.15.114:0/1953401043 shutdown_connections 2024-05-09T00:17:41.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.496+0000 7f4f27200640 1 -- 172.21.15.114:0/1953401043 wait complete. 2024-05-09T00:17:41.495 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-05-09T00:17:41.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.501+0000 7f4f27200640 1 Processor -- start 2024-05-09T00:17:41.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.501+0000 7f4f27200640 1 -- start start 2024-05-09T00:17:41.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.504+0000 7f4f27200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f18048d20 0x7f4f180d7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:41.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.505+0000 7f4f27200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 0x7f4f18174fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.505+0000 7f4f27200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180d91a0 0x7f4f18175510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.505+0000 7f4f1fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f18048d20 0x7f4f180d7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.505+0000 7f4f1fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f18048d20 0x7f4f180d7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:56406/0 (socket says 172.21.15.114:56406) 2024-05-09T00:17:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.505+0000 7f4f1f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 0x7f4f18174fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:41.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.506+0000 7f4f1f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 0x7f4f18174fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:39174/0 (socket says 172.21.15.114:39174) 2024-05-09T00:17:41.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.506+0000 7f4f27200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1804a380 con 0x7f4f180d91a0 2024-05-09T00:17:41.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.506+0000 7f4f1fe00640 1 -- 172.21.15.114:0/3698583788 learned_addr learned my addr 172.21.15.114:0/3698583788 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:17:41.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.506+0000 7f4f25200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180d91a0 0x7f4f18175510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:41.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.507+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f180dc800 con 0x7f4f18048d20 2024-05-09T00:17:41.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.507+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1800abb0 con 0x7f4f1804bf90 2024-05-09T00:17:41.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.508+0000 7f4f1f400640 1 -- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f18048d20 msgr2=0x7f4f180d7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.509+0000 7f4f1f400640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f18048d20 0x7f4f180d7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.509+0000 7f4f1f400640 1 -- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180d91a0 msgr2=0x7f4f18175510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.509+0000 7f4f1f400640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180d91a0 0x7f4f18175510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.510+0000 7f4f1f400640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f180420e0 con 0x7f4f1804bf90 2024-05-09T00:17:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.510+0000 7f4f25200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180d91a0 0x7f4f18175510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:17:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.511+0000 7f4f1f400640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 0x7f4f18174fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800f2d0 tx=0x7f4f0c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:41.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.511+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c017070 con 0x7f4f1804bf90 2024-05-09T00:17:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.511+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c005ce0 con 0x7f4f1804bf90 2024-05-09T00:17:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.513+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c007310 con 0x7f4f1804bf90 2024-05-09T00:17:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.514+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f18044df0 con 0x7f4f1804bf90 2024-05-09T00:17:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.514+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f180d7140 con 0x7f4f1804bf90 2024-05-09T00:17:41.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.516+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f180d6f70 con 0x7f4f1804bf90 2024-05-09T00:17:41.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.519+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f0c01a070 con 0x7f4f1804bf90 2024-05-09T00:17:41.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.521+0000 7f4f13e00640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f000763d0 0x7f4f000788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:17:41.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.521+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f4f0c097310 con 0x7f4f1804bf90 2024-05-09T00:17:41.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.522+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f000763d0 0x7f4f000788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:41.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.523+0000 7f4f1fe00640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f000763d0 0x7f4f000788e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009b60 tx=0x7f4f14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:41.539+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f0c021020 con 0x7f4f1804bf90 2024-05-09T00:17:42.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.103+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f18045310 con 0x7f4f1804bf90 2024-05-09T00:17:42.104 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:17:42.104 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:17:42.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.105+0000 7f4f13e00640 1 -- 172.21.15.114:0/3698583788 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f4f18045310 con 0x7f4f1804bf90 2024-05-09T00:17:42.104 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:17:42.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.109+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f000763d0 msgr2=0x7f4f000788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:42.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.109+0000 7f4f27200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f000763d0 0x7f4f000788e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009b60 tx=0x7f4f14009190 comp rx=0 tx=0).stop 2024-05-09T00:17:42.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.109+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 msgr2=0x7f4f18174fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:42.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.109+0000 7f4f27200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 0x7f4f18174fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800f2d0 tx=0x7f4f0c00c820 comp rx=0 tx=0).stop 2024-05-09T00:17:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.110+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 shutdown_connections 2024-05-09T00:17:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.110+0000 7f4f27200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4f000763d0 0x7f4f000788e0 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009b60 tx=0x7f4f14009190 comp rx=0 tx=0).stop 2024-05-09T00:17:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.110+0000 7f4f27200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180d91a0 0x7f4f18175510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.110+0000 7f4f27200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f1804bf90 0x7f4f18174fd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.110+0000 7f4f27200640 1 --2- 172.21.15.114:0/3698583788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f18048d20 0x7f4f180d7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:17:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.110+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 >> 172.21.15.114:0/3698583788 conn(0x7f4f1804aa00 msgr2=0x7f4f180d89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:42.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.117+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 shutdown_connections 2024-05-09T00:17:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:17:42.117+0000 7f4f27200640 1 -- 172.21.15.114:0/3698583788 wait complete. 2024-05-09T00:17:42.202 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2024-05-09T00:17:42.203 INFO:tasks.mds_thrash.fs.[b]:waiting for 37 secs before thrashing 2024-05-09T00:17:45.544 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:17:45.562 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:18:11.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:11.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.977+0000 7f6554000640 1 Processor -- start 2024-05-09T00:18:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.977+0000 7f6554000640 1 -- start start 2024-05-09T00:18:11.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.980+0000 7f6554000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c158460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:11.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.980+0000 7f6551600640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f654c0af570 0x7f654c0c60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:38704/0 (socket says 172.21.15.114:38704) 2024-05-09T00:18:11.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.982+0000 7f6554000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654c0748f0 con 0x7f654c0706c0 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.982+0000 7f6554000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654c154420 con 0x7f654c0af570 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.982+0000 7f6554000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f654c073430 con 0x7f654c0c5bb0 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.982+0000 7f6552000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.982+0000 7f6552000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:39752/0 (socket says 172.21.15.114:39752) 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.982+0000 7f6552000640 1 -- 172.21.15.114:0/4111346661 learned_addr learned my addr 172.21.15.114:0/4111346661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.984+0000 7f6552000640 1 -- 172.21.15.114:0/4111346661 >> v1:172.21.15.153:6789/0 conn(0x7f654c0af570 legacy=0x7f654c0c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.984+0000 7f6552000640 1 -- 172.21.15.114:0/4111346661 >> v1:172.21.15.114:6789/0 conn(0x7f654c0706c0 legacy=0x7f654c157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.984+0000 7f6552000640 1 -- 172.21.15.114:0/4111346661 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c0c4d00 con 0x7f654c0c5bb0 2024-05-09T00:18:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.988+0000 7f6552000640 1 --2- 172.21.15.114:0/4111346661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c158460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6544014480 tx=0x7f6544032cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a0b1ffdb8979c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:11.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.989+0000 7f654be00640 1 -- 172.21.15.114:0/4111346661 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544003b90 con 0x7f654c0c5bb0 2024-05-09T00:18:11.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.989+0000 7f654be00640 1 -- 172.21.15.114:0/4111346661 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6544003d30 con 0x7f654c0c5bb0 2024-05-09T00:18:11.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.989+0000 7f654be00640 1 -- 172.21.15.114:0/4111346661 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544033a00 con 0x7f654c0c5bb0 2024-05-09T00:18:11.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.991+0000 7f6554000640 1 -- 172.21.15.114:0/4111346661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 msgr2=0x7f654c158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:11.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.991+0000 7f6554000640 1 --2- 172.21.15.114:0/4111346661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c158460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6544014480 tx=0x7f6544032cb0 comp rx=0 tx=0).stop 2024-05-09T00:18:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.992+0000 7f6554000640 1 -- 172.21.15.114:0/4111346661 shutdown_connections 2024-05-09T00:18:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.992+0000 7f6554000640 1 --2- 172.21.15.114:0/4111346661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c158460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.992+0000 7f6554000640 1 -- 172.21.15.114:0/4111346661 >> 172.21.15.114:0/4111346661 conn(0x7f654c06c680 msgr2=0x7f654c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:11.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.994+0000 7f6554000640 1 -- 172.21.15.114:0/4111346661 shutdown_connections 2024-05-09T00:18:11.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.994+0000 7f6554000640 1 -- 172.21.15.114:0/4111346661 wait complete. 2024-05-09T00:18:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:11.999+0000 7f6554000640 1 Processor -- start 2024-05-09T00:18:12.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.000+0000 7f6554000640 1 -- start start 2024-05-09T00:18:12.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.006+0000 7f6554000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0706c0 0x7f654c0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:12.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.006+0000 7f6554000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c0af570 0x7f654c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:12.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.006+0000 7f6554000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:12.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.007+0000 7f6551600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0706c0 0x7f654c0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.007+0000 7f6551600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0706c0 0x7f654c0c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:59670/0 (socket says 172.21.15.114:59670) 2024-05-09T00:18:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.008+0000 7f6551600640 1 -- 172.21.15.114:0/3207043306 learned_addr learned my addr 172.21.15.114:0/3207043306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.008+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f654c073710 con 0x7f654c0af570 2024-05-09T00:18:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.008+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f654c073130 con 0x7f654c0706c0 2024-05-09T00:18:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.008+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f654c0c6800 con 0x7f654c0c5bb0 2024-05-09T00:18:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.009+0000 7f6550c00640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c0af570 0x7f654c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.009+0000 7f6552000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.010+0000 7f6552000640 1 -- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0706c0 msgr2=0x7f654c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:12.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.010+0000 7f6552000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0706c0 0x7f654c0c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.010+0000 7f6552000640 1 -- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c0af570 msgr2=0x7f654c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.010+0000 7f6552000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c0af570 0x7f654c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.010+0000 7f6552000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c143770 con 0x7f654c0c5bb0 2024-05-09T00:18:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.012+0000 7f6552000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c0c80e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6544004000 tx=0x7f6544004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.013+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544033e60 con 0x7f654c0c5bb0 2024-05-09T00:18:12.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.013+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654c0c7600 con 0x7f654c0c5bb0 2024-05-09T00:18:12.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.013+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f654c0c7bc0 con 0x7f654c0c5bb0 2024-05-09T00:18:12.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.014+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f654404c070 con 0x7f654c0c5bb0 2024-05-09T00:18:12.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.014+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544033e60 con 0x7f654c0c5bb0 2024-05-09T00:18:12.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.016+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6528005290 con 0x7f654c0c5bb0 2024-05-09T00:18:12.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.019+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6544047470 con 0x7f654c0c5bb0 2024-05-09T00:18:12.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.020+0000 7f6549600640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f652c076500 0x7f652c078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:12.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.020+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f65440c0c50 con 0x7f654c0c5bb0 2024-05-09T00:18:12.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.024+0000 7f6551600640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f652c076500 0x7f652c078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:12.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.026+0000 7f6551600640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f652c076500 0x7f652c078a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6540000f60 tx=0x7f6540007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.032+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f65440898b0 con 0x7f654c0c5bb0 2024-05-09T00:18:12.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.639+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6528005580 con 0x7f654c0c5bb0 2024-05-09T00:18:12.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.642+0000 7f6549600640 1 -- 172.21.15.114:0/3207043306 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f654408dbb0 con 0x7f654c0c5bb0 2024-05-09T00:18:12.645 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:12.645 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:12.646 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:12.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.652+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f652c076500 msgr2=0x7f652c078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:12.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.652+0000 7f6554000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f652c076500 0x7f652c078a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6540000f60 tx=0x7f6540007eb0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.652+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 msgr2=0x7f654c0c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:12.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.652+0000 7f6554000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c0c80e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6544004000 tx=0x7f6544004a40 comp rx=0 tx=0).stop 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 shutdown_connections 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f652c076500 0x7f652c078a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c0c5bb0 0x7f654c0c80e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c0af570 0x7f654c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 --2- 172.21.15.114:0/3207043306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0706c0 0x7f654c0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 >> 172.21.15.114:0/3207043306 conn(0x7f654c06c680 msgr2=0x7f654c1511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:12.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.653+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 shutdown_connections 2024-05-09T00:18:12.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:12.658+0000 7f6554000640 1 -- 172.21.15.114:0/3207043306 wait complete. 2024-05-09T00:18:12.716 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-05-09T00:18:12.717 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T00:18:12.717 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:18:12.778 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T00:18:12.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.360+0000 7fe6abe00640 1 Processor -- start 2024-05-09T00:18:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.360+0000 7fe6abe00640 1 -- start start 2024-05-09T00:18:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.368+0000 7fe6abe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.368+0000 7fe6abe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6ac072530 0x7fe6ac15ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:13.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.368+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:13.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.368+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:39772/0 (socket says 172.21.15.114:39772) 2024-05-09T00:18:13.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.370+0000 7fe6ab400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6ac072530 0x7fe6ac15ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:13.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.370+0000 7fe6aa000640 1 -- 172.21.15.114:0/2467575218 learned_addr learned my addr 172.21.15.114:0/2467575218 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:13.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.370+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac0701f0 con 0x7fe6ac06e610 2024-05-09T00:18:13.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.370+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ac0c4cc0 con 0x7fe6ac072530 2024-05-09T00:18:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.370+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0c54b0 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.372+0000 7fe6ab400640 1 -- 172.21.15.114:0/2467575218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 msgr2=0x7fe6ac071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.372+0000 7fe6ab400640 1 --2- 172.21.15.114:0/2467575218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.372+0000 7fe6ab400640 1 -- 172.21.15.114:0/2467575218 >> v1:172.21.15.114:6789/0 conn(0x7fe6ac06e610 legacy=0x7fe6ac0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.372+0000 7fe6ab400640 1 -- 172.21.15.114:0/2467575218 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0c5790 con 0x7fe6ac072530 2024-05-09T00:18:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.376+0000 7fe6ab400640 1 --2- 172.21.15.114:0/2467575218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac072530 0x7fe6ac15ffd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b050 tx=0x7fe6a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432a6f80215e487 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.376+0000 7fe6a9600640 1 -- 172.21.15.114:0/2467575218 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4031600 con 0x7fe6ac072530 2024-05-09T00:18:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.376+0000 7fe6a9600640 1 -- 172.21.15.114:0/2467575218 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a40317a0 con 0x7fe6ac072530 2024-05-09T00:18:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.378+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac072530 msgr2=0x7fe6ac15ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.378+0000 7fe6abe00640 1 --2- 172.21.15.114:0/2467575218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac072530 0x7fe6ac15ffd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b050 tx=0x7fe6a402a730 comp rx=0 tx=0).stop 2024-05-09T00:18:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.378+0000 7fe6a9600640 1 -- 172.21.15.114:0/2467575218 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4031600 con 0x7fe6ac072530 2024-05-09T00:18:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.379+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 shutdown_connections 2024-05-09T00:18:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.379+0000 7fe6abe00640 1 --2- 172.21.15.114:0/2467575218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac072530 0x7fe6ac15ffd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.379+0000 7fe6abe00640 1 --2- 172.21.15.114:0/2467575218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.379+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 >> 172.21.15.114:0/2467575218 conn(0x7fe6ac0c92e0 msgr2=0x7fe6ac0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.379+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 shutdown_connections 2024-05-09T00:18:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.379+0000 7fe6abe00640 1 -- 172.21.15.114:0/2467575218 wait complete. 2024-05-09T00:18:13.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.386+0000 7fe6abe00640 1 Processor -- start 2024-05-09T00:18:13.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.386+0000 7fe6abe00640 1 -- start start 2024-05-09T00:18:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.390+0000 7fe6abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac06e610 0x7fe6ac0c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.391+0000 7fe6abe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac072530 0x7fe6ac0be300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.391+0000 7fe6abe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac1fde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.391+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac072530 0x7fe6ac0be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.391+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac072530 0x7fe6ac0be300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:59686/0 (socket says 172.21.15.114:59686) 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6ab400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac1fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6ab400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac1fde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:39776/0 (socket says 172.21.15.114:39776) 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6ab400640 1 -- 172.21.15.114:0/747607994 learned_addr learned my addr 172.21.15.114:0/747607994 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6aaa00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac06e610 0x7fe6ac0c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0c8c20 con 0x7fe6ac06e610 2024-05-09T00:18:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac06fb00 con 0x7fe6ac072530 2024-05-09T00:18:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.393+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0c8da0 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.394+0000 7fe6ab400640 1 -- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac072530 msgr2=0x7fe6ac0be300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.394+0000 7fe6ab400640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac072530 0x7fe6ac0be300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.394+0000 7fe6ab400640 1 -- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac06e610 msgr2=0x7fe6ac0c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.394+0000 7fe6ab400640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac06e610 0x7fe6ac0c15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.394+0000 7fe6ab400640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0a8b90 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.395+0000 7fe6ab400640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac1fde70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b170 tx=0x7fe6a4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.395+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4040070 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.396+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac0c2390 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.397+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac0c2950 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.398+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a4004260 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.398+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4009450 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.401+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe684005290 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.408+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe6a4039040 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.410+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe68c0762d0 0x7fe68c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:13.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.411+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7fe6a40b9530 con 0x7fe6ac0c48b0 2024-05-09T00:18:13.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.412+0000 7fe6aaa00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe68c0762d0 0x7fe68c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:13.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.413+0000 7fe6aaa00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe68c0762d0 0x7fe68c0787e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac074380 tx=0x7fe69c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:13.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:13.422+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe6a404a060 con 0x7fe6ac0c48b0 2024-05-09T00:18:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.011+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe684005580 con 0x7fe6ac0c48b0 2024-05-09T00:18:14.020 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:14.020 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.018+0000 7fe6a2a00640 1 -- 172.21.15.114:0/747607994 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7fe6a4082860 con 0x7fe6ac0c48b0 2024-05-09T00:18:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe68c0762d0 msgr2=0x7fe68c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe68c0762d0 0x7fe68c0787e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac074380 tx=0x7fe69c009040 comp rx=0 tx=0).stop 2024-05-09T00:18:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 msgr2=0x7fe6ac1fde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac1fde70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b170 tx=0x7fe6a4004a40 comp rx=0 tx=0).stop 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 shutdown_connections 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe68c0762d0 0x7fe68c0787e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6ac0c48b0 0x7fe6ac1fde70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac072530 0x7fe6ac0be300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 --2- 172.21.15.114:0/747607994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6ac06e610 0x7fe6ac0c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.025+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 >> 172.21.15.114:0/747607994 conn(0x7fe6ac0c92e0 msgr2=0x7fe6ac0ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.026+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 shutdown_connections 2024-05-09T00:18:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:14.026+0000 7fe6abe00640 1 -- 172.21.15.114:0/747607994 wait complete. 2024-05-09T00:18:14.098 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:18:15.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:18:15.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:18:16.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:16.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.601+0000 7f456ae00640 1 Processor -- start 2024-05-09T00:18:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.602+0000 7f456ae00640 1 -- start start 2024-05-09T00:18:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.603+0000 7f456ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 0x7f456406f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.603+0000 7f456ae00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4564072950 0x7f4564072d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.603+0000 7f456ae00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4564160a00 con 0x7f45640c51a0 2024-05-09T00:18:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.603+0000 7f456ae00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f45641604d0 con 0x7f4564072950 2024-05-09T00:18:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.603+0000 7f456ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f45640c49e0 con 0x7f456406f530 2024-05-09T00:18:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.604+0000 7f4563400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 0x7f456406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.605+0000 7f4563400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 0x7f456406f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:39792/0 (socket says 172.21.15.114:39792) 2024-05-09T00:18:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.605+0000 7f4563400640 1 -- 172.21.15.114:0/3681881596 learned_addr learned my addr 172.21.15.114:0/3681881596 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:16.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.607+0000 7f4568e00640 1 --2- 172.21.15.114:0/3681881596 >> v2:172.21.15.153:3300/0 conn(0x7f4564072950 0x7f4564072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.608+0000 7f4563400640 1 -- 172.21.15.114:0/3681881596 >> v2:172.21.15.153:3300/0 conn(0x7f4564072950 msgr2=0x7f4564072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:16.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.608+0000 7f4563400640 1 --2- 172.21.15.114:0/3681881596 >> v2:172.21.15.153:3300/0 conn(0x7f4564072950 0x7f4564072d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:16.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.608+0000 7f4563400640 1 -- 172.21.15.114:0/3681881596 >> v1:172.21.15.153:6789/0 conn(0x7f45640c51a0 legacy=0x7f4564159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.608+0000 7f4563400640 1 -- 172.21.15.114:0/3681881596 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45640c4470 con 0x7f456406f530 2024-05-09T00:18:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.613+0000 7f4563400640 1 --2- 172.21.15.114:0/3681881596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 0x7f456406f940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f455001a870 tx=0x7f455003b150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de899578bb4594bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.614+0000 7f4562a00640 1 -- 172.21.15.114:0/3681881596 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550048070 con 0x7f456406f530 2024-05-09T00:18:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.614+0000 7f4562a00640 1 -- 172.21.15.114:0/3681881596 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4550043440 con 0x7f456406f530 2024-05-09T00:18:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.615+0000 7f4562a00640 1 -- 172.21.15.114:0/3681881596 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550048070 con 0x7f456406f530 2024-05-09T00:18:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.616+0000 7f456ae00640 1 -- 172.21.15.114:0/3681881596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 msgr2=0x7f456406f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.616+0000 7f456ae00640 1 --2- 172.21.15.114:0/3681881596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 0x7f456406f940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f455001a870 tx=0x7f455003b150 comp rx=0 tx=0).stop 2024-05-09T00:18:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.617+0000 7f456ae00640 1 -- 172.21.15.114:0/3681881596 shutdown_connections 2024-05-09T00:18:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.617+0000 7f456ae00640 1 --2- 172.21.15.114:0/3681881596 >> v2:172.21.15.153:3300/0 conn(0x7f4564072950 0x7f4564072d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.617+0000 7f456ae00640 1 --2- 172.21.15.114:0/3681881596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f456406f530 0x7f456406f940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.617+0000 7f456ae00640 1 -- 172.21.15.114:0/3681881596 >> 172.21.15.114:0/3681881596 conn(0x7f45640c98e0 msgr2=0x7f45640c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.617+0000 7f456ae00640 1 -- 172.21.15.114:0/3681881596 shutdown_connections 2024-05-09T00:18:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.617+0000 7f456ae00640 1 -- 172.21.15.114:0/3681881596 wait complete. 2024-05-09T00:18:16.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.623+0000 7f456ae00640 1 Processor -- start 2024-05-09T00:18:16.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.623+0000 7f456ae00640 1 -- start start 2024-05-09T00:18:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.626+0000 7f456ae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f456406f530 0x7f45641ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.626+0000 7f456ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4564072950 0x7f456415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.626+0000 7f456ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 0x7f4564148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.626+0000 7f456ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f45640c5900 con 0x7f4564072950 2024-05-09T00:18:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.626+0000 7f456ae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45640c4c80 con 0x7f456406f530 2024-05-09T00:18:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.626+0000 7f456ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f45640c5a80 con 0x7f45640c51a0 2024-05-09T00:18:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.627+0000 7f4568e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 0x7f4564148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.627+0000 7f4568e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 0x7f4564148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:39804/0 (socket says 172.21.15.114:39804) 2024-05-09T00:18:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.627+0000 7f4568e00640 1 -- 172.21.15.114:0/1255634945 learned_addr learned my addr 172.21.15.114:0/1255634945 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.627+0000 7f4563400640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4564072950 0x7f456415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.627+0000 7f4563e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f456406f530 0x7f45641ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.629+0000 7f4568e00640 1 -- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f456406f530 msgr2=0x7f45641ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.629+0000 7f4568e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f456406f530 0x7f45641ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.630+0000 7f4568e00640 1 -- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4564072950 msgr2=0x7f456415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.630+0000 7f4568e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4564072950 0x7f456415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.630+0000 7f4568e00640 1 -- 172.21.15.114:0/1255634945 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456415ce00 con 0x7f45640c51a0 2024-05-09T00:18:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.630+0000 7f4563e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f456406f530 0x7f45641ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.630+0000 7f4563400640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4564072950 0x7f456415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.631+0000 7f4568e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 0x7f4564148430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f455c007d40 tx=0x7f455c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.632+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c014420 con 0x7f45640c51a0 2024-05-09T00:18:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.632+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c019070 con 0x7f45640c51a0 2024-05-09T00:18:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.632+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c014820 con 0x7f45640c51a0 2024-05-09T00:18:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.634+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45641ede10 con 0x7f45640c51a0 2024-05-09T00:18:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.635+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f456415bc10 con 0x7f45640c51a0 2024-05-09T00:18:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.637+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4564077430 con 0x7f45640c51a0 2024-05-09T00:18:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.644+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f455c0149c0 con 0x7f45640c51a0 2024-05-09T00:18:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.647+0000 7f455be00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4544076350 0x7f4544078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.648+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f455c098f60 con 0x7f45640c51a0 2024-05-09T00:18:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.649+0000 7f4563e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4544076350 0x7f4544078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.652+0000 7f4563e00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4544076350 0x7f4544078860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f456406f420 tx=0x7f4554009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:16.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:16.663+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f455c061d40 con 0x7f45640c51a0 2024-05-09T00:18:17.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.339+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45640acfc0 con 0x7f45640c51a0 2024-05-09T00:18:17.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.347+0000 7f455be00640 1 -- 172.21.15.114:0/1255634945 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f45640acfc0 con 0x7f45640c51a0 2024-05-09T00:18:17.349 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:17.349 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:17.349 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.355+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4544076350 msgr2=0x7f4544078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.355+0000 7f456ae00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4544076350 0x7f4544078860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f456406f420 tx=0x7f4554009040 comp rx=0 tx=0).stop 2024-05-09T00:18:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.355+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 msgr2=0x7f4564148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.355+0000 7f456ae00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 0x7f4564148430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f455c007d40 tx=0x7f455c00e4b0 comp rx=0 tx=0).stop 2024-05-09T00:18:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.356+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 shutdown_connections 2024-05-09T00:18:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.356+0000 7f456ae00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f4544076350 0x7f4544078860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.357+0000 7f456ae00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45640c51a0 0x7f4564148430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.357+0000 7f456ae00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4564072950 0x7f456415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.357+0000 7f456ae00640 1 --2- 172.21.15.114:0/1255634945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f456406f530 0x7f45641ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.357+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 >> 172.21.15.114:0/1255634945 conn(0x7f45640c98e0 msgr2=0x7f4564159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.357+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 shutdown_connections 2024-05-09T00:18:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:17.357+0000 7f456ae00640 1 -- 172.21.15.114:0/1255634945 wait complete. 2024-05-09T00:18:17.428 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:18:19.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:19.429 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:19.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.747+0000 7f7552400640 1 Processor -- start 2024-05-09T00:18:19.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.747+0000 7f7552400640 1 -- start start 2024-05-09T00:18:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.750+0000 7f7552400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f754c0acbe0 0x7f754c0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.758+0000 7f7552400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 0x7f754c1604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.758+0000 7f7552400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754c0ac250 con 0x7f754c1609f0 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.758+0000 7f7552400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f754c0c4bf0 con 0x7f754c0acbe0 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.758+0000 7f7552400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f754c160e00 con 0x7f754c0c4620 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.759+0000 7f754be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 0x7f754c1604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.759+0000 7f754be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 0x7f754c1604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51166/0 (socket says 172.21.15.114:51166) 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.759+0000 7f754be00640 1 -- 172.21.15.114:0/3090417658 learned_addr learned my addr 172.21.15.114:0/3090417658 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.759+0000 7f7551000640 1 --2- 172.21.15.114:0/3090417658 >> v2:172.21.15.114:3300/0 conn(0x7f754c0acbe0 0x7f754c0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.761+0000 7f754be00640 1 -- 172.21.15.114:0/3090417658 >> v2:172.21.15.114:3300/0 conn(0x7f754c0acbe0 msgr2=0x7f754c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:19.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.763+0000 7f754b400640 1 -- 172.21.15.114:0/3090417658 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871720881 0 0) 0x7f754c0ac250 con 0x7f754c1609f0 2024-05-09T00:18:19.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.763+0000 7f754be00640 1 --2- 172.21.15.114:0/3090417658 >> v2:172.21.15.114:3300/0 conn(0x7f754c0acbe0 0x7f754c0c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:19.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.763+0000 7f754be00640 1 -- 172.21.15.114:0/3090417658 >> v1:172.21.15.114:6789/0 conn(0x7f754c1609f0 legacy=0x7f754c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.768+0000 7f754be00640 1 -- 172.21.15.114:0/3090417658 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c0abaf0 con 0x7f754c0c4620 2024-05-09T00:18:19.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.768+0000 7f7551000640 1 --2- 172.21.15.114:0/3090417658 >> v2:172.21.15.114:3300/0 conn(0x7f754c0acbe0 0x7f754c0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:19.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.770+0000 7f754be00640 1 --2- 172.21.15.114:0/3090417658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 0x7f754c1604b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753802a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e01ae6f88da86a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:19.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.771+0000 7f754b400640 1 -- 172.21.15.114:0/3090417658 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538037070 con 0x7f754c0c4620 2024-05-09T00:18:19.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.771+0000 7f754b400640 1 -- 172.21.15.114:0/3090417658 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7538032440 con 0x7f754c0c4620 2024-05-09T00:18:19.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.771+0000 7f754b400640 1 -- 172.21.15.114:0/3090417658 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538032810 con 0x7f754c0c4620 2024-05-09T00:18:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.775+0000 7f7552400640 1 -- 172.21.15.114:0/3090417658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 msgr2=0x7f754c1604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.775+0000 7f7552400640 1 --2- 172.21.15.114:0/3090417658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 0x7f754c1604b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753802a140 comp rx=0 tx=0).stop 2024-05-09T00:18:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.776+0000 7f7552400640 1 -- 172.21.15.114:0/3090417658 shutdown_connections 2024-05-09T00:18:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.776+0000 7f7552400640 1 --2- 172.21.15.114:0/3090417658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0c4620 0x7f754c1604b0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753802a140 comp rx=0 tx=0).stop 2024-05-09T00:18:19.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.776+0000 7f7552400640 1 --2- 172.21.15.114:0/3090417658 >> v2:172.21.15.114:3300/0 conn(0x7f754c0acbe0 0x7f754c0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:19.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.776+0000 7f7552400640 1 -- 172.21.15.114:0/3090417658 >> 172.21.15.114:0/3090417658 conn(0x7f754c0aaeb0 msgr2=0x7f754c0ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:19.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.777+0000 7f7552400640 1 -- 172.21.15.114:0/3090417658 shutdown_connections 2024-05-09T00:18:19.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.777+0000 7f7552400640 1 -- 172.21.15.114:0/3090417658 wait complete. 2024-05-09T00:18:19.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.787+0000 7f7552400640 1 Processor -- start 2024-05-09T00:18:19.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.788+0000 7f7552400640 1 -- start start 2024-05-09T00:18:19.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.795+0000 7f7552400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 0x7f754c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.796+0000 7f7551000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 0x7f754c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.796+0000 7f7551000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 0x7f754c15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51170/0 (socket says 172.21.15.114:51170) 2024-05-09T00:18:19.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.795+0000 7f7552400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f754c1609f0 0x7f754c0a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.797+0000 7f7551000640 1 -- 172.21.15.114:0/1935039009 learned_addr learned my addr 172.21.15.114:0/1935039009 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:19.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.797+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f754c073d90 0x7f754c1f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.797+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0ae550 con 0x7f754c1609f0 2024-05-09T00:18:19.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.797+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0c5950 con 0x7f754c073d90 2024-05-09T00:18:19.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.798+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f754c0ae6d0 con 0x7f754c0acbe0 2024-05-09T00:18:19.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.798+0000 7f754be00640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f754c1609f0 0x7f754c0a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.798+0000 7f7551a00640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f754c073d90 0x7f754c1f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.800+0000 7f7551000640 1 -- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f754c073d90 msgr2=0x7f754c1f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.800+0000 7f7551000640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f754c073d90 0x7f754c1f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.800+0000 7f7551000640 1 -- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f754c1609f0 msgr2=0x7f754c0a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.800+0000 7f7551000640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f754c1609f0 0x7f754c0a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:19.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.801+0000 7f754be00640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f754c1609f0 0x7f754c0a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:19.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.802+0000 7f7551000640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c1534a0 con 0x7f754c0acbe0 2024-05-09T00:18:19.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.803+0000 7f7551000640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 0x7f754c15b300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f753c00e940 tx=0x7f753c00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:19.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.804+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c017070 con 0x7f754c0acbe0 2024-05-09T00:18:19.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.804+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c153930 con 0x7f754c0acbe0 2024-05-09T00:18:19.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.804+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c00ca00 con 0x7f754c0acbe0 2024-05-09T00:18:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.804+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c017070 con 0x7f754c0acbe0 2024-05-09T00:18:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.805+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c0721b0 con 0x7f754c0acbe0 2024-05-09T00:18:19.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.811+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c078350 con 0x7f754c0acbe0 2024-05-09T00:18:19.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.822+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f753c01a070 con 0x7f754c0acbe0 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.836+0000 7f7548c00640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f752c0764d0 0x7f752c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.836+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f753c097850 con 0x7f754c0acbe0 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.839+0000 7f754be00640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f752c0764d0 0x7f752c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.839+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f753c0609e0 con 0x7f754c0acbe0 2024-05-09T00:18:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.841+0000 7f754be00640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f752c0764d0 0x7f752c0789e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7538034000 tx=0x7f753802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:19.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.985+0000 7f1792000640 1 Processor -- start 2024-05-09T00:18:19.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.985+0000 7f1792000640 1 -- start start 2024-05-09T00:18:19.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f1792000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f1792000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f178c1545c0 0x7f178c15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:19.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f1792000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178c1581b0 con 0x7f178c0aebf0 2024-05-09T00:18:19.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f178b400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f178c0aebf0 0x7f178c0c5180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:33662/0 (socket says 172.21.15.114:33662) 2024-05-09T00:18:19.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f178b400640 1 -- 172.21.15.114:0/3018032871 learned_addr learned my addr 172.21.15.114:0/3018032871 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f178c158490 con 0x7f178c1545c0 2024-05-09T00:18:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.994+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f178c06e240 con 0x7f178c0ae490 2024-05-09T00:18:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.995+0000 7f178be00640 1 --2- 172.21.15.114:0/3018032871 >> v2:172.21.15.114:3300/0 conn(0x7f178c1545c0 0x7f178c15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.996+0000 7f178be00640 1 -- 172.21.15.114:0/3018032871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 msgr2=0x7f178c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.996+0000 7f178be00640 1 --2- 172.21.15.114:0/3018032871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:19.996+0000 7f178be00640 1 -- 172.21.15.114:0/3018032871 >> v1:172.21.15.153:6789/0 conn(0x7f178c0aebf0 legacy=0x7f178c0c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:19.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.000+0000 7f178be00640 1 -- 172.21.15.114:0/3018032871 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c06e520 con 0x7f178c1545c0 2024-05-09T00:18:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.003+0000 7f178be00640 1 --2- 172.21.15.114:0/3018032871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c1545c0 0x7f178c15ea00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1784009d90 tx=0x7f178402a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d103945dbff8640f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:20.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.005+0000 7f178a000640 1 -- 172.21.15.114:0/3018032871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784007740 con 0x7f178c1545c0 2024-05-09T00:18:20.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.005+0000 7f178a000640 1 -- 172.21.15.114:0/3018032871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17840078e0 con 0x7f178c1545c0 2024-05-09T00:18:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.005+0000 7f178a000640 1 -- 172.21.15.114:0/3018032871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784007cb0 con 0x7f178c1545c0 2024-05-09T00:18:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.006+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c1545c0 msgr2=0x7f178c15ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.006+0000 7f1792000640 1 --2- 172.21.15.114:0/3018032871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c1545c0 0x7f178c15ea00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1784009d90 tx=0x7f178402a490 comp rx=0 tx=0).stop 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.008+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 shutdown_connections 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.008+0000 7f1792000640 1 --2- 172.21.15.114:0/3018032871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c1545c0 0x7f178c15ea00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.008+0000 7f1792000640 1 --2- 172.21.15.114:0/3018032871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.008+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 >> 172.21.15.114:0/3018032871 conn(0x7f178c0c5ea0 msgr2=0x7f178c0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.009+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 shutdown_connections 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.009+0000 7f1792000640 1 -- 172.21.15.114:0/3018032871 wait complete. 2024-05-09T00:18:20.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.013+0000 7f1792000640 1 Processor -- start 2024-05-09T00:18:20.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.020+0000 7f1792000640 1 -- start start 2024-05-09T00:18:20.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.027+0000 7f1792000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c1fef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:20.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.028+0000 7f1792000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c0aebf0 0x7f178c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:20.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.028+0000 7f178b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c1fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:20.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.028+0000 7f178b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c1fef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51190/0 (socket says 172.21.15.114:51190) 2024-05-09T00:18:20.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.028+0000 7f178b400640 1 -- 172.21.15.114:0/236822625 learned_addr learned my addr 172.21.15.114:0/236822625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:20.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.028+0000 7f1792000640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c1545c0 0x7f178c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:20.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.028+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0c5a10 con 0x7f178c0aebf0 2024-05-09T00:18:20.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.029+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0c5890 con 0x7f178c1545c0 2024-05-09T00:18:20.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.029+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f178c0742d0 con 0x7f178c0ae490 2024-05-09T00:18:20.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.029+0000 7f178be00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c1545c0 0x7f178c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:20.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.029+0000 7f178aa00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c0aebf0 0x7f178c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:20.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.030+0000 7f178b400640 1 -- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c1545c0 msgr2=0x7f178c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.030+0000 7f178b400640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c1545c0 0x7f178c150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.030+0000 7f178b400640 1 -- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c0aebf0 msgr2=0x7f178c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.030+0000 7f178b400640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c0aebf0 0x7f178c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.030+0000 7f178b400640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c0c8a30 con 0x7f178c0ae490 2024-05-09T00:18:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.030+0000 7f178be00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c1545c0 0x7f178c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.031+0000 7f178aa00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c0aebf0 0x7f178c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.032+0000 7f178b400640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c1fef30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f177c00b410 tx=0x7f177c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:20.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.034+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c015020 con 0x7f178c0ae490 2024-05-09T00:18:20.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.034+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c1fe730 con 0x7f178c0ae490 2024-05-09T00:18:20.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.034+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c1ff470 con 0x7f178c0ae490 2024-05-09T00:18:20.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.034+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c011830 con 0x7f178c0ae490 2024-05-09T00:18:20.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.034+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c015020 con 0x7f178c0ae490 2024-05-09T00:18:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.041+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1764005290 con 0x7f178c0ae490 2024-05-09T00:18:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.044+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f177c018020 con 0x7f178c0ae490 2024-05-09T00:18:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.045+0000 7f1783400640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f176c076500 0x7f176c078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.046+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f177c097910 con 0x7f178c0ae490 2024-05-09T00:18:20.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.047+0000 7f178aa00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f176c076500 0x7f176c078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:20.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.048+0000 7f178aa00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f176c076500 0x7f176c078a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f178c06eed0 tx=0x7f1778008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:20.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.056+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f177c01f020 con 0x7f178c0ae490 2024-05-09T00:18:20.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.474+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f754c0ae0c0 con 0x7f754c0acbe0 2024-05-09T00:18:20.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.476+0000 7f7548c00640 1 -- 172.21.15.114:0/1935039009 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f753c0602e0 con 0x7f754c0acbe0 2024-05-09T00:18:20.475 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:20.475 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:20.475 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.483+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f752c0764d0 msgr2=0x7f752c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.483+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f752c0764d0 0x7f752c0789e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7538034000 tx=0x7f753802e000 comp rx=0 tx=0).stop 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.483+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 msgr2=0x7f754c15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.483+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 0x7f754c15b300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f753c00e940 tx=0x7f753c00ee00 comp rx=0 tx=0).stop 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.484+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 shutdown_connections 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.484+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f752c0764d0 0x7f752c0789e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.484+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f754c073d90 0x7f754c1f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.484+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f754c1609f0 0x7f754c0a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.484+0000 7f7552400640 1 --2- 172.21.15.114:0/1935039009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f754c0acbe0 0x7f754c15b300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.484+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 >> 172.21.15.114:0/1935039009 conn(0x7f754c0aaeb0 msgr2=0x7f754c1e5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:20.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.485+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 shutdown_connections 2024-05-09T00:18:20.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.485+0000 7f7552400640 1 -- 172.21.15.114:0/1935039009 wait complete. 2024-05-09T00:18:20.536 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-05-09T00:18:20.537 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T00:18:20.537 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:18:20.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.605+0000 7f1792000640 1 -- 172.21.15.114:0/236822625 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1764005580 con 0x7f178c0ae490 2024-05-09T00:18:20.615 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T00:18:20.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:20.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.616+0000 7f1783400640 1 -- 172.21.15.114:0/236822625 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f177c060ab0 con 0x7f178c0ae490 2024-05-09T00:18:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:20.616 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:20.617 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.628+0000 7f1780c00640 1 -- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f176c076500 msgr2=0x7f176c078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.628+0000 7f1780c00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f176c076500 0x7f176c078a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f178c06eed0 tx=0x7f1778008040 comp rx=0 tx=0).stop 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.628+0000 7f1780c00640 1 -- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 msgr2=0x7f178c1fef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.628+0000 7f1780c00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c1fef30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f177c00b410 tx=0x7f177c00b8d0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 -- 172.21.15.114:0/236822625 shutdown_connections 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f176c076500 0x7f176c078a10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c1545c0 0x7f178c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178c0aebf0 0x7f178c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 --2- 172.21.15.114:0/236822625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f178c0ae490 0x7f178c1fef30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 -- 172.21.15.114:0/236822625 >> 172.21.15.114:0/236822625 conn(0x7f178c0c5ea0 msgr2=0x7f178c072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 -- 172.21.15.114:0/236822625 shutdown_connections 2024-05-09T00:18:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:20.629+0000 7f1780c00640 1 -- 172.21.15.114:0/236822625 wait complete. 2024-05-09T00:18:20.680 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:18:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.109+0000 7f97ffa00640 1 Processor -- start 2024-05-09T00:18:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.109+0000 7f97ffa00640 1 -- start start 2024-05-09T00:18:21.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.115+0000 7f97ffa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97f80af570 0x7f97f8154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:21.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.115+0000 7f97ffa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97f8157d50 0x7f97f8158160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:21.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.116+0000 7f97ffa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f80748f0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.116+0000 7f97ffa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f97f81553e0 con 0x7f97f8157d50 2024-05-09T00:18:21.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.116+0000 7f97ffa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f97f8154420 con 0x7f97f80af570 2024-05-09T00:18:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.117+0000 7f97fda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97f8157d50 0x7f97f8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.117+0000 7f97fda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97f8157d50 0x7f97f8158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33130/0 (socket says 172.21.15.114:33130) 2024-05-09T00:18:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.117+0000 7f97fda00640 1 -- 172.21.15.114:0/3507102185 learned_addr learned my addr 172.21.15.114:0/3507102185 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:21.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.118+0000 7f97fd000640 1 --2- 172.21.15.114:0/3507102185 >> v2:172.21.15.153:3300/0 conn(0x7f97f80af570 0x7f97f8154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.119+0000 7f97fda00640 1 -- 172.21.15.114:0/3507102185 >> v2:172.21.15.153:3300/0 conn(0x7f97f80af570 msgr2=0x7f97f8154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.119+0000 7f97fda00640 1 --2- 172.21.15.114:0/3507102185 >> v2:172.21.15.153:3300/0 conn(0x7f97f80af570 0x7f97f8154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.119+0000 7f97fda00640 1 -- 172.21.15.114:0/3507102185 >> v1:172.21.15.153:6789/0 conn(0x7f97f80c5bb0 legacy=0x7f97f80c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.119+0000 7f97fda00640 1 -- 172.21.15.114:0/3507102185 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f8073430 con 0x7f97f8157d50 2024-05-09T00:18:21.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.125+0000 7f97fda00640 1 --2- 172.21.15.114:0/3507102185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f8158160 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f97f8071290 tx=0x7f97f002aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc723e7ef2c375 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:21.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.125+0000 7f97f7400640 1 -- 172.21.15.114:0/3507102185 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0032070 con 0x7f97f8157d50 2024-05-09T00:18:21.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.126+0000 7f97f7400640 1 -- 172.21.15.114:0/3507102185 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f002e600 con 0x7f97f8157d50 2024-05-09T00:18:21.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.126+0000 7f97f7400640 1 -- 172.21.15.114:0/3507102185 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f002ea10 con 0x7f97f8157d50 2024-05-09T00:18:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.127+0000 7f97ffa00640 1 -- 172.21.15.114:0/3507102185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 msgr2=0x7f97f8158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.127+0000 7f97ffa00640 1 --2- 172.21.15.114:0/3507102185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f8158160 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f97f8071290 tx=0x7f97f002aa50 comp rx=0 tx=0).stop 2024-05-09T00:18:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.127+0000 7f97ffa00640 1 -- 172.21.15.114:0/3507102185 shutdown_connections 2024-05-09T00:18:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.128+0000 7f97ffa00640 1 --2- 172.21.15.114:0/3507102185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f8158160 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.128+0000 7f97ffa00640 1 --2- 172.21.15.114:0/3507102185 >> v2:172.21.15.153:3300/0 conn(0x7f97f80af570 0x7f97f8154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.128+0000 7f97ffa00640 1 -- 172.21.15.114:0/3507102185 >> 172.21.15.114:0/3507102185 conn(0x7f97f806c680 msgr2=0x7f97f806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.128+0000 7f97ffa00640 1 -- 172.21.15.114:0/3507102185 shutdown_connections 2024-05-09T00:18:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.128+0000 7f97ffa00640 1 -- 172.21.15.114:0/3507102185 wait complete. 2024-05-09T00:18:21.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.136+0000 7f97ffa00640 1 Processor -- start 2024-05-09T00:18:21.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.137+0000 7f97ffa00640 1 -- start start 2024-05-09T00:18:21.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.140+0000 7f97ffa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f80af570 0x7f97f80acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:21.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.141+0000 7f97fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f80af570 0x7f97f80acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:21.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.142+0000 7f97ffa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97f80c5bb0 0x7f97f81de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:21.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.142+0000 7f97fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f80af570 0x7f97f80acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:55912/0 (socket says 172.21.15.114:55912) 2024-05-09T00:18:21.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.142+0000 7f97fd000640 1 -- 172.21.15.114:0/287226361 learned_addr learned my addr 172.21.15.114:0/287226361 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:21.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.143+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:21.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.145+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97f8073130 con 0x7f97f8157d50 2024-05-09T00:18:21.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.145+0000 7f97f7e00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97f80c5bb0 0x7f97f81de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:21.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.145+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97f80c4fe0 con 0x7f97f80af570 2024-05-09T00:18:21.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.145+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f97f8073710 con 0x7f97f80c5bb0 2024-05-09T00:18:21.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.147+0000 7f97fda00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.147+0000 7f97f7e00640 1 -- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f80af570 msgr2=0x7f97f80acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.147+0000 7f97f7e00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f80af570 0x7f97f80acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.147+0000 7f97f7e00640 1 -- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 msgr2=0x7f97f814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.148+0000 7f97f7e00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.148+0000 7f97f7e00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f80ad0c0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.148+0000 7f97fda00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.149+0000 7f97f7e00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97f80c5bb0 0x7f97f81de4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c340 tx=0x7f97e400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.149+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4017070 con 0x7f97f80c5bb0 2024-05-09T00:18:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.150+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e40052d0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.150+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f814c3f0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.150+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f80ae320 con 0x7f97f80c5bb0 2024-05-09T00:18:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.150+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4003810 con 0x7f97f80c5bb0 2024-05-09T00:18:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.156+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f80708a0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.158+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f97e401a070 con 0x7f97f80c5bb0 2024-05-09T00:18:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.160+0000 7f97f4c00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97d8076320 0x7f97d8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.160+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f97e4096d80 con 0x7f97f80c5bb0 2024-05-09T00:18:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.161+0000 7f97fd000640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97d8076320 0x7f97d8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.164+0000 7f97fd000640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97d8076320 0x7f97d8078830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f97e8004640 tx=0x7f97e8013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.170+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f97f80708a0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.757+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97f8077430 con 0x7f97f80c5bb0 2024-05-09T00:18:21.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.773+0000 7f97f4c00640 1 -- 172.21.15.114:0/287226361 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f97e40681a0 con 0x7f97f80c5bb0 2024-05-09T00:18:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:21.774 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:21.774 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:21.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.781+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97d8076320 msgr2=0x7f97d8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:21.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.782+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97d8076320 0x7f97d8078830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f97e8004640 tx=0x7f97e8013040 comp rx=0 tx=0).stop 2024-05-09T00:18:21.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.782+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97f80c5bb0 msgr2=0x7f97f81de4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:21.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.782+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97f80c5bb0 0x7f97f81de4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c340 tx=0x7f97e400c800 comp rx=0 tx=0).stop 2024-05-09T00:18:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 shutdown_connections 2024-05-09T00:18:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f97d8076320 0x7f97d8078830 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f8157d50 0x7f97f814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97f80c5bb0 0x7f97f81de4e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 --2- 172.21.15.114:0/287226361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f80af570 0x7f97f80acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 >> 172.21.15.114:0/287226361 conn(0x7f97f806c680 msgr2=0x7f97f8155650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:21.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.786+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 shutdown_connections 2024-05-09T00:18:21.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:21.789+0000 7f97ffa00640 1 -- 172.21.15.114:0/287226361 wait complete. 2024-05-09T00:18:21.841 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:18:22.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:23.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.214+0000 7f0fd0000640 1 Processor -- start 2024-05-09T00:18:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.215+0000 7f0fd0000640 1 -- start start 2024-05-09T00:18:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.220+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc80c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:23.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.220+0000 7f0fd0000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc815fe20 con 0x7f0fc8072890 2024-05-09T00:18:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.220+0000 7f0fcd600640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0fc8072d50 0x7f0fc80c4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:33684/0 (socket says 172.21.15.114:33684) 2024-05-09T00:18:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.221+0000 7f0fd0000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc815d1b0 con 0x7f0fc8072d50 2024-05-09T00:18:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.221+0000 7f0fd0000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc8160170 con 0x7f0fc8160600 2024-05-09T00:18:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.221+0000 7f0fcd600640 1 -- 172.21.15.114:0/1609970999 learned_addr learned my addr 172.21.15.114:0/1609970999 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.221+0000 7f0fccc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0fc8072890 0x7f0fc8159c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55990/0 (socket says 172.21.15.114:55990) 2024-05-09T00:18:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.221+0000 7f0fce000640 1 --2- 172.21.15.114:0/1609970999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc80c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.222+0000 7f0fc7e00640 1 -- 172.21.15.114:0/1609970999 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358908920 0 0) 0x7f0fc815fe20 con 0x7f0fc8072890 2024-05-09T00:18:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.222+0000 7f0fc7e00640 1 -- 172.21.15.114:0/1609970999 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb0003520 con 0x7f0fc8072890 2024-05-09T00:18:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.222+0000 7f0fce000640 1 -- 172.21.15.114:0/1609970999 >> v1:172.21.15.153:6789/0 conn(0x7f0fc8072d50 legacy=0x7f0fc80c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.222+0000 7f0fc7e00640 1 -- 172.21.15.114:0/1609970999 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766309142 0 0) 0x7f0fc815d1b0 con 0x7f0fc8072d50 2024-05-09T00:18:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.223+0000 7f0fce000640 1 -- 172.21.15.114:0/1609970999 >> v1:172.21.15.114:6789/0 conn(0x7f0fc8072890 legacy=0x7f0fc8159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.223+0000 7f0fce000640 1 -- 172.21.15.114:0/1609970999 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc815d490 con 0x7f0fc8160600 2024-05-09T00:18:23.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.224+0000 7f0fce000640 1 --2- 172.21.15.114:0/1609970999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc80c6050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009dc0 tx=0x7f0fc002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60d671cfba66d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:23.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.225+0000 7f0fc7e00640 1 -- 172.21.15.114:0/1609970999 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc002ae60 con 0x7f0fc8160600 2024-05-09T00:18:23.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.225+0000 7f0fc7e00640 1 -- 172.21.15.114:0/1609970999 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0007740 con 0x7f0fc8160600 2024-05-09T00:18:23.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.225+0000 7f0fc7e00640 1 -- 172.21.15.114:0/1609970999 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0007b10 con 0x7f0fc8160600 2024-05-09T00:18:23.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.226+0000 7f0fd0000640 1 -- 172.21.15.114:0/1609970999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 msgr2=0x7f0fc80c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.226+0000 7f0fd0000640 1 --2- 172.21.15.114:0/1609970999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc80c6050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009dc0 tx=0x7f0fc002a640 comp rx=0 tx=0).stop 2024-05-09T00:18:23.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.233+0000 7f0fd0000640 1 -- 172.21.15.114:0/1609970999 shutdown_connections 2024-05-09T00:18:23.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.233+0000 7f0fd0000640 1 --2- 172.21.15.114:0/1609970999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc80c6050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.233+0000 7f0fd0000640 1 -- 172.21.15.114:0/1609970999 >> 172.21.15.114:0/1609970999 conn(0x7f0fc806c680 msgr2=0x7f0fc806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:23.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.233+0000 7f0fd0000640 1 -- 172.21.15.114:0/1609970999 shutdown_connections 2024-05-09T00:18:23.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.234+0000 7f0fd0000640 1 -- 172.21.15.114:0/1609970999 wait complete. 2024-05-09T00:18:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.243+0000 7f0fd0000640 1 Processor -- start 2024-05-09T00:18:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.244+0000 7f0fd0000640 1 -- start start 2024-05-09T00:18:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.249+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 0x7f0fc815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.249+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fc8072d50 0x7f0fc8158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:23.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.251+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:23.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.251+0000 7f0fd0000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8160b90 con 0x7f0fc8072890 2024-05-09T00:18:23.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.251+0000 7f0fd0000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8160a10 con 0x7f0fc8072d50 2024-05-09T00:18:23.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.251+0000 7f0fd0000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc80c6590 con 0x7f0fc8160600 2024-05-09T00:18:23.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.252+0000 7f0fcd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 0x7f0fc815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:23.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.252+0000 7f0fccc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fc8072d50 0x7f0fc8158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:23.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.252+0000 7f0fcd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 0x7f0fc815d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33154/0 (socket says 172.21.15.114:33154) 2024-05-09T00:18:23.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.252+0000 7f0fcd600640 1 -- 172.21.15.114:0/3582967378 learned_addr learned my addr 172.21.15.114:0/3582967378 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.256+0000 7f0fcd600640 1 -- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 msgr2=0x7f0fc814b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.252+0000 7f0fce000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.256+0000 7f0fcd600640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc814b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.256+0000 7f0fcd600640 1 -- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fc8072d50 msgr2=0x7f0fc8158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.256+0000 7f0fcd600640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fc8072d50 0x7f0fc8158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.256+0000 7f0fcd600640 1 -- 172.21.15.114:0/3582967378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc81f3560 con 0x7f0fc8072890 2024-05-09T00:18:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.257+0000 7f0fce000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.257+0000 7f0fccc00640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fc8072d50 0x7f0fc8158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.257+0000 7f0fcd600640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 0x7f0fc815d770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c3f0 tx=0x7f0fb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.258+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40074e0 con 0x7f0fc8072890 2024-05-09T00:18:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.258+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4007680 con 0x7f0fc8072890 2024-05-09T00:18:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.259+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4004a20 con 0x7f0fc8072890 2024-05-09T00:18:23.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.259+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc8159240 con 0x7f0fc8072890 2024-05-09T00:18:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.265+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc81f2a80 con 0x7f0fc8072890 2024-05-09T00:18:23.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.267+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fb4011070 con 0x7f0fc8072890 2024-05-09T00:18:23.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.269+0000 7f0fc5600640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0fa8076350 0x7f0fa8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:23.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.269+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7f0fb4096e60 con 0x7f0fc8072890 2024-05-09T00:18:23.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.269+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc8159cb0 con 0x7f0fc8072890 2024-05-09T00:18:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.274+0000 7f0fccc00640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0fa8076350 0x7f0fa8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.278+0000 7f0fccc00640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0fa8076350 0x7f0fa8078860 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806cc00 tx=0x7f0fbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.291+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0fc8159cb0 con 0x7f0fc8072890 2024-05-09T00:18:23.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:23.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.864+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fc815b0a0 con 0x7f0fc8072890 2024-05-09T00:18:23.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.866+0000 7f0fc5600640 1 -- 172.21.15.114:0/3582967378 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7f0fc815b0a0 con 0x7f0fc8072890 2024-05-09T00:18:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:23.870 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.872+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0fa8076350 msgr2=0x7f0fa8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.872+0000 7f0fd0000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0fa8076350 0x7f0fa8078860 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806cc00 tx=0x7f0fbc009040 comp rx=0 tx=0).stop 2024-05-09T00:18:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.873+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 msgr2=0x7f0fc815d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.873+0000 7f0fd0000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 0x7f0fc815d770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c3f0 tx=0x7f0fb400c8b0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.873+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 shutdown_connections 2024-05-09T00:18:23.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.874+0000 7f0fd0000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0fa8076350 0x7f0fa8078860 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.874+0000 7f0fd0000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0fc8160600 0x7f0fc814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.874+0000 7f0fd0000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0fc8072d50 0x7f0fc8158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.874+0000 7f0fd0000640 1 --2- 172.21.15.114:0/3582967378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8072890 0x7f0fc815d770 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:23.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.874+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 >> 172.21.15.114:0/3582967378 conn(0x7f0fc806c680 msgr2=0x7f0fc815a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:23.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.874+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 shutdown_connections 2024-05-09T00:18:23.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:23.875+0000 7f0fd0000640 1 -- 172.21.15.114:0/3582967378 wait complete. 2024-05-09T00:18:23.945 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T00:18:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.382+0000 7fda95000640 1 Processor -- start 2024-05-09T00:18:24.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.382+0000 7fda95000640 1 -- start start 2024-05-09T00:18:24.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.390+0000 7fda95000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda9006dee0 0x7fda900c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:24.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda95000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda900cb840 0x7fda9006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda95000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda900cd2b0 con 0x7fda900c4020 2024-05-09T00:18:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda95000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fda9008ee80 con 0x7fda9006dee0 2024-05-09T00:18:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda8f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda9006dee0 0x7fda900c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda8f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda9006dee0 0x7fda900c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33164/0 (socket says 172.21.15.114:33164) 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda8f400640 1 -- 172.21.15.114:0/721452668 learned_addr learned my addr 172.21.15.114:0/721452668 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.391+0000 7fda95000640 1 -- 172.21.15.114:0/721452668 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fda90158ca0 con 0x7fda900cb840 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.392+0000 7fda8fe00640 1 --2- 172.21.15.114:0/721452668 >> v2:172.21.15.153:3300/0 conn(0x7fda900cb840 0x7fda9006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.392+0000 7fda8fe00640 1 -- 172.21.15.114:0/721452668 >> v2:172.21.15.114:3300/0 conn(0x7fda9006dee0 msgr2=0x7fda900c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.392+0000 7fda8fe00640 1 --2- 172.21.15.114:0/721452668 >> v2:172.21.15.114:3300/0 conn(0x7fda9006dee0 0x7fda900c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.392+0000 7fda8fe00640 1 -- 172.21.15.114:0/721452668 >> v1:172.21.15.114:6789/0 conn(0x7fda900c4020 legacy=0x7fda900c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.394+0000 7fda8fe00640 1 -- 172.21.15.114:0/721452668 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda900cc9c0 con 0x7fda900cb840 2024-05-09T00:18:24.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.395+0000 7fda8fe00640 1 --2- 172.21.15.114:0/721452668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda900cb840 0x7fda9006cf80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda9008f170 tx=0x7fda8002a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c41921038b2baf26 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:24.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.396+0000 7fda8e000640 1 -- 172.21.15.114:0/721452668 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80037070 con 0x7fda900cb840 2024-05-09T00:18:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.396+0000 7fda8e000640 1 -- 172.21.15.114:0/721452668 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8002adf0 con 0x7fda900cb840 2024-05-09T00:18:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.397+0000 7fda8e000640 1 -- 172.21.15.114:0/721452668 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80037070 con 0x7fda900cb840 2024-05-09T00:18:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.398+0000 7fda95000640 1 -- 172.21.15.114:0/721452668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda900cb840 msgr2=0x7fda9006cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.398+0000 7fda95000640 1 --2- 172.21.15.114:0/721452668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda900cb840 0x7fda9006cf80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda9008f170 tx=0x7fda8002a0a0 comp rx=0 tx=0).stop 2024-05-09T00:18:24.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.399+0000 7fda95000640 1 -- 172.21.15.114:0/721452668 shutdown_connections 2024-05-09T00:18:24.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.399+0000 7fda95000640 1 --2- 172.21.15.114:0/721452668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda900cb840 0x7fda9006cf80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:24.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.399+0000 7fda95000640 1 --2- 172.21.15.114:0/721452668 >> v2:172.21.15.114:3300/0 conn(0x7fda9006dee0 0x7fda900c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:24.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.399+0000 7fda95000640 1 -- 172.21.15.114:0/721452668 >> 172.21.15.114:0/721452668 conn(0x7fda900ca140 msgr2=0x7fda900ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:24.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.400+0000 7fda95000640 1 -- 172.21.15.114:0/721452668 shutdown_connections 2024-05-09T00:18:24.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.400+0000 7fda95000640 1 -- 172.21.15.114:0/721452668 wait complete. 2024-05-09T00:18:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.409+0000 7fda95000640 1 Processor -- start 2024-05-09T00:18:24.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.413+0000 7fda95000640 1 -- start start 2024-05-09T00:18:24.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.419+0000 7fda95000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9006dee0 0x7fda901595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:24.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.419+0000 7fda95000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 0x7fda900ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.420+0000 7fda8f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9006dee0 0x7fda901595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.420+0000 7fda95000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda900cb840 0x7fda90149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.421+0000 7fda95000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda9006d4c0 con 0x7fda900c4020 2024-05-09T00:18:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.421+0000 7fda8ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 0x7fda900ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.421+0000 7fda95000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda900c8570 con 0x7fda9006dee0 2024-05-09T00:18:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.421+0000 7fda95000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda9006d640 con 0x7fda900cb840 2024-05-09T00:18:24.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.421+0000 7fda8ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 0x7fda900ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33180/0 (socket says 172.21.15.114:33180) 2024-05-09T00:18:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.422+0000 7fda8ea00640 1 -- 172.21.15.114:0/2975962175 learned_addr learned my addr 172.21.15.114:0/2975962175 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:24.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.422+0000 7fda8ea00640 1 -- 172.21.15.114:0/2975962175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda900cb840 msgr2=0x7fda90149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.422+0000 7fda8ea00640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda900cb840 0x7fda90149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.422+0000 7fda8ea00640 1 -- 172.21.15.114:0/2975962175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9006dee0 msgr2=0x7fda901595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.422+0000 7fda8ea00640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9006dee0 0x7fda901595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:24.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.422+0000 7fda8ea00640 1 -- 172.21.15.114:0/2975962175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda901f1f70 con 0x7fda900c4020 2024-05-09T00:18:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.423+0000 7fda8ea00640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 0x7fda900ad4a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00b3f0 tx=0x7fda7c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.425+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c015020 con 0x7fda900c4020 2024-05-09T00:18:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.425+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7c011830 con 0x7fda900c4020 2024-05-09T00:18:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.425+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9015a520 con 0x7fda900c4020 2024-05-09T00:18:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.425+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9015bfb0 con 0x7fda900c4020 2024-05-09T00:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.426+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c015020 con 0x7fda900c4020 2024-05-09T00:18:24.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.434+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68005290 con 0x7fda900c4020 2024-05-09T00:18:24.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.436+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda7c018020 con 0x7fda900c4020 2024-05-09T00:18:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.442+0000 7fda87400640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fda70076500 0x7fda70078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:24.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.442+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7440+0+0 (secure 0 0 0) 0x7fda7c097850 con 0x7fda900c4020 2024-05-09T00:18:24.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.446+0000 7fda8f400640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fda70076500 0x7fda70078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:24.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.450+0000 7fda8f400640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fda70076500 0x7fda70078a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda88009aa0 tx=0x7fda88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:24.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:24.452+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda7c01f020 con 0x7fda900c4020 2024-05-09T00:18:25.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.022+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda68005580 con 0x7fda900c4020 2024-05-09T00:18:25.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.025+0000 7fda87400640 1 -- 172.21.15.114:0/2975962175 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+6503 (secure 0 0 0) 0x7fda7c060a70 con 0x7fda900c4020 2024-05-09T00:18:25.024 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:25.025 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5406,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:16:46.168266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":14,"addr":"172.21.15.153:6835/1232162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1232162808},{"type":"v1","addr":"172.21.15.153:6835","nonce":1232162808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:25.025 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-05-09T00:18:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.030+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fda70076500 msgr2=0x7fda70078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.030+0000 7fda95000640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fda70076500 0x7fda70078a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda88009aa0 tx=0x7fda88009040 comp rx=0 tx=0).stop 2024-05-09T00:18:25.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.033+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 msgr2=0x7fda900ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:25.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.033+0000 7fda95000640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 0x7fda900ad4a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00b3f0 tx=0x7fda7c00b8b0 comp rx=0 tx=0).stop 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.034+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 shutdown_connections 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.034+0000 7fda95000640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fda70076500 0x7fda70078a10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.034+0000 7fda95000640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda900cb840 0x7fda90149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.034+0000 7fda95000640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda900c4020 0x7fda900ad4a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.034+0000 7fda95000640 1 --2- 172.21.15.114:0/2975962175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9006dee0 0x7fda901595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.034+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 >> 172.21.15.114:0/2975962175 conn(0x7fda900ca140 msgr2=0x7fda900ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.035+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 shutdown_connections 2024-05-09T00:18:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:25.035+0000 7fda95000640 1 -- 172.21.15.114:0/2975962175 wait complete. 2024-05-09T00:18:25.085 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:18:25.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:26.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.444+0000 7fde11a00640 1 Processor -- start 2024-05-09T00:18:26.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.445+0000 7fde11a00640 1 -- start start 2024-05-09T00:18:26.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde11a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:26.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde11a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde0c160600 0x7fde0c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde11a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c0c4ca0 con 0x7fde0c072890 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde11a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c160170 con 0x7fde0c160600 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde11a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c15fe20 con 0x7fde0c072d50 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde0a000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fde0c072890 0x7fde0c159c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56022/0 (socket says 172.21.15.114:56022) 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde0a000640 1 -- 172.21.15.114:0/978009368 learned_addr learned my addr 172.21.15.114:0/978009368 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.448+0000 7fde0aa00640 1 --2- 172.21.15.114:0/978009368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:26.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.449+0000 7fde0b400640 1 --2- 172.21.15.114:0/978009368 >> v2:172.21.15.114:3300/0 conn(0x7fde0c160600 0x7fde0c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:26.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.449+0000 7fde0aa00640 1 -- 172.21.15.114:0/978009368 >> v2:172.21.15.114:3300/0 conn(0x7fde0c160600 msgr2=0x7fde0c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:26.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.450+0000 7fde0aa00640 1 --2- 172.21.15.114:0/978009368 >> v2:172.21.15.114:3300/0 conn(0x7fde0c160600 0x7fde0c0c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:26.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.450+0000 7fde0aa00640 1 -- 172.21.15.114:0/978009368 >> v1:172.21.15.114:6789/0 conn(0x7fde0c072890 legacy=0x7fde0c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:26.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.453+0000 7fde0aa00640 1 -- 172.21.15.114:0/978009368 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c15d1b0 con 0x7fde0c072d50 2024-05-09T00:18:26.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.456+0000 7fde0b400640 1 --2- 172.21.15.114:0/978009368 >> v2:172.21.15.114:3300/0 conn(0x7fde0c160600 0x7fde0c0c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.460+0000 7fde0aa00640 1 --2- 172.21.15.114:0/978009368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c0c4760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0097a0 tx=0x7fddfc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ee3158681f0af server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.468+0000 7fde09600640 1 -- 172.21.15.114:0/978009368 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc037070 con 0x7fde0c072d50 2024-05-09T00:18:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.468+0000 7fde09600640 1 -- 172.21.15.114:0/978009368 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc032440 con 0x7fde0c072d50 2024-05-09T00:18:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.468+0000 7fde09600640 1 -- 172.21.15.114:0/978009368 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc032850 con 0x7fde0c072d50 2024-05-09T00:18:26.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.469+0000 7fde11a00640 1 -- 172.21.15.114:0/978009368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 msgr2=0x7fde0c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:26.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.469+0000 7fde11a00640 1 --2- 172.21.15.114:0/978009368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c0c4760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0097a0 tx=0x7fddfc02a130 comp rx=0 tx=0).stop 2024-05-09T00:18:26.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.471+0000 7fde11a00640 1 -- 172.21.15.114:0/978009368 shutdown_connections 2024-05-09T00:18:26.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.471+0000 7fde11a00640 1 --2- 172.21.15.114:0/978009368 >> v2:172.21.15.114:3300/0 conn(0x7fde0c160600 0x7fde0c0c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:26.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.471+0000 7fde11a00640 1 --2- 172.21.15.114:0/978009368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c0c4760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:26.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.471+0000 7fde11a00640 1 -- 172.21.15.114:0/978009368 >> 172.21.15.114:0/978009368 conn(0x7fde0c06c680 msgr2=0x7fde0c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:26.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.472+0000 7fde11a00640 1 -- 172.21.15.114:0/978009368 shutdown_connections 2024-05-09T00:18:26.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.472+0000 7fde11a00640 1 -- 172.21.15.114:0/978009368 wait complete. 2024-05-09T00:18:26.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.477+0000 7fde11a00640 1 Processor -- start 2024-05-09T00:18:26.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.479+0000 7fde11a00640 1 -- start start 2024-05-09T00:18:26.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.489+0000 7fde11a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 0x7fde0c1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:26.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.490+0000 7fde0aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 0x7fde0c1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:26.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.491+0000 7fde0aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 0x7fde0c1549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:55930/0 (socket says 172.21.15.114:55930) 2024-05-09T00:18:26.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.491+0000 7fde0aa00640 1 -- 172.21.15.114:0/131742972 learned_addr learned my addr 172.21.15.114:0/131742972 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:26.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.492+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:26.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.492+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c160600 0x7fde0c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:26.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.492+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c160a10 con 0x7fde0c160600 2024-05-09T00:18:26.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.492+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c0c42e0 con 0x7fde0c072890 2024-05-09T00:18:26.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.492+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c160b90 con 0x7fde0c072d50 2024-05-09T00:18:26.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.492+0000 7fde0b400640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c160600 0x7fde0c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:26.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.493+0000 7fde0aa00640 1 -- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 msgr2=0x7fde0c15e020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:18:26.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.493+0000 7fde0aa00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c15e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:26.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.493+0000 7fde0aa00640 1 -- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c160600 msgr2=0x7fde0c152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:26.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.493+0000 7fde0aa00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c160600 0x7fde0c152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:26.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.493+0000 7fde0aa00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c15f6e0 con 0x7fde0c072890 2024-05-09T00:18:26.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.494+0000 7fde0b400640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c160600 0x7fde0c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:26.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.495+0000 7fde0aa00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 0x7fde0c1549f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0098c0 tx=0x7fddfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:26.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.496+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc037040 con 0x7fde0c072890 2024-05-09T00:18:26.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.496+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc042070 con 0x7fde0c072890 2024-05-09T00:18:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.496+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0308a0 con 0x7fde0c072890 2024-05-09T00:18:26.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.496+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c1f34c0 con 0x7fde0c072890 2024-05-09T00:18:26.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.496+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c152d90 con 0x7fde0c072890 2024-05-09T00:18:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.501+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde4005290 con 0x7fde0c072890 2024-05-09T00:18:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.504+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fddfc030a40 con 0x7fde0c072890 2024-05-09T00:18:26.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.506+0000 7fde02a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fddec0763d0 0x7fddec0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:26.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.507+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7fddfc0b8d00 con 0x7fde0c072890 2024-05-09T00:18:26.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.510+0000 7fde0a000640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fddec0763d0 0x7fddec0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:26.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.512+0000 7fde0a000640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fddec0763d0 0x7fddec0788e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0c3b40 tx=0x7fddf8007a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:26.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:26.521+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fddfc081f20 con 0x7fde0c072890 2024-05-09T00:18:27.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.059+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdde4005580 con 0x7fde0c072890 2024-05-09T00:18:27.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.061+0000 7fde02a00640 1 -- 172.21.15.114:0/131742972 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7fddfc081820 con 0x7fde0c072890 2024-05-09T00:18:27.060 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:27.066 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:27.066 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:27.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.068+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fddec0763d0 msgr2=0x7fddec0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.068+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fddec0763d0 0x7fddec0788e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0c3b40 tx=0x7fddf8007a20 comp rx=0 tx=0).stop 2024-05-09T00:18:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.069+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 msgr2=0x7fde0c1549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.069+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 0x7fde0c1549f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0098c0 tx=0x7fddfc0046c0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.073+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 shutdown_connections 2024-05-09T00:18:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.073+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fddec0763d0 0x7fddec0788e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.073+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c160600 0x7fde0c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.073+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde0c072d50 0x7fde0c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.073+0000 7fde11a00640 1 --2- 172.21.15.114:0/131742972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde0c072890 0x7fde0c1549f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.073+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 >> 172.21.15.114:0/131742972 conn(0x7fde0c06c680 msgr2=0x7fde0c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:27.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.074+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 shutdown_connections 2024-05-09T00:18:27.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.074+0000 7fde11a00640 1 -- 172.21.15.114:0/131742972 wait complete. 2024-05-09T00:18:27.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:27.116 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-05-09T00:18:27.116 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T00:18:27.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:27.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.609+0000 7fd894000640 1 Processor -- start 2024-05-09T00:18:27.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.609+0000 7fd894000640 1 -- start start 2024-05-09T00:18:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.613+0000 7fd894000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd88c157770 0x7fd88c072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.614+0000 7fd894000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c0af2c0 0x7fd88c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.614+0000 7fd894000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88c0c49b0 con 0x7fd88c154c20 2024-05-09T00:18:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.614+0000 7fd894000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd88c155190 con 0x7fd88c157770 2024-05-09T00:18:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.614+0000 7fd894000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd88c073110 con 0x7fd88c0af2c0 2024-05-09T00:18:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.615+0000 7fd88be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd88c154c20 0x7fd88c0c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56024/0 (socket says 172.21.15.114:56024) 2024-05-09T00:18:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.615+0000 7fd88be00640 1 -- 172.21.15.114:0/4136259740 learned_addr learned my addr 172.21.15.114:0/4136259740 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.616+0000 7fd891600640 1 --2- 172.21.15.114:0/4136259740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c0af2c0 0x7fd88c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.616+0000 7fd890c00640 1 --2- 172.21.15.114:0/4136259740 >> v2:172.21.15.114:3300/0 conn(0x7fd88c157770 0x7fd88c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.617+0000 7fd891600640 1 -- 172.21.15.114:0/4136259740 >> v2:172.21.15.114:3300/0 conn(0x7fd88c157770 msgr2=0x7fd88c072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.617+0000 7fd891600640 1 --2- 172.21.15.114:0/4136259740 >> v2:172.21.15.114:3300/0 conn(0x7fd88c157770 0x7fd88c072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.617+0000 7fd891600640 1 -- 172.21.15.114:0/4136259740 >> v1:172.21.15.114:6789/0 conn(0x7fd88c154c20 legacy=0x7fd88c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:27.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.617+0000 7fd891600640 1 -- 172.21.15.114:0/4136259740 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c0733f0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.622+0000 7fd891600640 1 --2- 172.21.15.114:0/4136259740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c0af2c0 0x7fd88c0c6050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd88c071e80 tx=0x7fd88402ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483d4dd1c08c03c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.623+0000 7fd892a00640 1 -- 172.21.15.114:0/4136259740 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884038070 con 0x7fd88c0af2c0 2024-05-09T00:18:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.623+0000 7fd892a00640 1 -- 172.21.15.114:0/4136259740 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88402b9e0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.623+0000 7fd892a00640 1 -- 172.21.15.114:0/4136259740 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884038070 con 0x7fd88c0af2c0 2024-05-09T00:18:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.625+0000 7fd894000640 1 -- 172.21.15.114:0/4136259740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c0af2c0 msgr2=0x7fd88c0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.625+0000 7fd894000640 1 --2- 172.21.15.114:0/4136259740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c0af2c0 0x7fd88c0c6050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd88c071e80 tx=0x7fd88402ac90 comp rx=0 tx=0).stop 2024-05-09T00:18:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.626+0000 7fd894000640 1 -- 172.21.15.114:0/4136259740 shutdown_connections 2024-05-09T00:18:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.626+0000 7fd894000640 1 --2- 172.21.15.114:0/4136259740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c0af2c0 0x7fd88c0c6050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.626+0000 7fd894000640 1 --2- 172.21.15.114:0/4136259740 >> v2:172.21.15.114:3300/0 conn(0x7fd88c157770 0x7fd88c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.626+0000 7fd894000640 1 -- 172.21.15.114:0/4136259740 >> 172.21.15.114:0/4136259740 conn(0x7fd88c0c95f0 msgr2=0x7fd88c0c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.627+0000 7fd894000640 1 -- 172.21.15.114:0/4136259740 shutdown_connections 2024-05-09T00:18:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.627+0000 7fd894000640 1 -- 172.21.15.114:0/4136259740 wait complete. 2024-05-09T00:18:27.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.632+0000 7fd894000640 1 Processor -- start 2024-05-09T00:18:27.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.632+0000 7fd894000640 1 -- start start 2024-05-09T00:18:27.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.635+0000 7fd894000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 0x7fd88c0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.636+0000 7fd894000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c154c20 0x7fd88c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.636+0000 7fd894000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd88c157770 0x7fd88c148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.637+0000 7fd894000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c0af6d0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.637+0000 7fd88be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c154c20 0x7fd88c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.637+0000 7fd894000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c0c5c90 con 0x7fd88c157770 2024-05-09T00:18:27.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.637+0000 7fd894000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd88c072be0 con 0x7fd88c154c20 2024-05-09T00:18:27.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.637+0000 7fd890c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 0x7fd88c0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.638+0000 7fd890c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 0x7fd88c0c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33224/0 (socket says 172.21.15.114:33224) 2024-05-09T00:18:27.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.638+0000 7fd890c00640 1 -- 172.21.15.114:0/3092883285 learned_addr learned my addr 172.21.15.114:0/3092883285 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:27.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.637+0000 7fd891600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd88c157770 0x7fd88c148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.640+0000 7fd890c00640 1 -- 172.21.15.114:0/3092883285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c154c20 msgr2=0x7fd88c14baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.640+0000 7fd890c00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c154c20 0x7fd88c14baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.640+0000 7fd890c00640 1 -- 172.21.15.114:0/3092883285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd88c157770 msgr2=0x7fd88c148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.643+0000 7fd890c00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd88c157770 0x7fd88c148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.643+0000 7fd890c00640 1 -- 172.21.15.114:0/3092883285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c155320 con 0x7fd88c0af2c0 2024-05-09T00:18:27.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.643+0000 7fd890c00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 0x7fd88c0c8750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd88000d820 tx=0x7fd88000dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:27.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.644+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880004030 con 0x7fd88c0af2c0 2024-05-09T00:18:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.644+0000 7fd894000640 1 -- 172.21.15.114:0/3092883285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88c0c3d80 con 0x7fd88c0af2c0 2024-05-09T00:18:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.644+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8800041d0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.645+0000 7fd894000640 1 -- 172.21.15.114:0/3092883285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88c1555c0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.652+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880004030 con 0x7fd88c0af2c0 2024-05-09T00:18:27.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.652+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd868005290 con 0x7fd88c0af2c0 2024-05-09T00:18:27.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.652+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd8800043c0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.654+0000 7fd889600640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd86c076470 0x7fd86c078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.658+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7fd88005c0e0 con 0x7fd88c0af2c0 2024-05-09T00:18:27.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.659+0000 7fd88be00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd86c076470 0x7fd86c078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.660+0000 7fd88be00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd86c076470 0x7fd86c078980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd88c1ef100 tx=0x7fd878005dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:27.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.671+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd880060550 con 0x7fd88c0af2c0 2024-05-09T00:18:27.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.673+0000 7f0983e00640 1 Processor -- start 2024-05-09T00:18:27.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.674+0000 7f0983e00640 1 -- start start 2024-05-09T00:18:27.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.676+0000 7f0983e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09840c5900 0x7f0984155600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.677+0000 7f0983e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09840706c0 con 0x7f0984158ac0 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.677+0000 7f0983e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0984072310 con 0x7f098415b630 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.677+0000 7f0983e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f09840728d0 con 0x7f09840c5900 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.678+0000 7f0983400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f098415b630 0x7f098415ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:33690/0 (socket says 172.21.15.114:33690) 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.678+0000 7f0983400640 1 -- 172.21.15.114:0/451716554 learned_addr learned my addr 172.21.15.114:0/451716554 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.679+0000 7f0982a00640 1 --2- 172.21.15.114:0/451716554 >> v2:172.21.15.153:3300/0 conn(0x7f09840c5900 0x7f0984155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.680+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090491949 0 0) 0x7f0984072310 con 0x7f098415b630 2024-05-09T00:18:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.680+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0968003520 con 0x7f098415b630 2024-05-09T00:18:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126427498 0 0) 0x7f0968003520 con 0x7f098415b630 2024-05-09T00:18:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 >> v2:172.21.15.153:3300/0 conn(0x7f09840c5900 msgr2=0x7f0984155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 --2- 172.21.15.114:0/451716554 >> v2:172.21.15.153:3300/0 conn(0x7f09840c5900 0x7f0984155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 >> v1:172.21.15.114:6789/0 conn(0x7f0984158ac0 legacy=0x7f09840c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09840725f0 con 0x7f098415b630 2024-05-09T00:18:27.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f09740016f0 con 0x7f098415b630 2024-05-09T00:18:27.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 >> v1:172.21.15.153:6789/0 conn(0x7f098415b630 legacy=0x7f098415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f0968003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0968004800 0x7f0968004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09680052a0 0x7f096800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09840728d0 con 0x7f09680052a0 2024-05-09T00:18:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f096800c230 con 0x7f0968004800 2024-05-09T00:18:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.682+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f096800c430 con 0x7f0968003a50 2024-05-09T00:18:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.686+0000 7f0983400640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09680052a0 0x7f096800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.688+0000 7f0982a00640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f0968003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.689+0000 7f0982a00640 1 -- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0968004800 msgr2=0x7f0968004c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:18:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.689+0000 7f0982a00640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0968004800 0x7f0968004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.689+0000 7f0982a00640 1 -- 172.21.15.114:0/451716554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09680052a0 msgr2=0x7f096800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:27.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.690+0000 7f0982a00640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09680052a0 0x7f096800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.690+0000 7f0982a00640 1 -- 172.21.15.114:0/451716554 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09840725f0 con 0x7f0968003a50 2024-05-09T00:18:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.690+0000 7f0983400640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09680052a0 0x7f096800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.690+0000 7f0983400640 1 -- 172.21.15.114:0/451716554 reap_dead start 2024-05-09T00:18:27.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.693+0000 7f0982a00640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f0968003ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0970009ac0 tx=0x7f0968005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d760a657b7128ada server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:27.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.695+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970036070 con 0x7f0968003a50 2024-05-09T00:18:27.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.695+0000 7f0981600640 1 -- 172.21.15.114:0/451716554 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0970031400 con 0x7f0968003a50 2024-05-09T00:18:27.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.697+0000 7f0983e00640 1 -- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 msgr2=0x7f0968003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.697+0000 7f0983e00640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f0968003ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0970009ac0 tx=0x7f0968005830 comp rx=0 tx=0).stop 2024-05-09T00:18:27.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.700+0000 7f0983e00640 1 -- 172.21.15.114:0/451716554 shutdown_connections 2024-05-09T00:18:27.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.700+0000 7f0983e00640 1 --2- 172.21.15.114:0/451716554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f0968003ec0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.700+0000 7f0983e00640 1 -- 172.21.15.114:0/451716554 >> 172.21.15.114:0/451716554 conn(0x7f09840c99c0 msgr2=0x7f09840c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:27.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.704+0000 7f0983e00640 1 -- 172.21.15.114:0/451716554 shutdown_connections 2024-05-09T00:18:27.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.704+0000 7f0983e00640 1 -- 172.21.15.114:0/451716554 wait complete. 2024-05-09T00:18:27.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.712+0000 7f0983e00640 1 Processor -- start 2024-05-09T00:18:27.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.712+0000 7f0983e00640 1 -- start start 2024-05-09T00:18:27.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.715+0000 7f0983e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f098414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.715+0000 7f0983e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09841edcc0 0x7f09841ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.715+0000 7f0983e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0984142a50 0x7f0984142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.715+0000 7f0983e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f098406ee30 con 0x7f0984142a50 2024-05-09T00:18:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.715+0000 7f0983e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f098406e910 con 0x7f09841edcc0 2024-05-09T00:18:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.715+0000 7f0983e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0984158ed0 con 0x7f0968003a50 2024-05-09T00:18:27.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.717+0000 7f0982a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f098414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.718+0000 7f0982a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f098414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:51264/0 (socket says 172.21.15.114:51264) 2024-05-09T00:18:27.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.718+0000 7f0982a00640 1 -- 172.21.15.114:0/3752782684 learned_addr learned my addr 172.21.15.114:0/3752782684 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:27.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.718+0000 7f0983400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0984142a50 0x7f0984142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.720+0000 7f0982000640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09841edcc0 0x7f09841ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.722+0000 7f0982a00640 1 -- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09841edcc0 msgr2=0x7f09841ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.722+0000 7f0982a00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09841edcc0 0x7f09841ee0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.722+0000 7f0982a00640 1 -- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0984142a50 msgr2=0x7f0984142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:27.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.722+0000 7f0982a00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0984142a50 0x7f0984142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:27.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.722+0000 7f0982a00640 1 -- 172.21.15.114:0/3752782684 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09841433a0 con 0x7f0968003a50 2024-05-09T00:18:27.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.724+0000 7f0983400640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0984142a50 0x7f0984142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.729+0000 7f0982a00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f098414ef50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0970009be0 tx=0x7f0970004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:27.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.733+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970041020 con 0x7f0968003a50 2024-05-09T00:18:27.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.733+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0970032e40 con 0x7f0968003a50 2024-05-09T00:18:27.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.733+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970041020 con 0x7f0968003a50 2024-05-09T00:18:27.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.734+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09841f11d0 con 0x7f0968003a50 2024-05-09T00:18:27.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.734+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09841f1790 con 0x7f0968003a50 2024-05-09T00:18:27.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.741+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0970044020 con 0x7f0968003a50 2024-05-09T00:18:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.743+0000 7f097aa00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0964076700 0x7f0964078c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.743+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7f09700044c0 con 0x7f0968003a50 2024-05-09T00:18:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.746+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0984078430 con 0x7f0968003a50 2024-05-09T00:18:27.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.747+0000 7f0982000640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0964076700 0x7f0964078c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:27.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.748+0000 7f0982000640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0964076700 0x7f0964078c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f097c007fd0 tx=0x7f097c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:27.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:27.768+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f097004b060 con 0x7f0968003a50 2024-05-09T00:18:28.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.270+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd868005850 con 0x7fd88c0af2c0 2024-05-09T00:18:28.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.274+0000 7fd889600640 1 -- 172.21.15.114:0/3092883285 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7fd88005fe50 con 0x7fd88c0af2c0 2024-05-09T00:18:28.275 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:28.275 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:28.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd86c076470 msgr2=0x7fd86c078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd86c076470 0x7fd86c078980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd88c1ef100 tx=0x7fd878005dc0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 msgr2=0x7fd88c0c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 0x7fd88c0c8750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd88000d820 tx=0x7fd88000dce0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 shutdown_connections 2024-05-09T00:18:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd86c076470 0x7fd86c078980 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.287+0000 7fd87ea00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd88c157770 0x7fd88c148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.289+0000 7fd87ea00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd88c154c20 0x7fd88c14baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.289+0000 7fd87ea00640 1 --2- 172.21.15.114:0/3092883285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd88c0af2c0 0x7fd88c0c8750 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.289+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 >> 172.21.15.114:0/3092883285 conn(0x7fd88c0c95f0 msgr2=0x7fd88c0ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.291+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 shutdown_connections 2024-05-09T00:18:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.291+0000 7fd87ea00640 1 -- 172.21.15.114:0/3092883285 wait complete. 2024-05-09T00:18:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.336+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0984076630 con 0x7f0968003a50 2024-05-09T00:18:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.337+0000 7f097aa00640 1 -- 172.21.15.114:0/3752782684 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7f09700804d0 con 0x7f0968003a50 2024-05-09T00:18:28.337 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:28.337 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:28.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0964076700 msgr2=0x7f0964078c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0964076700 0x7f0964078c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f097c007fd0 tx=0x7f097c009040 comp rx=0 tx=0).stop 2024-05-09T00:18:28.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 msgr2=0x7f098414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f098414ef50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0970009be0 tx=0x7f0970004730 comp rx=0 tx=0).stop 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 shutdown_connections 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0964076700 0x7f0964078c10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0984142a50 0x7f0984142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09841edcc0 0x7f09841ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 --2- 172.21.15.114:0/3752782684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0968003a50 0x7f098414ef50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.342+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 >> 172.21.15.114:0/3752782684 conn(0x7f09840c99c0 msgr2=0x7f09841548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.343+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 shutdown_connections 2024-05-09T00:18:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:28.343+0000 7f0983e00640 1 -- 172.21.15.114:0/3752782684 wait complete. 2024-05-09T00:18:28.360 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 58, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 58, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5406": { "addr": "172.21.15.114:6837/2437507270", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2437507270, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2437507270, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5406, "incarnation": 58, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:18:25.023429+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5406 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 56, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5334": { "addr": "172.21.15.114:6836/2312453128", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 2312453128, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 2312453128, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5334, "incarnation": 53, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 14 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:17:36.316579+0000", "qdb_cluster": [ 5334 ], "qdb_leader": 5334, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5334 } } } ], "standbys": [ { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 31, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T00:18:28.389 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:18:30.361 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:30.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:30.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.840+0000 7fabc1a00640 1 Processor -- start 2024-05-09T00:18:30.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.840+0000 7fabc1a00640 1 -- start start 2024-05-09T00:18:30.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.843+0000 7fabc1a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fabbc0ae4d0 0x7fabbc072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.843+0000 7fabc1a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06e300 0x7fabbc06e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabc1a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabbc154400 con 0x7fabbc06fe50 2024-05-09T00:18:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabc1a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fabbc155010 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabc1a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc0ae8e0 con 0x7fabbc06e300 2024-05-09T00:18:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabbb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06e300 0x7fabbc06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabbb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06e300 0x7fabbc06e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:33322/0 (socket says 172.21.15.114:33322) 2024-05-09T00:18:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabbb400640 1 -- 172.21.15.114:0/3562552277 learned_addr learned my addr 172.21.15.114:0/3562552277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.847+0000 7fabba000640 1 --2- 172.21.15.114:0/3562552277 >> v2:172.21.15.114:3300/0 conn(0x7fabbc0ae4d0 0x7fabbc072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.848+0000 7fabba000640 1 -- 172.21.15.114:0/3562552277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06e300 msgr2=0x7fabbc06e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.848+0000 7fabba000640 1 --2- 172.21.15.114:0/3562552277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06e300 0x7fabbc06e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.848+0000 7fabba000640 1 -- 172.21.15.114:0/3562552277 >> v1:172.21.15.153:6789/0 conn(0x7fabbc06fe50 legacy=0x7fabbc0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.848+0000 7fabba000640 1 -- 172.21.15.114:0/3562552277 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc1546e0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.850+0000 7fabba000640 1 --2- 172.21.15.114:0/3562552277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc072110 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faba800de20 tx=0x7faba802e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a40a4ff0b33c3c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.851+0000 7fabb9600640 1 -- 172.21.15.114:0/3562552277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba803a070 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.851+0000 7fabb9600640 1 -- 172.21.15.114:0/3562552277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba800b450 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.851+0000 7fabb9600640 1 -- 172.21.15.114:0/3562552277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba800d2d0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.852+0000 7fabc1a00640 1 -- 172.21.15.114:0/3562552277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 msgr2=0x7fabbc072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.852+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3562552277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc072110 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faba800de20 tx=0x7faba802e540 comp rx=0 tx=0).stop 2024-05-09T00:18:30.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.853+0000 7fabc1a00640 1 -- 172.21.15.114:0/3562552277 shutdown_connections 2024-05-09T00:18:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.853+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3562552277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06e300 0x7fabbc06e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.853+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3562552277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc072110 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.853+0000 7fabc1a00640 1 -- 172.21.15.114:0/3562552277 >> 172.21.15.114:0/3562552277 conn(0x7fabbc0c5ea0 msgr2=0x7fabbc0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.853+0000 7fabc1a00640 1 -- 172.21.15.114:0/3562552277 shutdown_connections 2024-05-09T00:18:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.853+0000 7fabc1a00640 1 -- 172.21.15.114:0/3562552277 wait complete. 2024-05-09T00:18:30.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.861+0000 7fabc1a00640 1 Processor -- start 2024-05-09T00:18:30.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.862+0000 7fabc1a00640 1 -- start start 2024-05-09T00:18:30.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.867+0000 7fabc1a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 0x7fabbc0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.868+0000 7fabc1a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06fe50 0x7fabbc1fe620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.869+0000 7fabc1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.869+0000 7fabbaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 0x7fabbc0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.869+0000 7fabbaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 0x7fabbc0bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:58594/0 (socket says 172.21.15.114:58594) 2024-05-09T00:18:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabbb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabbb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36990/0 (socket says 172.21.15.114:36990) 2024-05-09T00:18:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabbaa00640 1 -- 172.21.15.114:0/3410254765 learned_addr learned my addr 172.21.15.114:0/3410254765 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabba000640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06fe50 0x7fabbc1fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc0af3b0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc154ca0 con 0x7fabbc06e300 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.872+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc0af530 con 0x7fabbc06fe50 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.873+0000 7fabbb400640 1 -- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06fe50 msgr2=0x7fabbc1fe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.873+0000 7fabbb400640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06fe50 0x7fabbc1fe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.874+0000 7fabbb400640 1 -- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 msgr2=0x7fabbc0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.874+0000 7fabbb400640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 0x7fabbc0bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.874+0000 7fabbb400640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc1feef0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.874+0000 7fabbaa00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 0x7fabbc0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.875+0000 7fabbb400640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc157ac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009d90 tx=0x7fabb40085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.876+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4008ce0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.876+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4003990 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.876+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4003d80 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.876+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabbc1ff1d0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.877+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabbc156030 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.885+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fabb4003f20 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.887+0000 7fabb2a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fab9c0763a0 0x7fab9c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.887+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7fabb4097b20 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.889+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabbc1ff3a0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.890+0000 7fabbaa00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fab9c0763a0 0x7fab9c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.891+0000 7fabbaa00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fab9c0763a0 0x7fab9c0788b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fabac006fd0 tx=0x7fabac0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.904+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fabb40606f0 con 0x7fabbc0ae4d0 2024-05-09T00:18:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.935+0000 7fd936200640 1 Processor -- start 2024-05-09T00:18:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.935+0000 7fd936200640 1 -- start start 2024-05-09T00:18:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.938+0000 7fd936200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9300c7980 0x7fd930070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.938+0000 7fd936200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd930153730 0x7fd9300710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.938+0000 7fd936200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93015a070 con 0x7fd930159570 2024-05-09T00:18:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.938+0000 7fd936200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd930072fd0 con 0x7fd9300c7980 2024-05-09T00:18:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.938+0000 7fd936200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd9300c6060 con 0x7fd930153730 2024-05-09T00:18:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.939+0000 7fd92f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9300c7980 0x7fd930070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.939+0000 7fd92fe00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd930159570 0x7fd9300c6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:53906/0 (socket says 172.21.15.114:53906) 2024-05-09T00:18:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.939+0000 7fd92fe00640 1 -- 172.21.15.114:0/996705752 learned_addr learned my addr 172.21.15.114:0/996705752 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.940+0000 7fd92ea00640 1 --2- 172.21.15.114:0/996705752 >> v2:172.21.15.153:3300/0 conn(0x7fd930153730 0x7fd9300710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.940+0000 7fd92f400640 1 -- 172.21.15.114:0/996705752 >> v2:172.21.15.153:3300/0 conn(0x7fd930153730 msgr2=0x7fd9300710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:30.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.941+0000 7fd92f400640 1 --2- 172.21.15.114:0/996705752 >> v2:172.21.15.153:3300/0 conn(0x7fd930153730 0x7fd9300710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.941+0000 7fd92f400640 1 -- 172.21.15.114:0/996705752 >> v1:172.21.15.153:6789/0 conn(0x7fd930159570 legacy=0x7fd9300c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.941+0000 7fd92f400640 1 -- 172.21.15.114:0/996705752 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93015a350 con 0x7fd9300c7980 2024-05-09T00:18:30.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.941+0000 7fd92e000640 1 -- 172.21.15.114:0/996705752 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570946786 0 0) 0x7fd93015a070 con 0x7fd930159570 2024-05-09T00:18:30.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.942+0000 7fd92f400640 1 --2- 172.21.15.114:0/996705752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9300c7980 0x7fd930070970 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd930073dc0 tx=0x7fd91802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70f08f99bf455e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.943+0000 7fd92e000640 1 -- 172.21.15.114:0/996705752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918037070 con 0x7fd9300c7980 2024-05-09T00:18:30.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.943+0000 7fd92e000640 1 -- 172.21.15.114:0/996705752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91802add0 con 0x7fd9300c7980 2024-05-09T00:18:30.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.943+0000 7fd92e000640 1 -- 172.21.15.114:0/996705752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918032660 con 0x7fd9300c7980 2024-05-09T00:18:30.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.944+0000 7fd936200640 1 -- 172.21.15.114:0/996705752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9300c7980 msgr2=0x7fd930070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.944+0000 7fd936200640 1 --2- 172.21.15.114:0/996705752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9300c7980 0x7fd930070970 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd930073dc0 tx=0x7fd91802a080 comp rx=0 tx=0).stop 2024-05-09T00:18:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.945+0000 7fd936200640 1 -- 172.21.15.114:0/996705752 shutdown_connections 2024-05-09T00:18:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.945+0000 7fd936200640 1 --2- 172.21.15.114:0/996705752 >> v2:172.21.15.153:3300/0 conn(0x7fd930153730 0x7fd9300710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.945+0000 7fd936200640 1 --2- 172.21.15.114:0/996705752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9300c7980 0x7fd930070970 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.945+0000 7fd936200640 1 -- 172.21.15.114:0/996705752 >> 172.21.15.114:0/996705752 conn(0x7fd9300cbb70 msgr2=0x7fd9300ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.946+0000 7fd936200640 1 -- 172.21.15.114:0/996705752 shutdown_connections 2024-05-09T00:18:30.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.949+0000 7fd936200640 1 -- 172.21.15.114:0/996705752 wait complete. 2024-05-09T00:18:30.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.958+0000 7fd936200640 1 Processor -- start 2024-05-09T00:18:30.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.960+0000 7fd936200640 1 -- start start 2024-05-09T00:18:30.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.962+0000 7fd936200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9300c7980 0x7fd93006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.962+0000 7fd936200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd930153730 0x7fd9301f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.962+0000 7fd936200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930159570 0x7fd93014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.962+0000 7fd936200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd9300c73f0 con 0x7fd930153730 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.962+0000 7fd936200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd930072cf0 con 0x7fd930159570 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.962+0000 7fd936200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd9300c7570 con 0x7fd9300c7980 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.964+0000 7fd92f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9300c7980 0x7fd93006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.964+0000 7fd92f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9300c7980 0x7fd93006eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:33346/0 (socket says 172.21.15.114:33346) 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.964+0000 7fd92f400640 1 -- 172.21.15.114:0/30816606 learned_addr learned my addr 172.21.15.114:0/30816606 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.965+0000 7fd92fe00640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930159570 0x7fd93014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.965+0000 7fd92ea00640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd930153730 0x7fd9301f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.966+0000 7fd92fe00640 1 -- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9300c7980 msgr2=0x7fd93006eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.966+0000 7fd92fe00640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9300c7980 0x7fd93006eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.966+0000 7fd92fe00640 1 -- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd930153730 msgr2=0x7fd9301f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.969+0000 7fd92fe00640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd930153730 0x7fd9301f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:30.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.969+0000 7fd92fe00640 1 -- 172.21.15.114:0/30816606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9300af370 con 0x7fd930159570 2024-05-09T00:18:30.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.970+0000 7fd92fe00640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930159570 0x7fd93014e820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd92800c700 tx=0x7fd92800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.971+0000 7fd92ea00640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd930153730 0x7fd9301f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:30.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.973+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928018070 con 0x7fd930159570 2024-05-09T00:18:30.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.973+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9301f6290 con 0x7fd930159570 2024-05-09T00:18:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.973+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd928004d60 con 0x7fd930159570 2024-05-09T00:18:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.973+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928018070 con 0x7fd930159570 2024-05-09T00:18:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.973+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9300afcc0 con 0x7fd930159570 2024-05-09T00:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.984+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd930154190 con 0x7fd930159570 2024-05-09T00:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.984+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd92800a640 con 0x7fd930159570 2024-05-09T00:18:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.991+0000 7fd927400640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd90c0764d0 0x7fd90c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.991+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7fd928096e50 con 0x7fd930159570 2024-05-09T00:18:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.992+0000 7fd92f400640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd90c0764d0 0x7fd90c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:30.994+0000 7fd92f400640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd90c0764d0 0x7fd90c0789e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd918009560 tx=0x7fd91802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.011+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd92805f9a0 con 0x7fd930159570 2024-05-09T00:18:31.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.513+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabbc06f9d0 con 0x7fabbc0ae4d0 2024-05-09T00:18:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.514+0000 7fabb2a00640 1 -- 172.21.15.114:0/3410254765 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7fabb40649f0 con 0x7fabbc0ae4d0 2024-05-09T00:18:31.514 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:31.514 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.519+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fab9c0763a0 msgr2=0x7fab9c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.519+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fab9c0763a0 0x7fab9c0788b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fabac006fd0 tx=0x7fabac0090e0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.520+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 msgr2=0x7fabbc157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.520+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc157ac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009d90 tx=0x7fabb40085d0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.520+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 shutdown_connections 2024-05-09T00:18:31.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.520+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fab9c0763a0 0x7fab9c0788b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.521+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabbc0ae4d0 0x7fabbc157ac0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.521+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabbc06fe50 0x7fabbc1fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.521+0000 7fabc1a00640 1 --2- 172.21.15.114:0/3410254765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc06e300 0x7fabbc0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.521+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 >> 172.21.15.114:0/3410254765 conn(0x7fabbc0c5ea0 msgr2=0x7fabbc0c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.521+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 shutdown_connections 2024-05-09T00:18:31.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.522+0000 7fabc1a00640 1 -- 172.21.15.114:0/3410254765 wait complete. 2024-05-09T00:18:31.593 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.598+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd930077430 con 0x7fd930159570 2024-05-09T00:18:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.602+0000 7fd927400640 1 -- 172.21.15.114:0/30816606 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7fd928063ca0 con 0x7fd930159570 2024-05-09T00:18:31.602 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:31.602 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:31.603 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd90c0764d0 msgr2=0x7fd90c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd90c0764d0 0x7fd90c0789e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd918009560 tx=0x7fd91802e000 comp rx=0 tx=0).stop 2024-05-09T00:18:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930159570 msgr2=0x7fd93014e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930159570 0x7fd93014e820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd92800c700 tx=0x7fd92800cbc0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 shutdown_connections 2024-05-09T00:18:31.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd90c0764d0 0x7fd90c0789e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd930159570 0x7fd93014e820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd930153730 0x7fd9301f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 --2- 172.21.15.114:0/30816606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9300c7980 0x7fd93006eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:31.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.608+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 >> 172.21.15.114:0/30816606 conn(0x7fd9300cbb70 msgr2=0x7fd930152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.609+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 shutdown_connections 2024-05-09T00:18:31.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:31.609+0000 7fd936200640 1 -- 172.21.15.114:0/30816606 wait complete. 2024-05-09T00:18:31.663 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:18:33.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:33.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:34.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.067+0000 7f8472e00640 1 Processor -- start 2024-05-09T00:18:34.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.067+0000 7f8472e00640 1 -- start start 2024-05-09T00:18:34.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.075+0000 7f8472e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f846c157770 0x7f846c072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.077+0000 7f8472e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846c0c49b0 con 0x7f846c154c20 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.078+0000 7f8472e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846c073110 con 0x7f846c0af2c0 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.078+0000 7f8472e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f846c155190 con 0x7f846c157770 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.077+0000 7f846b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f846c154c20 0x7f846c0c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36404/0 (socket says 172.21.15.114:36404) 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.078+0000 7f8471800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f846c0af2c0 0x7f846c0c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:53912/0 (socket says 172.21.15.114:53912) 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.078+0000 7f8471800640 1 -- 172.21.15.114:0/2651979144 learned_addr learned my addr 172.21.15.114:0/2651979144 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.077+0000 7f846be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f846c157770 0x7f846c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.079+0000 7f846be00640 1 -- 172.21.15.114:0/2651979144 >> v1:172.21.15.153:6789/0 conn(0x7f846c0af2c0 legacy=0x7f846c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.079+0000 7f846be00640 1 -- 172.21.15.114:0/2651979144 >> v1:172.21.15.114:6789/0 conn(0x7f846c154c20 legacy=0x7f846c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.079+0000 7f846be00640 1 -- 172.21.15.114:0/2651979144 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c0733f0 con 0x7f846c157770 2024-05-09T00:18:34.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.086+0000 7f846be00640 1 --2- 172.21.15.114:0/2651979144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 0x7f846c072500 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f846000a8c0 tx=0x7f846002b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5aa90d22ba4748 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.089+0000 7f846aa00640 1 -- 172.21.15.114:0/2651979144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460038070 con 0x7f846c157770 2024-05-09T00:18:34.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.089+0000 7f846aa00640 1 -- 172.21.15.114:0/2651979144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460033640 con 0x7f846c157770 2024-05-09T00:18:34.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.089+0000 7f846aa00640 1 -- 172.21.15.114:0/2651979144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460038070 con 0x7f846c157770 2024-05-09T00:18:34.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.090+0000 7f8472e00640 1 -- 172.21.15.114:0/2651979144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 msgr2=0x7f846c072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.090+0000 7f8472e00640 1 --2- 172.21.15.114:0/2651979144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 0x7f846c072500 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f846000a8c0 tx=0x7f846002b2c0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.091+0000 7f8472e00640 1 -- 172.21.15.114:0/2651979144 shutdown_connections 2024-05-09T00:18:34.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.091+0000 7f8472e00640 1 --2- 172.21.15.114:0/2651979144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 0x7f846c072500 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.091+0000 7f8472e00640 1 -- 172.21.15.114:0/2651979144 >> 172.21.15.114:0/2651979144 conn(0x7f846c0c95f0 msgr2=0x7f846c0c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.095+0000 7f8472e00640 1 -- 172.21.15.114:0/2651979144 shutdown_connections 2024-05-09T00:18:34.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.095+0000 7f8472e00640 1 -- 172.21.15.114:0/2651979144 wait complete. 2024-05-09T00:18:34.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.104+0000 7f8472e00640 1 Processor -- start 2024-05-09T00:18:34.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.104+0000 7f8472e00640 1 -- start start 2024-05-09T00:18:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.107+0000 7f8472e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 0x7f846c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.108+0000 7f8472e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846c154c20 0x7f846c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.109+0000 7f846be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 0x7f846c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.109+0000 7f846be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 0x7f846c0c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:58622/0 (socket says 172.21.15.114:58622) 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.109+0000 7f846be00640 1 -- 172.21.15.114:0/2721701812 learned_addr learned my addr 172.21.15.114:0/2721701812 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.109+0000 7f8472e00640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 0x7f846c143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.110+0000 7f846b400640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846c154c20 0x7f846c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.110+0000 7f8472e00640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0af6d0 con 0x7f846c157770 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.110+0000 7f8472e00640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0c5c90 con 0x7f846c0af2c0 2024-05-09T00:18:34.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.110+0000 7f8472e00640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f846c0c6760 con 0x7f846c154c20 2024-05-09T00:18:34.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.111+0000 7f846be00640 1 -- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846c154c20 msgr2=0x7f846c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.111+0000 7f846be00640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846c154c20 0x7f846c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.111+0000 7f846be00640 1 -- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 msgr2=0x7f846c143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.111+0000 7f846be00640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 0x7f846c143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.111+0000 7f846be00640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c150b50 con 0x7f846c0af2c0 2024-05-09T00:18:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.112+0000 7f846be00640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 0x7f846c0c89f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f846002b8b0 tx=0x7f84600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.114+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460043070 con 0x7f846c0af2c0 2024-05-09T00:18:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.114+0000 7f8472e00640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846c14ffd0 con 0x7f846c0af2c0 2024-05-09T00:18:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.114+0000 7f8472e00640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846c150590 con 0x7f846c0af2c0 2024-05-09T00:18:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.116+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8448005290 con 0x7f846c0af2c0 2024-05-09T00:18:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.117+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460033640 con 0x7f846c0af2c0 2024-05-09T00:18:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.117+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846004d060 con 0x7f846c0af2c0 2024-05-09T00:18:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.130+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8460046070 con 0x7f846c0af2c0 2024-05-09T00:18:34.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.134+0000 7f845fe00640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f844c0762d0 0x7f844c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.134+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7f84600b8120 con 0x7f846c0af2c0 2024-05-09T00:18:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.135+0000 7f846b400640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f844c0762d0 0x7f844c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.136+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84600b8620 con 0x7f846c0af2c0 2024-05-09T00:18:34.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.140+0000 7f846b400640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f844c0762d0 0x7f844c0787e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f846c0c9420 tx=0x7f8458007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.253+0000 7fd6c7200640 1 Processor -- start 2024-05-09T00:18:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.253+0000 7fd6c7200640 1 -- start start 2024-05-09T00:18:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.258+0000 7fd6c5e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd6c80a87c0 0x7fd6c80c2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:53916/0 (socket says 172.21.15.114:53916) 2024-05-09T00:18:34.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c7200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd6c8074ae0 0x7fd6c80adb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c80ad360 con 0x7fd6c80a8270 2024-05-09T00:18:34.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c8158fd0 con 0x7fd6c80a87c0 2024-05-09T00:18:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c7200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c80ad600 con 0x7fd6c8074ae0 2024-05-09T00:18:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c5400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6c80a8270 0x7fd6c80743d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36406/0 (socket says 172.21.15.114:36406) 2024-05-09T00:18:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c5400640 1 -- 172.21.15.114:0/4176125898 learned_addr learned my addr 172.21.15.114:0/4176125898 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.260+0000 7fd6c6800640 1 --2- 172.21.15.114:0/4176125898 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8074ae0 0x7fd6c80adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.261+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002971135 0 0) 0x7fd6c8158fd0 con 0x7fd6c80a87c0 2024-05-09T00:18:34.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.262+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ac003520 con 0x7fd6c80a87c0 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.262+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522411537 0 0) 0x7fd6c80ad360 con 0x7fd6c80a8270 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.262+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c8158fd0 con 0x7fd6c80a8270 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 504185894 0 0) 0x7fd6c8158fd0 con 0x7fd6c80a8270 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8074ae0 msgr2=0x7fd6c80adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 --2- 172.21.15.114:0/4176125898 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8074ae0 0x7fd6c80adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 >> v1:172.21.15.153:6789/0 conn(0x7fd6c80a87c0 legacy=0x7fd6c80c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c81592b0 con 0x7fd6c80a8270 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fd6b80016d0 con 0x7fd6c80a8270 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 >> v1:172.21.15.114:6789/0 conn(0x7fd6c80a8270 legacy=0x7fd6c80743d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ac004d00 0x7fd6ac005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0037a0 0x7fd6ac003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6ac0042e0 0x7fd6ac00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c80ad600 con 0x7fd6ac004d00 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac00c2e0 con 0x7fd6ac0037a0 2024-05-09T00:18:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.264+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ac00c4e0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.265+0000 7fd6c6800640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6ac0042e0 0x7fd6ac00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.266+0000 7fd6c6800640 1 -- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0037a0 msgr2=0x7fd6ac003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.266+0000 7fd6c6800640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0037a0 0x7fd6ac003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.266+0000 7fd6c6800640 1 -- 172.21.15.114:0/4176125898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ac004d00 msgr2=0x7fd6ac005150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.266+0000 7fd6c6800640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ac004d00 0x7fd6ac005150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.266+0000 7fd6c6800640 1 -- 172.21.15.114:0/4176125898 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c81592b0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.267+0000 7fd6c6800640 1 -- 172.21.15.114:0/4176125898 reap_dead start 2024-05-09T00:18:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.269+0000 7fd6c6800640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6ac0042e0 0x7fd6ac00ba00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80a8bf0 tx=0x7fd6ac005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae018094113da675 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.269+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0009c10 con 0x7fd6ac0042e0 2024-05-09T00:18:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.270+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c0031410 con 0x7fd6ac0042e0 2024-05-09T00:18:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.270+0000 7fd6c4a00640 1 -- 172.21.15.114:0/4176125898 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00317e0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.271+0000 7fd6c7200640 1 -- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6ac0042e0 msgr2=0x7fd6ac00ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.271+0000 7fd6c7200640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6ac0042e0 0x7fd6ac00ba00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80a8bf0 tx=0x7fd6ac005830 comp rx=0 tx=0).stop 2024-05-09T00:18:34.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.271+0000 7fd6c7200640 1 -- 172.21.15.114:0/4176125898 shutdown_connections 2024-05-09T00:18:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.271+0000 7fd6c7200640 1 --2- 172.21.15.114:0/4176125898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6ac0042e0 0x7fd6ac00ba00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.271+0000 7fd6c7200640 1 -- 172.21.15.114:0/4176125898 >> 172.21.15.114:0/4176125898 conn(0x7fd6c80aaeb0 msgr2=0x7fd6c80ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.272+0000 7fd6c7200640 1 -- 172.21.15.114:0/4176125898 shutdown_connections 2024-05-09T00:18:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.272+0000 7fd6c7200640 1 -- 172.21.15.114:0/4176125898 wait complete. 2024-05-09T00:18:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.276+0000 7fd6c7200640 1 Processor -- start 2024-05-09T00:18:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.276+0000 7fd6c7200640 1 -- start start 2024-05-09T00:18:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.279+0000 7fd6c7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 0x7fd6c8151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.279+0000 7fd6c7200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c80a9080 0x7fd6c8072f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8071f40 0x7fd6c8072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c80a9080 0x7fd6c8072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 0x7fd6c8151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 0x7fd6c8151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:58648/0 (socket says 172.21.15.114:58648) 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c80c2710 con 0x7fd6c8071f40 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c80709b0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c7200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c80c2890 con 0x7fd6c80a9080 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.280+0000 7fd6c5e00640 1 -- 172.21.15.114:0/3222807067 learned_addr learned my addr 172.21.15.114:0/3222807067 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c6800640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8071f40 0x7fd6c8072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c5e00640 1 -- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c80a9080 msgr2=0x7fd6c8072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c5e00640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c80a9080 0x7fd6c8072f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c5e00640 1 -- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8071f40 msgr2=0x7fd6c8072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c5e00640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8071f40 0x7fd6c8072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c5e00640 1 -- 172.21.15.114:0/3222807067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c81e9cc0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.281+0000 7fd6c6800640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8071f40 0x7fd6c8072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.286+0000 7fd6c5e00640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 0x7fd6c8151f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c500 tx=0x7fd6b400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.290+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4007500 con 0x7fd6ac0042e0 2024-05-09T00:18:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.290+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b40047e0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.290+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4004bb0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.291+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c8072890 con 0x7fd6ac0042e0 2024-05-09T00:18:34.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.292+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c8151480 con 0x7fd6ac0042e0 2024-05-09T00:18:34.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.293+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c8078350 con 0x7fd6ac0042e0 2024-05-09T00:18:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.296+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd6b401a020 con 0x7fd6ac0042e0 2024-05-09T00:18:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.301+0000 7fd6be000640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6a80763d0 0x7fd6a80788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.301+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7526+0+0 (secure 0 0 0) 0x7fd6b4097bb0 con 0x7fd6ac0042e0 2024-05-09T00:18:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.302+0000 7fd6c5400640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6a80763d0 0x7fd6a80788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.304+0000 7fd6c5400640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6a80763d0 0x7fd6a80788e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8150720 tx=0x7fd6b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.306+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd6b4021070 con 0x7fd6ac0042e0 2024-05-09T00:18:34.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.714+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8448005580 con 0x7f846c0af2c0 2024-05-09T00:18:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.715+0000 7f845fe00640 1 -- 172.21.15.114:0/2721701812 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7f8460080ec0 con 0x7f846c0af2c0 2024-05-09T00:18:34.718 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:34.718 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.720+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f844c0762d0 msgr2=0x7f844c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.720+0000 7f845d600640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f844c0762d0 0x7f844c0787e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f846c0c9420 tx=0x7f8458007e40 comp rx=0 tx=0).stop 2024-05-09T00:18:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.720+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 msgr2=0x7f846c0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.720+0000 7f845d600640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 0x7f846c0c89f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f846002b8b0 tx=0x7f84600046c0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.723+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 shutdown_connections 2024-05-09T00:18:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.723+0000 7f845d600640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f844c0762d0 0x7f844c0787e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.723+0000 7f845d600640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846c157770 0x7f846c143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.723+0000 7f845d600640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846c154c20 0x7f846c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.723+0000 7f845d600640 1 --2- 172.21.15.114:0/2721701812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846c0af2c0 0x7f846c0c89f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.723+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 >> 172.21.15.114:0/2721701812 conn(0x7f846c0c95f0 msgr2=0x7f846c075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.726+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 shutdown_connections 2024-05-09T00:18:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.726+0000 7f845d600640 1 -- 172.21.15.114:0/2721701812 wait complete. 2024-05-09T00:18:34.810 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:18:34.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.830+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6c80a8050 con 0x7fd6ac0042e0 2024-05-09T00:18:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.833+0000 7fd6be000640 1 -- 172.21.15.114:0/3222807067 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5667 (secure 0 0 0) 0x7fd6b4060e60 con 0x7fd6ac0042e0 2024-05-09T00:18:34.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:34.835 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:17:36.316579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":14,"addr":"172.21.15.114:6836/2312453128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2312453128},{"type":"v1","addr":"172.21.15.114:6836","nonce":2312453128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-05-09T00:18:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2024-05-09T00:18:34.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6a80763d0 msgr2=0x7fd6a80788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6a80763d0 0x7fd6a80788e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8150720 tx=0x7fd6b8009040 comp rx=0 tx=0).stop 2024-05-09T00:18:34.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 msgr2=0x7fd6c8151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 0x7fd6c8151f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c500 tx=0x7fd6b400c9c0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 shutdown_connections 2024-05-09T00:18:34.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6a80763d0 0x7fd6a80788e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8071f40 0x7fd6c8072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c80a9080 0x7fd6c8072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 --2- 172.21.15.114:0/3222807067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6ac0042e0 0x7fd6c8151f60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:34.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.841+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 >> 172.21.15.114:0/3222807067 conn(0x7fd6c80aaeb0 msgr2=0x7fd6c80c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.842+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 shutdown_connections 2024-05-09T00:18:34.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:34.842+0000 7fd6c7200640 1 -- 172.21.15.114:0/3222807067 wait complete. 2024-05-09T00:18:34.889 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T00:18:36.811 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:36.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:37.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.293+0000 7fbfa5a00640 1 Processor -- start 2024-05-09T00:18:37.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.293+0000 7fbfa5a00640 1 -- start start 2024-05-09T00:18:37.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.296+0000 7fbfa5a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00c85a0 0x7fbfa01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.296+0000 7fbfa5a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbfa00cc540 0x7fbfa00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.297+0000 7fbf9fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00c85a0 0x7fbfa01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.297+0000 7fbf9f400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbfa01585f0 0x7fbfa0158a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36420/0 (socket says 172.21.15.114:36420) 2024-05-09T00:18:37.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.297+0000 7fbf9f400640 1 -- 172.21.15.114:0/1815430159 learned_addr learned my addr 172.21.15.114:0/1815430159 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.299+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa0158110 con 0x7fbfa01585f0 2024-05-09T00:18:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.299+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa00cbca0 con 0x7fbfa00cc540 2024-05-09T00:18:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.299+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa00cbf80 con 0x7fbfa00c85a0 2024-05-09T00:18:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.299+0000 7fbfa5000640 1 --2- 172.21.15.114:0/1815430159 >> v2:172.21.15.114:3300/0 conn(0x7fbfa00cc540 0x7fbfa00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.301+0000 7fbf9ea00640 1 -- 172.21.15.114:0/1815430159 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193564487 0 0) 0x7fbfa0158110 con 0x7fbfa01585f0 2024-05-09T00:18:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.301+0000 7fbf9ea00640 1 -- 172.21.15.114:0/1815430159 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf84003520 con 0x7fbfa01585f0 2024-05-09T00:18:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.302+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1815430159 >> v2:172.21.15.114:3300/0 conn(0x7fbfa00cc540 msgr2=0x7fbfa00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.302+0000 7fbf9fe00640 1 --2- 172.21.15.114:0/1815430159 >> v2:172.21.15.114:3300/0 conn(0x7fbfa00cc540 0x7fbfa00cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.302+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1815430159 >> v1:172.21.15.114:6789/0 conn(0x7fbfa01585f0 legacy=0x7fbfa0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.302+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1815430159 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa00cc260 con 0x7fbfa00c85a0 2024-05-09T00:18:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.306+0000 7fbf9fe00640 1 --2- 172.21.15.114:0/1815430159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00c85a0 0x7fbfa01556c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009d90 tx=0x7fbf9802a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=811bd3d50f738a8c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.306+0000 7fbf9ea00640 1 -- 172.21.15.114:0/1815430159 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007740 con 0x7fbfa00c85a0 2024-05-09T00:18:37.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.307+0000 7fbf9ea00640 1 -- 172.21.15.114:0/1815430159 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf980078e0 con 0x7fbfa00c85a0 2024-05-09T00:18:37.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.307+0000 7fbf9ea00640 1 -- 172.21.15.114:0/1815430159 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007740 con 0x7fbfa00c85a0 2024-05-09T00:18:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.308+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00c85a0 msgr2=0x7fbfa01556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.308+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1815430159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00c85a0 0x7fbfa01556c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009d90 tx=0x7fbf9802a610 comp rx=0 tx=0).stop 2024-05-09T00:18:37.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.311+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 shutdown_connections 2024-05-09T00:18:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.311+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1815430159 >> v2:172.21.15.114:3300/0 conn(0x7fbfa00cc540 0x7fbfa00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.311+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1815430159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00c85a0 0x7fbfa01556c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.311+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 >> 172.21.15.114:0/1815430159 conn(0x7fbfa0069000 msgr2=0x7fbfa00af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.312+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 shutdown_connections 2024-05-09T00:18:37.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.312+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1815430159 wait complete. 2024-05-09T00:18:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.324+0000 7fbfa5a00640 1 Processor -- start 2024-05-09T00:18:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.324+0000 7fbfa5a00640 1 -- start start 2024-05-09T00:18:37.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.327+0000 7fbfa5a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 0x7fbfa00ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.327+0000 7fbfa5a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00cc540 0x7fbfa00c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.327+0000 7fbfa5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfa01585f0 0x7fbfa0153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.327+0000 7fbfa5a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa00ca790 con 0x7fbfa00c85a0 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.327+0000 7fbfa5a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa00ca610 con 0x7fbfa01585f0 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.327+0000 7fbfa5a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa00cce90 con 0x7fbfa00cc540 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.328+0000 7fbfa5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfa01585f0 0x7fbfa0153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.328+0000 7fbf9fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 0x7fbfa00ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.328+0000 7fbf9fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 0x7fbfa00ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37040/0 (socket says 172.21.15.114:37040) 2024-05-09T00:18:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.328+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1508746340 learned_addr learned my addr 172.21.15.114:0/1508746340 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.329+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1508746340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00cc540 msgr2=0x7fbfa00c0fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:18:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.329+0000 7fbf9fe00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00cc540 0x7fbfa00c0fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.329+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1508746340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfa01585f0 msgr2=0x7fbfa0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.329+0000 7fbf9fe00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfa01585f0 0x7fbfa0153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.329+0000 7fbf9fe00640 1 -- 172.21.15.114:0/1508746340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa00c3650 con 0x7fbfa00c85a0 2024-05-09T00:18:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.330+0000 7fbf9fe00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 0x7fbfa00ae5e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000f80 tx=0x7fbf98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.332+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9803f070 con 0x7fbfa00c85a0 2024-05-09T00:18:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.332+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf98031d40 con 0x7fbfa00c85a0 2024-05-09T00:18:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.332+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007740 con 0x7fbfa00c85a0 2024-05-09T00:18:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.332+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa0154b60 con 0x7fbfa00c85a0 2024-05-09T00:18:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.333+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa00c3b80 con 0x7fbfa00c85a0 2024-05-09T00:18:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.337+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa0078350 con 0x7fbfa00c85a0 2024-05-09T00:18:37.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.344+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf9803b410 con 0x7fbfa00c85a0 2024-05-09T00:18:37.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.351+0000 7fbf97e00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf800763a0 0x7fbf800788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.351+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fbf980b9050 con 0x7fbfa00c85a0 2024-05-09T00:18:37.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.358+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf98082220 con 0x7fbfa00c85a0 2024-05-09T00:18:37.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.361+0000 7fbf9f400640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf800763a0 0x7fbf800788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.366+0000 7fbf9f400640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf800763a0 0x7fbf800788b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00c7dc0 tx=0x7fbf8c007910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.376+0000 7fdb54000640 1 Processor -- start 2024-05-09T00:18:37.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.377+0000 7fdb54000640 1 -- start start 2024-05-09T00:18:37.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.382+0000 7fdb54000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb4404afb0 0x7fdb440073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.382+0000 7fdb54000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb44007910 0x7fdb440de400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.382+0000 7fdb51600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb4404afb0 0x7fdb440073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.383+0000 7fdb51600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb4404afb0 0x7fdb440073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:58672/0 (socket says 172.21.15.114:58672) 2024-05-09T00:18:37.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.383+0000 7fdb51600640 1 -- 172.21.15.114:0/1682634326 learned_addr learned my addr 172.21.15.114:0/1682634326 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:37.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.383+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4404e5e0 con 0x7fdb440d8090 2024-05-09T00:18:37.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.383+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4404e8c0 con 0x7fdb44007910 2024-05-09T00:18:37.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.383+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4404eba0 con 0x7fdb4404afb0 2024-05-09T00:18:37.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.384+0000 7fdb50c00640 1 --2- 172.21.15.114:0/1682634326 >> v2:172.21.15.114:3300/0 conn(0x7fdb44007910 0x7fdb440de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.385+0000 7fdb51600640 1 -- 172.21.15.114:0/1682634326 >> v2:172.21.15.114:3300/0 conn(0x7fdb44007910 msgr2=0x7fdb440de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:37.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.385+0000 7fdb51600640 1 --2- 172.21.15.114:0/1682634326 >> v2:172.21.15.114:3300/0 conn(0x7fdb44007910 0x7fdb440de400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.385+0000 7fdb51600640 1 -- 172.21.15.114:0/1682634326 >> v1:172.21.15.114:6789/0 conn(0x7fdb440d8090 legacy=0x7fdb44035050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:37.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.385+0000 7fdb51600640 1 -- 172.21.15.114:0/1682634326 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4404ee80 con 0x7fdb4404afb0 2024-05-09T00:18:37.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.391+0000 7fdb51600640 1 --2- 172.21.15.114:0/1682634326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb4404afb0 0x7fdb440073d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdb44050e80 tx=0x7fdb3802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b04ff638e21f1985 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.394+0000 7fdb4be00640 1 -- 172.21.15.114:0/1682634326 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38037070 con 0x7fdb4404afb0 2024-05-09T00:18:37.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.394+0000 7fdb4be00640 1 -- 172.21.15.114:0/1682634326 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb38032440 con 0x7fdb4404afb0 2024-05-09T00:18:37.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.396+0000 7fdb4be00640 1 -- 172.21.15.114:0/1682634326 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38032810 con 0x7fdb4404afb0 2024-05-09T00:18:37.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.397+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb4404afb0 msgr2=0x7fdb440073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.397+0000 7fdb54000640 1 --2- 172.21.15.114:0/1682634326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb4404afb0 0x7fdb440073d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdb44050e80 tx=0x7fdb3802a1e0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.397+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 shutdown_connections 2024-05-09T00:18:37.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.397+0000 7fdb54000640 1 --2- 172.21.15.114:0/1682634326 >> v2:172.21.15.114:3300/0 conn(0x7fdb44007910 0x7fdb440de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.397+0000 7fdb54000640 1 --2- 172.21.15.114:0/1682634326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb4404afb0 0x7fdb440073d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.397+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 >> 172.21.15.114:0/1682634326 conn(0x7fdb4404c8c0 msgr2=0x7fdb4404ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.398+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 shutdown_connections 2024-05-09T00:18:37.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.399+0000 7fdb54000640 1 -- 172.21.15.114:0/1682634326 wait complete. 2024-05-09T00:18:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.406+0000 7fdb54000640 1 Processor -- start 2024-05-09T00:18:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.406+0000 7fdb54000640 1 -- start start 2024-05-09T00:18:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb54000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb44007910 0x7fdb44173f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb54000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb4404afb0 0x7fdb440db210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb54000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb440d8090 0x7fdb440d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb54000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4404c5b0 con 0x7fdb440d8090 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb54000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4404e270 con 0x7fdb44007910 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb54000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb44166430 con 0x7fdb4404afb0 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.412+0000 7fdb50c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb4404afb0 0x7fdb440db210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.413+0000 7fdb51600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb44007910 0x7fdb44173f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.413+0000 7fdb51600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb44007910 0x7fdb44173f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:58678/0 (socket says 172.21.15.114:58678) 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.413+0000 7fdb51600640 1 -- 172.21.15.114:0/3387586166 learned_addr learned my addr 172.21.15.114:0/3387586166 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.413+0000 7fdb52000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb440d8090 0x7fdb440d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.414+0000 7fdb50c00640 1 -- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb44007910 msgr2=0x7fdb44173f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.414+0000 7fdb50c00640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb44007910 0x7fdb44173f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.414+0000 7fdb50c00640 1 -- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb440d8090 msgr2=0x7fdb440d2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb50c00640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb440d8090 0x7fdb440d2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb50c00640 1 -- 172.21.15.114:0/3387586166 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb44167f80 con 0x7fdb4404afb0 2024-05-09T00:18:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb52000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb440d8090 0x7fdb440d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb50c00640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb4404afb0 0x7fdb440db210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c050d90 tx=0x7fdb4c0776c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c06ee60 con 0x7fdb4404afb0 2024-05-09T00:18:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c08e530 con 0x7fdb4404afb0 2024-05-09T00:18:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c08e8e0 con 0x7fdb4404afb0 2024-05-09T00:18:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.415+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb44166220 con 0x7fdb4404afb0 2024-05-09T00:18:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.416+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb44174b90 con 0x7fdb4404afb0 2024-05-09T00:18:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.421+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb28005290 con 0x7fdb4404afb0 2024-05-09T00:18:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.423+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb4c096390 con 0x7fdb4404afb0 2024-05-09T00:18:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.425+0000 7fdb49600640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdb2c076300 0x7fdb2c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.425+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fdb4c114990 con 0x7fdb4404afb0 2024-05-09T00:18:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.429+0000 7fdb51600640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdb2c076300 0x7fdb2c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.435+0000 7fdb51600640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdb2c076300 0x7fdb2c078810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009630 tx=0x7fdb3802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.453+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdb44167f80 con 0x7fdb4404afb0 2024-05-09T00:18:37.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.905+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfa00c1ee0 con 0x7fbfa00c85a0 2024-05-09T00:18:37.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.909+0000 7fbf97e00640 1 -- 172.21.15.114:0/1508746340 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7fbf98081b20 con 0x7fbfa00c85a0 2024-05-09T00:18:37.909 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:37.910 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:37.910 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.917+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf800763a0 msgr2=0x7fbf800788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.918+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf800763a0 0x7fbf800788b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00c7dc0 tx=0x7fbf8c007910 comp rx=0 tx=0).stop 2024-05-09T00:18:37.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.918+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 msgr2=0x7fbfa00ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.918+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 0x7fbfa00ae5e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000f80 tx=0x7fbf98004a40 comp rx=0 tx=0).stop 2024-05-09T00:18:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.920+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 shutdown_connections 2024-05-09T00:18:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.920+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf800763a0 0x7fbf800788b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.920+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfa01585f0 0x7fbfa0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.920+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfa00cc540 0x7fbfa00c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.920+0000 7fbfa5a00640 1 --2- 172.21.15.114:0/1508746340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa00c85a0 0x7fbfa00ae5e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.920+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 >> 172.21.15.114:0/1508746340 conn(0x7fbfa0069000 msgr2=0x7fbfa00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.921+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 shutdown_connections 2024-05-09T00:18:37.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:37.923+0000 7fbfa5a00640 1 -- 172.21.15.114:0/1508746340 wait complete. 2024-05-09T00:18:37.971 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:18:38.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.015+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb28005850 con 0x7fdb4404afb0 2024-05-09T00:18:38.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.019+0000 7fdb49600640 1 -- 172.21.15.114:0/3387586166 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7fdb4c0ddb00 con 0x7fdb4404afb0 2024-05-09T00:18:38.019 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:38.019 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:38.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.025+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdb2c076300 msgr2=0x7fdb2c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.025+0000 7fdb54000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdb2c076300 0x7fdb2c078810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009630 tx=0x7fdb3802e000 comp rx=0 tx=0).stop 2024-05-09T00:18:38.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.026+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb4404afb0 msgr2=0x7fdb440db210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.026+0000 7fdb54000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb4404afb0 0x7fdb440db210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c050d90 tx=0x7fdb4c0776c0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.026+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 shutdown_connections 2024-05-09T00:18:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.027+0000 7fdb54000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fdb2c076300 0x7fdb2c078810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.027+0000 7fdb54000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb440d8090 0x7fdb440d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.027+0000 7fdb54000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb4404afb0 0x7fdb440db210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.027+0000 7fdb54000640 1 --2- 172.21.15.114:0/3387586166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb44007910 0x7fdb44173f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.027+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 >> 172.21.15.114:0/3387586166 conn(0x7fdb4404c8c0 msgr2=0x7fdb4400e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.029+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 shutdown_connections 2024-05-09T00:18:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.031+0000 7fdb54000640 1 -- 172.21.15.114:0/3387586166 wait complete. 2024-05-09T00:18:38.087 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-05-09T00:18:38.087 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T00:18:38.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.547+0000 7f0f8e400640 1 Processor -- start 2024-05-09T00:18:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.547+0000 7f0f8e400640 1 -- start start 2024-05-09T00:18:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.554+0000 7f0f8e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 0x7f0f8815c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.554+0000 7f0f8e400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f880c60f0 0x7f0f880c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.555+0000 7f0f86a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 0x7f0f8815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.555+0000 7f0f86a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 0x7f0f8815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:46748/0 (socket says 172.21.15.114:46748) 2024-05-09T00:18:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.555+0000 7f0f87400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0f880c4300 0x7f0f88072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:43470/0 (socket says 172.21.15.114:43470) 2024-05-09T00:18:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.556+0000 7f0f86a00640 1 -- 172.21.15.114:0/664110632 learned_addr learned my addr 172.21.15.114:0/664110632 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:38.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.556+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8815a1d0 con 0x7f0f880c4300 2024-05-09T00:18:38.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.556+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0f880c4f20 con 0x7f0f880c60f0 2024-05-09T00:18:38.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.556+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880c5680 con 0x7f0f88159dc0 2024-05-09T00:18:38.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.556+0000 7f0f87e00640 1 --2- 172.21.15.114:0/664110632 >> v2:172.21.15.114:3300/0 conn(0x7f0f880c60f0 0x7f0f880c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.556+0000 7f0f86000640 1 -- 172.21.15.114:0/664110632 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262192235 0 0) 0x7f0f8815a1d0 con 0x7f0f880c4300 2024-05-09T00:18:38.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.558+0000 7f0f86000640 1 -- 172.21.15.114:0/664110632 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6c003520 con 0x7f0f880c4300 2024-05-09T00:18:38.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.558+0000 7f0f86a00640 1 -- 172.21.15.114:0/664110632 >> v2:172.21.15.114:3300/0 conn(0x7f0f880c60f0 msgr2=0x7f0f880c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.558+0000 7f0f86a00640 1 --2- 172.21.15.114:0/664110632 >> v2:172.21.15.114:3300/0 conn(0x7f0f880c60f0 0x7f0f880c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.558+0000 7f0f86000640 1 -- 172.21.15.114:0/664110632 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2103522834 0 0) 0x7f0f6c003520 con 0x7f0f880c4300 2024-05-09T00:18:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.558+0000 7f0f86a00640 1 -- 172.21.15.114:0/664110632 >> v1:172.21.15.153:6789/0 conn(0x7f0f880c4300 legacy=0x7f0f88072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.558+0000 7f0f86a00640 1 -- 172.21.15.114:0/664110632 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f88160820 con 0x7f0f88159dc0 2024-05-09T00:18:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.559+0000 7f0f87e00640 1 --2- 172.21.15.114:0/664110632 >> v2:172.21.15.114:3300/0 conn(0x7f0f880c60f0 0x7f0f880c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.561+0000 7f0f86a00640 1 --2- 172.21.15.114:0/664110632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 0x7f0f8815c780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009870 tx=0x7f0f7802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f832d545c1e0bf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:38.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.562+0000 7f0f86000640 1 -- 172.21.15.114:0/664110632 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78037070 con 0x7f0f88159dc0 2024-05-09T00:18:38.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.562+0000 7f0f86000640 1 -- 172.21.15.114:0/664110632 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78032440 con 0x7f0f88159dc0 2024-05-09T00:18:38.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.562+0000 7f0f86000640 1 -- 172.21.15.114:0/664110632 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78032810 con 0x7f0f88159dc0 2024-05-09T00:18:38.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 msgr2=0x7f0f8815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 --2- 172.21.15.114:0/664110632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 0x7f0f8815c780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009870 tx=0x7f0f7802a160 comp rx=0 tx=0).stop 2024-05-09T00:18:38.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 shutdown_connections 2024-05-09T00:18:38.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 --2- 172.21.15.114:0/664110632 >> v2:172.21.15.114:3300/0 conn(0x7f0f880c60f0 0x7f0f880c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 --2- 172.21.15.114:0/664110632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f88159dc0 0x7f0f8815c780 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 >> 172.21.15.114:0/664110632 conn(0x7f0f8806c680 msgr2=0x7f0f8806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 shutdown_connections 2024-05-09T00:18:38.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.565+0000 7f0f8e400640 1 -- 172.21.15.114:0/664110632 wait complete. 2024-05-09T00:18:38.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.569+0000 7f0f8e400640 1 Processor -- start 2024-05-09T00:18:38.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.569+0000 7f0f8e400640 1 -- start start 2024-05-09T00:18:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.575+0000 7f0f8e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 0x7f0f88154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.576+0000 7f0f8e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f880c60f0 0x7f0f881e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.576+0000 7f0f87400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 0x7f0f88154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.576+0000 7f0f8e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f88159dc0 0x7f0f880adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.577+0000 7f0f86a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f880c60f0 0x7f0f881e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.577+0000 7f0f86a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f880c60f0 0x7f0f881e84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:46754/0 (socket says 172.21.15.114:46754) 2024-05-09T00:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.576+0000 7f0f87400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 0x7f0f88154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44356/0 (socket says 172.21.15.114:44356) 2024-05-09T00:18:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.578+0000 7f0f86a00640 1 -- 172.21.15.114:0/3814510554 learned_addr learned my addr 172.21.15.114:0/3814510554 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.579+0000 7f0f87e00640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f88159dc0 0x7f0f880adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.579+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880c49c0 con 0x7f0f880c4300 2024-05-09T00:18:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.579+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880c5170 con 0x7f0f88159dc0 2024-05-09T00:18:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.579+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880c4b40 con 0x7f0f880c60f0 2024-05-09T00:18:38.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.580+0000 7f0f87400640 1 -- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f880c60f0 msgr2=0x7f0f881e84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.580+0000 7f0f87400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f880c60f0 0x7f0f881e84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.580+0000 7f0f87400640 1 -- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f88159dc0 msgr2=0x7f0f880adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.580+0000 7f0f87400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f88159dc0 0x7f0f880adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:38.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.580+0000 7f0f87400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f88155120 con 0x7f0f880c4300 2024-05-09T00:18:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.581+0000 7f0f87400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 0x7f0f88154be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c780 tx=0x7f0f8000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.582+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80018070 con 0x7f0f880c4300 2024-05-09T00:18:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.582+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f881f5cd0 con 0x7f0f880c4300 2024-05-09T00:18:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.582+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f80004d60 con 0x7f0f880c4300 2024-05-09T00:18:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.582+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000a820 con 0x7f0f880c4300 2024-05-09T00:18:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.583+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f881f6290 con 0x7f0f880c4300 2024-05-09T00:18:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.587+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f88077430 con 0x7f0f880c4300 2024-05-09T00:18:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.595+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f8001b070 con 0x7f0f880c4300 2024-05-09T00:18:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.610+0000 7f0f7f400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f68076300 0x7f0f68078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.610+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f0f80097140 con 0x7f0f880c4300 2024-05-09T00:18:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.611+0000 7f0f86a00640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f68076300 0x7f0f68078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.613+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f88155120 con 0x7f0f880c4300 2024-05-09T00:18:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:38.616+0000 7f0f86a00640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f68076300 0x7f0f68078810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0f78000c00 tx=0x7f0f7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.140+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f880c3e40 con 0x7f0f880c4300 2024-05-09T00:18:39.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.142+0000 7f0f7f400640 1 -- 172.21.15.114:0/3814510554 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7f0f8005fc40 con 0x7f0f880c4300 2024-05-09T00:18:39.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:39.142 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:39.142 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:39.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.146+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f68076300 msgr2=0x7f0f68078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.146+0000 7f0f8e400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f68076300 0x7f0f68078810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0f78000c00 tx=0x7f0f7802e000 comp rx=0 tx=0).stop 2024-05-09T00:18:39.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.146+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 msgr2=0x7f0f88154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.146+0000 7f0f8e400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 0x7f0f88154be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c780 tx=0x7f0f8000cc40 comp rx=0 tx=0).stop 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 shutdown_connections 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0f68076300 0x7f0f68078810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f88159dc0 0x7f0f880adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0f880c60f0 0x7f0f881e84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 --2- 172.21.15.114:0/3814510554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f880c4300 0x7f0f88154be0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 >> 172.21.15.114:0/3814510554 conn(0x7f0f8806c680 msgr2=0x7f0f88156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:39.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 shutdown_connections 2024-05-09T00:18:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:39.147+0000 7f0f8e400640 1 -- 172.21.15.114:0/3814510554 wait complete. 2024-05-09T00:18:39.193 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 59, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 58, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5406": { "addr": "172.21.15.114:6837/2437507270", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2437507270, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2437507270, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5406, "incarnation": 58, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:18:25.023429+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5406 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 59, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4616": { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 59, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 38, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:18:35.026289+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4616 } } } ], "standbys": [] } 2024-05-09T00:18:39.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.428+0000 7f8cb8800640 1 Processor -- start 2024-05-09T00:18:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.428+0000 7f8cb8800640 1 -- start start 2024-05-09T00:18:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.431+0000 7f8cb8800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8cb00c3200 0x7f8cb0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.432+0000 7f8cb5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8cb00c3200 0x7f8cb0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.432+0000 7f8cb5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8cb00c3200 0x7f8cb0158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54848/0 (socket says 172.21.15.114:54848) 2024-05-09T00:18:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.434+0000 7f8cb5400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8cb01522f0 0x7f8cb00c5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44644/0 (socket says 172.21.15.114:44644) 2024-05-09T00:18:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.434+0000 7f8cb5e00640 1 -- 172.21.15.114:0/1670054193 learned_addr learned my addr 172.21.15.114:0/1670054193 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.435+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb0074100 con 0x7f8cb01522f0 2024-05-09T00:18:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.436+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb015c8c0 con 0x7f8cb00735e0 2024-05-09T00:18:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.436+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744235702 0 0) 0x7f8cb0074100 con 0x7f8cb01522f0 2024-05-09T00:18:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.436+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb015c430 con 0x7f8cb00c3200 2024-05-09T00:18:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.437+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c98003520 con 0x7f8cb01522f0 2024-05-09T00:18:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.437+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701565788 0 0) 0x7f8cb015c8c0 con 0x7f8cb00735e0 2024-05-09T00:18:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.437+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb0074100 con 0x7f8cb00735e0 2024-05-09T00:18:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.438+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1961100636 0 0) 0x7f8cb0074100 con 0x7f8cb00735e0 2024-05-09T00:18:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.438+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 >> v2:172.21.15.153:3300/0 conn(0x7f8cb00c3200 msgr2=0x7f8cb0158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.438+0000 7f8cb4a00640 1 --2- 172.21.15.114:0/1670054193 >> v2:172.21.15.153:3300/0 conn(0x7f8cb00c3200 0x7f8cb0158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.438+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 >> v1:172.21.15.114:6789/0 conn(0x7f8cb01522f0 legacy=0x7f8cb00c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.438+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb015bb00 con 0x7f8cb00735e0 2024-05-09T00:18:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f8cac001a50 con 0x7f8cb00735e0 2024-05-09T00:18:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 >> v1:172.21.15.153:6789/0 conn(0x7f8cb00735e0 legacy=0x7f8cb00739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c98004c90 0x7f8c98005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980037a0 0x7f8c98003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c98004300 0x7f8c98014230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb015c430 con 0x7f8c98004c90 2024-05-09T00:18:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98014b10 con 0x7f8c98004300 2024-05-09T00:18:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.439+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c98014d10 con 0x7f8c980037a0 2024-05-09T00:18:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.440+0000 7f8cb5400640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980037a0 0x7f8c98003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.441+0000 7f8cb6800640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c98004300 0x7f8c98014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.442+0000 7f8cb5400640 1 -- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c98004300 msgr2=0x7f8c98014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.442+0000 7f8cb5400640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c98004300 0x7f8c98014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.442+0000 7f8cb5400640 1 -- 172.21.15.114:0/1670054193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c98004c90 msgr2=0x7f8c98005120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:18:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.442+0000 7f8cb5e00640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c98004c90 0x7f8c98005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.445+0000 7f8cb5400640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c98004c90 0x7f8c98005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.445+0000 7f8cb6800640 1 -- 172.21.15.114:0/1670054193 reap_dead start 2024-05-09T00:18:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.445+0000 7f8cb5400640 1 -- 172.21.15.114:0/1670054193 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb015c8c0 con 0x7f8c980037a0 2024-05-09T00:18:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.445+0000 7f8cb5e00640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c98004c90 0x7f8c98005120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.446+0000 7f8cb5400640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980037a0 0x7f8c98003bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cb006d600 tx=0x7f8c98005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baef3d55f58d89cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.447+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40015d0 con 0x7f8c980037a0 2024-05-09T00:18:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.447+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca402e070 con 0x7f8c980037a0 2024-05-09T00:18:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.449+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980037a0 msgr2=0x7f8c98003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.450+0000 7f8cb4a00640 1 -- 172.21.15.114:0/1670054193 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca402ae00 con 0x7f8c980037a0 2024-05-09T00:18:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.450+0000 7f8cb8800640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980037a0 0x7f8c98003bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cb006d600 tx=0x7f8c98005830 comp rx=0 tx=0).stop 2024-05-09T00:18:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.451+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 shutdown_connections 2024-05-09T00:18:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.451+0000 7f8cb8800640 1 --2- 172.21.15.114:0/1670054193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980037a0 0x7f8c98003bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.451+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 >> 172.21.15.114:0/1670054193 conn(0x7f8cb006c680 msgr2=0x7f8cb006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:40.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.452+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 shutdown_connections 2024-05-09T00:18:40.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.452+0000 7f8cb8800640 1 -- 172.21.15.114:0/1670054193 wait complete. 2024-05-09T00:18:40.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.458+0000 7f8cb8800640 1 Processor -- start 2024-05-09T00:18:40.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.458+0000 7f8cb8800640 1 -- start start 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.464+0000 7f8cb8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 0x7f8cb01e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8cb015abe0 0x7f8cb013cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb8800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cb015aff0 0x7f8cb013b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb8800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb00c4140 con 0x7f8cb015aff0 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb015c0c0 con 0x7f8c980037a0 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb00c42c0 con 0x7f8cb015abe0 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 0x7f8cb01e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 0x7f8cb01e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54866/0 (socket says 172.21.15.114:54866) 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb5e00640 1 -- 172.21.15.114:0/3783999368 learned_addr learned my addr 172.21.15.114:0/3783999368 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.465+0000 7f8cb5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8cb015abe0 0x7f8cb013cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.466+0000 7f8cb5e00640 1 -- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8cb015abe0 msgr2=0x7f8cb013cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.466+0000 7f8cb5e00640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8cb015abe0 0x7f8cb013cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:40.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.466+0000 7f8cb5e00640 1 -- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cb015aff0 msgr2=0x7f8cb013b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.466+0000 7f8cb5e00640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cb015aff0 0x7f8cb013b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.466+0000 7f8cb5e00640 1 -- 172.21.15.114:0/3783999368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb01ea460 con 0x7f8c980037a0 2024-05-09T00:18:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.467+0000 7f8cb5e00640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 0x7f8cb01e9f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0004650 tx=0x7f8ca0010ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.467+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000f040 con 0x7f8c980037a0 2024-05-09T00:18:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.467+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca000e950 con 0x7f8c980037a0 2024-05-09T00:18:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.467+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000ed40 con 0x7f8c980037a0 2024-05-09T00:18:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.469+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb01ea970 con 0x7f8c980037a0 2024-05-09T00:18:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.469+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb013c730 con 0x7f8c980037a0 2024-05-09T00:18:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.474+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ca001c400 con 0x7f8c980037a0 2024-05-09T00:18:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.474+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb01eae30 con 0x7f8c980037a0 2024-05-09T00:18:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.475+0000 7f8caa000640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c940762d0 0x7f8c940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.475+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f8ca00980a0 con 0x7f8c980037a0 2024-05-09T00:18:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.477+0000 7f8cb5400640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c940762d0 0x7f8c940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.478+0000 7f8cb5400640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c940762d0 0x7f8c940787e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4032000 tx=0x7f8ca4007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:40.485+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ca0018030 con 0x7f8c980037a0 2024-05-09T00:18:41.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.017+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cb0077430 con 0x7f8c980037a0 2024-05-09T00:18:41.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.019+0000 7f8caa000640 1 -- 172.21.15.114:0/3783999368 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7f8ca0061280 con 0x7f8c980037a0 2024-05-09T00:18:41.019 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:41.019 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:41.020 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.025+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c940762d0 msgr2=0x7f8c940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.025+0000 7f8cb8800640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c940762d0 0x7f8c940787e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4032000 tx=0x7f8ca4007000 comp rx=0 tx=0).stop 2024-05-09T00:18:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.025+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 msgr2=0x7f8cb01e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.026+0000 7f8cb8800640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 0x7f8cb01e9f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0004650 tx=0x7f8ca0010ca0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.026+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 shutdown_connections 2024-05-09T00:18:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.026+0000 7f8cb8800640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8c940762d0 0x7f8c940787e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.026+0000 7f8cb8800640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cb015aff0 0x7f8cb013b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.027+0000 7f8cb8800640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8cb015abe0 0x7f8cb013cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.027+0000 7f8cb8800640 1 --2- 172.21.15.114:0/3783999368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980037a0 0x7f8cb01e9f20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.027+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 >> 172.21.15.114:0/3783999368 conn(0x7f8cb006c680 msgr2=0x7f8cb00c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.027+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 shutdown_connections 2024-05-09T00:18:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.027+0000 7f8cb8800640 1 -- 172.21.15.114:0/3783999368 wait complete. 2024-05-09T00:18:41.085 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:18:41.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.663+0000 7f5fab200640 1 Processor -- start 2024-05-09T00:18:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.663+0000 7f5fab200640 1 -- start start 2024-05-09T00:18:41.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.666+0000 7f5fab200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fac0c69c0 0x7f5fac0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.666+0000 7f5fab200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fac0aebf0 0x7f5fac0c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.667+0000 7f5fab200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fac0ae7f0 con 0x7f5fac0c56c0 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.667+0000 7f5fab200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5fac158490 con 0x7f5fac0aebf0 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.667+0000 7f5fab200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5fac06e240 con 0x7f5fac0c69c0 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.667+0000 7f5fa9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fac0c69c0 0x7f5fac0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.667+0000 7f5fa9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fac0c69c0 0x7f5fac0ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54882/0 (socket says 172.21.15.114:54882) 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.667+0000 7f5fa9e00640 1 -- 172.21.15.114:0/367526192 learned_addr learned my addr 172.21.15.114:0/367526192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:41.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.669+0000 7f5fa9400640 1 --2- 172.21.15.114:0/367526192 >> v2:172.21.15.114:3300/0 conn(0x7f5fac0aebf0 0x7f5fac0c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.670+0000 7f5fa9400640 1 -- 172.21.15.114:0/367526192 >> v2:172.21.15.153:3300/0 conn(0x7f5fac0c69c0 msgr2=0x7f5fac0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.670+0000 7f5fa9400640 1 --2- 172.21.15.114:0/367526192 >> v2:172.21.15.153:3300/0 conn(0x7f5fac0c69c0 0x7f5fac0ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.670+0000 7f5fa9400640 1 -- 172.21.15.114:0/367526192 >> v1:172.21.15.153:6789/0 conn(0x7f5fac0c56c0 legacy=0x7f5fac154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.670+0000 7f5fa9400640 1 -- 172.21.15.114:0/367526192 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac06e520 con 0x7f5fac0aebf0 2024-05-09T00:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.679+0000 7f5fa9400640 1 --2- 172.21.15.114:0/367526192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0aebf0 0x7f5fac0c5180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0718e0 tx=0x7f5f9c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b8f6754595b24c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.684+0000 7f5fa8a00640 1 -- 172.21.15.114:0/367526192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c037070 con 0x7f5fac0aebf0 2024-05-09T00:18:41.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.684+0000 7f5fa8a00640 1 -- 172.21.15.114:0/367526192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c02ad50 con 0x7f5fac0aebf0 2024-05-09T00:18:41.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.684+0000 7f5fa8a00640 1 -- 172.21.15.114:0/367526192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c032660 con 0x7f5fac0aebf0 2024-05-09T00:18:41.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.687+0000 7f5fab200640 1 -- 172.21.15.114:0/367526192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0aebf0 msgr2=0x7f5fac0c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.687+0000 7f5fab200640 1 --2- 172.21.15.114:0/367526192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0aebf0 0x7f5fac0c5180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0718e0 tx=0x7f5f9c02a000 comp rx=0 tx=0).stop 2024-05-09T00:18:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.706+0000 7f5fab200640 1 -- 172.21.15.114:0/367526192 shutdown_connections 2024-05-09T00:18:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.706+0000 7f5fab200640 1 --2- 172.21.15.114:0/367526192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0aebf0 0x7f5fac0c5180 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.706+0000 7f5fab200640 1 --2- 172.21.15.114:0/367526192 >> v2:172.21.15.153:3300/0 conn(0x7f5fac0c69c0 0x7f5fac0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.706+0000 7f5fab200640 1 -- 172.21.15.114:0/367526192 >> 172.21.15.114:0/367526192 conn(0x7f5fac0c5ea0 msgr2=0x7f5fac0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.707+0000 7f5fab200640 1 -- 172.21.15.114:0/367526192 shutdown_connections 2024-05-09T00:18:41.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.709+0000 7f5fab200640 1 -- 172.21.15.114:0/367526192 wait complete. 2024-05-09T00:18:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.721+0000 7f5fab200640 1 Processor -- start 2024-05-09T00:18:41.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.722+0000 7f5fab200640 1 -- start start 2024-05-09T00:18:41.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.724+0000 7f5fab200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 0x7f5fac0c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.724+0000 7f5fab200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fac0c56c0 0x7f5fac1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.724+0000 7f5fab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0c69c0 0x7f5fac1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.724+0000 7f5fab200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac074450 con 0x7f5fac0c69c0 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.724+0000 7f5fab200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac0742d0 con 0x7f5fac0c56c0 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.724+0000 7f5fab200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fac0af2f0 con 0x7f5fac0aebf0 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.725+0000 7f5fa9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fac0c56c0 0x7f5fac1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.725+0000 7f5faa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0c69c0 0x7f5fac1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.725+0000 7f5fa9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 0x7f5fac0c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.725+0000 7f5fa9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 0x7f5fac0c7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:46784/0 (socket says 172.21.15.114:46784) 2024-05-09T00:18:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.725+0000 7f5fa9e00640 1 -- 172.21.15.114:0/2454142464 learned_addr learned my addr 172.21.15.114:0/2454142464 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:41.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.728+0000 7f5fa9e00640 1 -- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fac0c56c0 msgr2=0x7f5fac1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.728+0000 7f5fa9e00640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fac0c56c0 0x7f5fac1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.728+0000 7f5fa9e00640 1 -- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0c69c0 msgr2=0x7f5fac1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.728+0000 7f5fa9e00640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0c69c0 0x7f5fac1540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:41.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.729+0000 7f5fa9e00640 1 -- 172.21.15.114:0/2454142464 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac157280 con 0x7f5fac0aebf0 2024-05-09T00:18:41.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.733+0000 7f5fa9e00640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 0x7f5fac0c7a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007ba0 tx=0x7f5fa400d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.734+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4018070 con 0x7f5fac0aebf0 2024-05-09T00:18:41.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.734+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa400ddb0 con 0x7f5fac0aebf0 2024-05-09T00:18:41.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.734+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4018070 con 0x7f5fac0aebf0 2024-05-09T00:18:41.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.736+0000 7f5fab200640 1 -- 172.21.15.114:0/2454142464 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac157560 con 0x7f5fac0aebf0 2024-05-09T00:18:41.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.736+0000 7f5fab200640 1 -- 172.21.15.114:0/2454142464 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac1530d0 con 0x7f5fac0aebf0 2024-05-09T00:18:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.738+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac078430 con 0x7f5fac0aebf0 2024-05-09T00:18:41.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.742+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5fa401b070 con 0x7f5fac0aebf0 2024-05-09T00:18:41.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.744+0000 7f5fa2000640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5f8c0764d0 0x7f5f8c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:41.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.745+0000 7f5fa9400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5f8c0764d0 0x7f5f8c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.747+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f5fa4097190 con 0x7f5fac0aebf0 2024-05-09T00:18:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.747+0000 7f5fa9400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5f8c0764d0 0x7f5f8c0789e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c034000 tx=0x7f5f9c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:41.759+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5fa4010070 con 0x7f5fac0aebf0 2024-05-09T00:18:42.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.355+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fac073a70 con 0x7f5fac0aebf0 2024-05-09T00:18:42.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.362+0000 7f5fa2000640 1 -- 172.21.15.114:0/2454142464 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7f5fa405fdc0 con 0x7f5fac0aebf0 2024-05-09T00:18:42.362 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:42.362 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:42.363 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.367+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5f8c0764d0 msgr2=0x7f5f8c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.367+0000 7f5f97400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5f8c0764d0 0x7f5f8c0789e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c034000 tx=0x7f5f9c02e000 comp rx=0 tx=0).stop 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 msgr2=0x7f5fac0c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 0x7f5fac0c7a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007ba0 tx=0x7f5fa400d4a0 comp rx=0 tx=0).stop 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 shutdown_connections 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5f8c0764d0 0x7f5f8c0789e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fac0c69c0 0x7f5fac1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fac0c56c0 0x7f5fac1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 --2- 172.21.15.114:0/2454142464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fac0aebf0 0x7f5fac0c7a00 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007ba0 tx=0x7f5fa400d4a0 comp rx=0 tx=0).stop 2024-05-09T00:18:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 >> 172.21.15.114:0/2454142464 conn(0x7f5fac0c5ea0 msgr2=0x7f5fac0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:42.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.368+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 shutdown_connections 2024-05-09T00:18:42.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:42.369+0000 7f5f97400640 1 -- 172.21.15.114:0/2454142464 wait complete. 2024-05-09T00:18:42.422 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:18:43.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.620+0000 7fd69be00640 1 Processor -- start 2024-05-09T00:18:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.620+0000 7fd69be00640 1 -- start start 2024-05-09T00:18:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.627+0000 7fd69be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694072870 0x7fd6940cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.628+0000 7fd69be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd69406f350 0x7fd69415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.629+0000 7fd699e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd69406f350 0x7fd69415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.629+0000 7fd699e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd69406f350 0x7fd69415fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54888/0 (socket says 172.21.15.114:54888) 2024-05-09T00:18:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.629+0000 7fd699e00640 1 -- 172.21.15.114:0/719387480 learned_addr learned my addr 172.21.15.114:0/719387480 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.629+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd69406ec10 con 0x7fd69406fbf0 2024-05-09T00:18:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.629+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd69406f1b0 con 0x7fd69406f350 2024-05-09T00:18:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.630+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd694073100 con 0x7fd694072870 2024-05-09T00:18:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.631+0000 7fd699400640 1 --2- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694072870 0x7fd6940cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.631+0000 7fd699e00640 1 -- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694072870 msgr2=0x7fd6940cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.631+0000 7fd699e00640 1 --2- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694072870 0x7fd6940cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.631+0000 7fd699e00640 1 -- 172.21.15.114:0/719387480 >> v1:172.21.15.114:6789/0 conn(0x7fd69406fbf0 legacy=0x7fd694159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.632+0000 7fd699e00640 1 -- 172.21.15.114:0/719387480 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69406eed0 con 0x7fd69406f350 2024-05-09T00:18:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.635+0000 7fd699e00640 1 --2- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd69406f350 0x7fd69415fd10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd688009870 tx=0x7fd68802a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872710658eb10404 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.636+0000 7fd693e00640 1 -- 172.21.15.114:0/719387480 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688037070 con 0x7fd69406f350 2024-05-09T00:18:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.637+0000 7fd693e00640 1 -- 172.21.15.114:0/719387480 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688032440 con 0x7fd69406f350 2024-05-09T00:18:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.637+0000 7fd693e00640 1 -- 172.21.15.114:0/719387480 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688032810 con 0x7fd69406f350 2024-05-09T00:18:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.638+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd69406f350 msgr2=0x7fd69415fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.638+0000 7fd69be00640 1 --2- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd69406f350 0x7fd69415fd10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd688009870 tx=0x7fd68802a140 comp rx=0 tx=0).stop 2024-05-09T00:18:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.641+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 shutdown_connections 2024-05-09T00:18:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.641+0000 7fd69be00640 1 --2- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd69406f350 0x7fd69415fd10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.641+0000 7fd69be00640 1 --2- 172.21.15.114:0/719387480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694072870 0x7fd6940cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.641+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 >> 172.21.15.114:0/719387480 conn(0x7fd69406c680 msgr2=0x7fd69406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.643+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 shutdown_connections 2024-05-09T00:18:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.644+0000 7fd69be00640 1 -- 172.21.15.114:0/719387480 wait complete. 2024-05-09T00:18:43.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.654+0000 7fd69be00640 1 Processor -- start 2024-05-09T00:18:43.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.655+0000 7fd69be00640 1 -- start start 2024-05-09T00:18:43.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.658+0000 7fd69be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69406f350 0x7fd6940b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:43.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.658+0000 7fd69be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd69406fbf0 0x7fd6940ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:43.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.659+0000 7fd69be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd694072870 0x7fd69415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:43.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.659+0000 7fd69be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd69406f8e0 con 0x7fd69406fbf0 2024-05-09T00:18:43.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.659+0000 7fd69be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd69406f760 con 0x7fd694072870 2024-05-09T00:18:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.659+0000 7fd69be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd694160250 con 0x7fd69406f350 2024-05-09T00:18:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.659+0000 7fd699400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69406f350 0x7fd6940b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.660+0000 7fd699400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69406f350 0x7fd6940b63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:46790/0 (socket says 172.21.15.114:46790) 2024-05-09T00:18:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.660+0000 7fd699400640 1 -- 172.21.15.114:0/2356353018 learned_addr learned my addr 172.21.15.114:0/2356353018 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.660+0000 7fd699e00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd694072870 0x7fd69415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.661+0000 7fd698a00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd69406fbf0 0x7fd6940ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.661+0000 7fd699e00640 1 -- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69406f350 msgr2=0x7fd6940b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.661+0000 7fd699e00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69406f350 0x7fd6940b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:43.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.661+0000 7fd699e00640 1 -- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd69406fbf0 msgr2=0x7fd6940ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.662+0000 7fd699e00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd69406fbf0 0x7fd6940ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.662+0000 7fd699e00640 1 -- 172.21.15.114:0/2356353018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6940b5ab0 con 0x7fd694072870 2024-05-09T00:18:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.662+0000 7fd698a00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd69406fbf0 0x7fd6940ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.663+0000 7fd699e00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd694072870 0x7fd69415be00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd69406ee00 tx=0x7fd6880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.663+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688041020 con 0x7fd694072870 2024-05-09T00:18:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.664+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688030700 con 0x7fd694072870 2024-05-09T00:18:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.664+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688041020 con 0x7fd694072870 2024-05-09T00:18:43.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.665+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6940b5d90 con 0x7fd694072870 2024-05-09T00:18:43.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.665+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69406e540 con 0x7fd694072870 2024-05-09T00:18:43.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.668+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6940784d0 con 0x7fd694072870 2024-05-09T00:18:43.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.681+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd688044020 con 0x7fd694072870 2024-05-09T00:18:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.689+0000 7fd691600640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6740764d0 0x7fd6740789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:43.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.689+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fd6880b88c0 con 0x7fd694072870 2024-05-09T00:18:43.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.690+0000 7fd699400640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6740764d0 0x7fd6740789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.690+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd68804b070 con 0x7fd694072870 2024-05-09T00:18:43.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:43.691+0000 7fd699400640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6740764d0 0x7fd6740789e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd680007a60 tx=0x7fd680008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:44.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.192+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd69415d6c0 con 0x7fd694072870 2024-05-09T00:18:44.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.193+0000 7fd691600640 1 -- 172.21.15.114:0/2356353018 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7fd688081440 con 0x7fd694072870 2024-05-09T00:18:44.198 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:44.198 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:44.198 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:44.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.199+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6740764d0 msgr2=0x7fd6740789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:44.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.199+0000 7fd69be00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6740764d0 0x7fd6740789e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd680007a60 tx=0x7fd680008040 comp rx=0 tx=0).stop 2024-05-09T00:18:44.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.199+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd694072870 msgr2=0x7fd69415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:44.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.199+0000 7fd69be00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd694072870 0x7fd69415be00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd69406ee00 tx=0x7fd6880046c0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.200+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 shutdown_connections 2024-05-09T00:18:44.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.200+0000 7fd69be00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd6740764d0 0x7fd6740789e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.200+0000 7fd69be00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd694072870 0x7fd69415be00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.200+0000 7fd69be00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd69406fbf0 0x7fd6940ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.200+0000 7fd69be00640 1 --2- 172.21.15.114:0/2356353018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69406f350 0x7fd6940b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.200+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 >> 172.21.15.114:0/2356353018 conn(0x7fd69406c680 msgr2=0x7fd69415db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:44.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.201+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 shutdown_connections 2024-05-09T00:18:44.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.201+0000 7fd69be00640 1 -- 172.21.15.114:0/2356353018 wait complete. 2024-05-09T00:18:44.262 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 59, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 58, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5406": { "addr": "172.21.15.114:6837/2437507270", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2437507270, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2437507270, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5406, "incarnation": 58, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:18:25.023429+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5406 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 59, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4616": { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 59, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 38, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:18:35.026289+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4616 } } } ], "standbys": [] } 2024-05-09T00:18:44.423 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.915+0000 7fc101400640 1 Processor -- start 2024-05-09T00:18:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.917+0000 7fc101400640 1 -- start start 2024-05-09T00:18:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.922+0000 7fc101400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0fc0c4300 0x7fc0fc159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.922+0000 7fc101400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0fc15c780 0x7fc0fc072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.922+0000 7fc101400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0fc160820 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.922+0000 7fc101400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc0fc0c4f20 con 0x7fc0fc0c4300 2024-05-09T00:18:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.922+0000 7fc101400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc0fc0c5680 con 0x7fc0fc15c780 2024-05-09T00:18:44.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.927+0000 7fc0f9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0fc15c780 0x7fc0fc072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:44.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.928+0000 7fc0f9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0fc15c780 0x7fc0fc072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54916/0 (socket says 172.21.15.114:54916) 2024-05-09T00:18:44.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.928+0000 7fc0f9e00640 1 -- 172.21.15.114:0/3613638500 learned_addr learned my addr 172.21.15.114:0/3613638500 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:44.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.929+0000 7fc0f9e00640 1 -- 172.21.15.114:0/3613638500 >> v2:172.21.15.114:3300/0 conn(0x7fc0fc0c4300 msgr2=0x7fc0fc159dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:18:44.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.929+0000 7fc0f9e00640 1 --2- 172.21.15.114:0/3613638500 >> v2:172.21.15.114:3300/0 conn(0x7fc0fc0c4300 0x7fc0fc159dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.929+0000 7fc0f9e00640 1 -- 172.21.15.114:0/3613638500 >> v1:172.21.15.114:6789/0 conn(0x7fc0fc0c60f0 legacy=0x7fc0fc06f3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:18:44.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.929+0000 7fc0f9e00640 1 -- 172.21.15.114:0/3613638500 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc160b00 con 0x7fc0fc15c780 2024-05-09T00:18:44.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.934+0000 7fc0f9e00640 1 --2- 172.21.15.114:0/3613638500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc15c780 0x7fc0fc072d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0c4ed0 tx=0x7fc0f402a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484ae5feb95907d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:44.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.937+0000 7fc0f9400640 1 -- 172.21.15.114:0/3613638500 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4036070 con 0x7fc0fc15c780 2024-05-09T00:18:44.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.937+0000 7fc0f9400640 1 -- 172.21.15.114:0/3613638500 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f4031600 con 0x7fc0fc15c780 2024-05-09T00:18:44.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.937+0000 7fc0f9400640 1 -- 172.21.15.114:0/3613638500 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40319d0 con 0x7fc0fc15c780 2024-05-09T00:18:44.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.938+0000 7fc101400640 1 -- 172.21.15.114:0/3613638500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc15c780 msgr2=0x7fc0fc072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:44.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.938+0000 7fc101400640 1 --2- 172.21.15.114:0/3613638500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc15c780 0x7fc0fc072d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0c4ed0 tx=0x7fc0f402a590 comp rx=0 tx=0).stop 2024-05-09T00:18:44.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.940+0000 7fc101400640 1 -- 172.21.15.114:0/3613638500 shutdown_connections 2024-05-09T00:18:44.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.940+0000 7fc101400640 1 --2- 172.21.15.114:0/3613638500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc15c780 0x7fc0fc072d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.940+0000 7fc101400640 1 --2- 172.21.15.114:0/3613638500 >> v2:172.21.15.114:3300/0 conn(0x7fc0fc0c4300 0x7fc0fc159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.940+0000 7fc101400640 1 -- 172.21.15.114:0/3613638500 >> 172.21.15.114:0/3613638500 conn(0x7fc0fc06c680 msgr2=0x7fc0fc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:44.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.940+0000 7fc101400640 1 -- 172.21.15.114:0/3613638500 shutdown_connections 2024-05-09T00:18:44.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.940+0000 7fc101400640 1 -- 172.21.15.114:0/3613638500 wait complete. 2024-05-09T00:18:44.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.944+0000 7fc101400640 1 Processor -- start 2024-05-09T00:18:44.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.944+0000 7fc101400640 1 -- start start 2024-05-09T00:18:44.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.947+0000 7fc101400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc0c4300 0x7fc0fc1e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.947+0000 7fc101400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0fc0c60f0 0x7fc0fc1f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.948+0000 7fc101400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0fc15c780 0x7fc0fc15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.948+0000 7fc101400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc0c5170 con 0x7fc0fc15c780 2024-05-09T00:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.948+0000 7fc101400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc0732b0 con 0x7fc0fc0c4300 2024-05-09T00:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.948+0000 7fc101400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc0fc0c49c0 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.949+0000 7fc0f9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0fc0c60f0 0x7fc0fc1f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.949+0000 7fc0fa800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc0c4300 0x7fc0fc1e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.949+0000 7fc0fa800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc0c4300 0x7fc0fc1e5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:54918/0 (socket says 172.21.15.114:54918) 2024-05-09T00:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.949+0000 7fc0fa800640 1 -- 172.21.15.114:0/2983106405 learned_addr learned my addr 172.21.15.114:0/2983106405 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.949+0000 7fc0fb200640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0fc15c780 0x7fc0fc15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.954+0000 7fc0f9e00640 1 -- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc0c4300 msgr2=0x7fc0fc1e5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.954+0000 7fc0f9e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc0c4300 0x7fc0fc1e5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.954+0000 7fc0f9e00640 1 -- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0fc15c780 msgr2=0x7fc0fc15ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.954+0000 7fc0f9e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0fc15c780 0x7fc0fc15ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.954+0000 7fc0f9e00640 1 -- 172.21.15.114:0/2983106405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc0af5c0 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.954+0000 7fc0fb200640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0fc15c780 0x7fc0fc15ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.955+0000 7fc0f9e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0fc0c60f0 0x7fc0fc1f33f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4030000 tx=0x7fc0f4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:44.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.956+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4041020 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.956+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f4037040 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.957+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4036070 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.957+0000 7fc101400640 1 -- 172.21.15.114:0/2983106405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0fc155dd0 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.957+0000 7fc101400640 1 -- 172.21.15.114:0/2983106405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0fc1f2ed0 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.959+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d0005290 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.967+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0f4044020 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.969+0000 7fc0f2a00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc0dc076300 0x7fc0dc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:44.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.969+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fc0f40b8da0 con 0x7fc0fc0c60f0 2024-05-09T00:18:44.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.970+0000 7fc0fa800640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc0dc076300 0x7fc0dc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.971+0000 7fc0fa800640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc0dc076300 0x7fc0dc078810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8006fd0 tx=0x7fc0e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:44.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:44.975+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0f404b030 con 0x7fc0fc0c60f0 2024-05-09T00:18:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.489+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0d0005580 con 0x7fc0fc0c60f0 2024-05-09T00:18:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.491+0000 7fc0f2a00640 1 -- 172.21.15.114:0/2983106405 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7fc0f4081f70 con 0x7fc0fc0c60f0 2024-05-09T00:18:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:45.496 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc0dc076300 msgr2=0x7fc0dc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc0dc076300 0x7fc0dc078810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8006fd0 tx=0x7fc0e8008040 comp rx=0 tx=0).stop 2024-05-09T00:18:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0fc0c60f0 msgr2=0x7fc0fc1f33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0fc0c60f0 0x7fc0fc1f33f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4030000 tx=0x7fc0f4004a40 comp rx=0 tx=0).stop 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 shutdown_connections 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc0dc076300 0x7fc0dc078810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0fc15c780 0x7fc0fc15ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0fc0c60f0 0x7fc0fc1f33f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2983106405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0fc0c4300 0x7fc0fc1e5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.497+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 >> 172.21.15.114:0/2983106405 conn(0x7fc0fc06c680 msgr2=0x7fc0fc15b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.498+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 shutdown_connections 2024-05-09T00:18:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:45.498+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2983106405 wait complete. 2024-05-09T00:18:45.547 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:18:46.263 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:46.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:18:46.529 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:18:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.108+0000 7fb5c7200640 1 Processor -- start 2024-05-09T00:18:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.117+0000 7fb5c7200640 1 -- start start 2024-05-09T00:18:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.120+0000 7fb5c7200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c80c8870 0x7fb5c8158830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.120+0000 7fb5c7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c8158050 con 0x7fb5c806de70 2024-05-09T00:18:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.120+0000 7fb5c7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c80c7f70 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.120+0000 7fb5c7200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c81583a0 con 0x7fb5c80c8870 2024-05-09T00:18:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.120+0000 7fb5c6800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb5c80cb7d0 0x7fb5c81629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:43492/0 (socket says 172.21.15.114:43492) 2024-05-09T00:18:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.121+0000 7fb5c6800640 1 -- 172.21.15.114:0/2424097302 learned_addr learned my addr 172.21.15.114:0/2424097302 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:47.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.122+0000 7fb5c5e00640 1 --2- 172.21.15.114:0/2424097302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c80c8870 0x7fb5c8158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:47.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.122+0000 7fb5c5e00640 1 -- 172.21.15.114:0/2424097302 >> v1:172.21.15.153:6789/0 conn(0x7fb5c80cb7d0 legacy=0x7fb5c81629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.122+0000 7fb5c5e00640 1 -- 172.21.15.114:0/2424097302 >> v1:172.21.15.114:6789/0 conn(0x7fb5c806de70 legacy=0x7fb5c806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.122+0000 7fb5c5e00640 1 -- 172.21.15.114:0/2424097302 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c80c8250 con 0x7fb5c80c8870 2024-05-09T00:18:47.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.130+0000 7fb5c5e00640 1 --2- 172.21.15.114:0/2424097302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c80c8870 0x7fb5c8158830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097d0 tx=0x7fb5b4029f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a84b886b507e1a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:47.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.131+0000 7fb5c4a00640 1 -- 172.21.15.114:0/2424097302 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4037070 con 0x7fb5c80c8870 2024-05-09T00:18:47.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.131+0000 7fb5c4a00640 1 -- 172.21.15.114:0/2424097302 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b402ab90 con 0x7fb5c80c8870 2024-05-09T00:18:47.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.131+0000 7fb5c4a00640 1 -- 172.21.15.114:0/2424097302 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4032440 con 0x7fb5c80c8870 2024-05-09T00:18:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 -- 172.21.15.114:0/2424097302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c80c8870 msgr2=0x7fb5c8158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 --2- 172.21.15.114:0/2424097302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c80c8870 0x7fb5c8158830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097d0 tx=0x7fb5b4029f00 comp rx=0 tx=0).stop 2024-05-09T00:18:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 -- 172.21.15.114:0/2424097302 shutdown_connections 2024-05-09T00:18:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 --2- 172.21.15.114:0/2424097302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c80c8870 0x7fb5c8158830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 -- 172.21.15.114:0/2424097302 >> 172.21.15.114:0/2424097302 conn(0x7fb5c80cd650 msgr2=0x7fb5c80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 -- 172.21.15.114:0/2424097302 shutdown_connections 2024-05-09T00:18:47.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.158+0000 7fb5c7200640 1 -- 172.21.15.114:0/2424097302 wait complete. 2024-05-09T00:18:47.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.166+0000 7fb5c7200640 1 Processor -- start 2024-05-09T00:18:47.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.167+0000 7fb5c7200640 1 -- start start 2024-05-09T00:18:47.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.170+0000 7fb5c7200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 0x7fb5c81f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.171+0000 7fb5c5e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 0x7fb5c81f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.171+0000 7fb5c5e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 0x7fb5c81f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:46826/0 (socket says 172.21.15.114:46826) 2024-05-09T00:18:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.172+0000 7fb5c5e00640 1 -- 172.21.15.114:0/3432027242 learned_addr learned my addr 172.21.15.114:0/3432027242 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.172+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c80cb7d0 0x7fb5c8150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:47.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.172+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5c81e1d70 0x7fb5c81e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:47.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.172+0000 7fb5c5400640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c80cb7d0 0x7fb5c8150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:47.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.175+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80cd070 con 0x7fb5c81e1d70 2024-05-09T00:18:47.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.175+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80ccef0 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.175+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c8158d70 con 0x7fb5c806de70 2024-05-09T00:18:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.176+0000 7fb5c6800640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5c81e1d70 0x7fb5c81e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.176+0000 7fb5c5400640 1 -- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 msgr2=0x7fb5c81f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.176+0000 7fb5c5400640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 0x7fb5c81f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.176+0000 7fb5c5400640 1 -- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5c81e1d70 msgr2=0x7fb5c81e2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.176+0000 7fb5c5400640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5c81e1d70 0x7fb5c81e2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.177+0000 7fb5c5400640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c8152bc0 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.177+0000 7fb5c6800640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5c81e1d70 0x7fb5c81e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:47.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.177+0000 7fb5c5e00640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 0x7fb5c81f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:47.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.182+0000 7fb5c5400640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c80cb7d0 0x7fb5c8150850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c430 tx=0x7fb5b800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:47.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.186+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8017070 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.188+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b80035f0 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.189+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c8152ea0 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.190+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80039e0 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.194+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c81e1850 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.199+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5b801a070 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.199+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c8078350 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.201+0000 7fb5be000640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb5a80762d0 0x7fb5a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.202+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fb5b809b060 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.203+0000 7fb5c5e00640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb5a80762d0 0x7fb5a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:47.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.205+0000 7fb5c5e00640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb5a80762d0 0x7fb5a80787e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb5b402a470 tx=0x7fb5b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:47.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.215+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb5b805fa00 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:47.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.846+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5c80cc0b0 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.847+0000 7fb5be000640 1 -- 172.21.15.114:0/3432027242 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+4832 (secure 0 0 0) 0x7fb5b8068040 con 0x7fb5c80cb7d0 2024-05-09T00:18:47.848 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:47.848 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:25.023429+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:47.848 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2024-05-09T00:18:47.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.852+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb5a80762d0 msgr2=0x7fb5a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.852+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb5a80762d0 0x7fb5a80787e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb5b402a470 tx=0x7fb5b402e000 comp rx=0 tx=0).stop 2024-05-09T00:18:47.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.852+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c80cb7d0 msgr2=0x7fb5c8150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:47.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.852+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c80cb7d0 0x7fb5c8150850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c430 tx=0x7fb5b800c8f0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.854+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 shutdown_connections 2024-05-09T00:18:47.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.854+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb5a80762d0 0x7fb5a80787e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.854+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5c81e1d70 0x7fb5c81e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.854+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c80cb7d0 0x7fb5c8150850 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.854+0000 7fb5c7200640 1 --2- 172.21.15.114:0/3432027242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c806de70 0x7fb5c81f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:47.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.854+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 >> 172.21.15.114:0/3432027242 conn(0x7fb5c80cd650 msgr2=0x7fb5c8151510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:47.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.855+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 shutdown_connections 2024-05-09T00:18:47.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:47.855+0000 7fb5c7200640 1 -- 172.21.15.114:0/3432027242 wait complete. 2024-05-09T00:18:47.911 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:18:49.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.041+0000 7f742b200640 1 Processor -- start 2024-05-09T00:18:49.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.041+0000 7f742b200640 1 -- start start 2024-05-09T00:18:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.044+0000 7f742b200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f742c0c8870 0x7f742c158830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.044+0000 7f742b200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f742c0cb7d0 0x7f742c1629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.044+0000 7f742b200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c158050 con 0x7f742c06de70 2024-05-09T00:18:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.044+0000 7f742b200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f742c1583a0 con 0x7f742c0c8870 2024-05-09T00:18:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.044+0000 7f742b200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f742c0c7f70 con 0x7f742c0cb7d0 2024-05-09T00:18:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.045+0000 7f7429400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f742c06de70 0x7f742c06cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:48446/0 (socket says 172.21.15.114:48446) 2024-05-09T00:18:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.045+0000 7f7429400640 1 -- 172.21.15.114:0/1087014944 learned_addr learned my addr 172.21.15.114:0/1087014944 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.048+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184851491 0 0) 0x7f742c158050 con 0x7f742c06de70 2024-05-09T00:18:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.049+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7410003520 con 0x7f742c06de70 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.049+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2692907938 0 0) 0x7f7410003520 con 0x7f742c06de70 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.049+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 >> v2:172.21.15.153:3300/0 conn(0x7f742c0cb7d0 msgr2=0x7f742c1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.049+0000 7f7428a00640 1 --2- 172.21.15.114:0/1087014944 >> v2:172.21.15.153:3300/0 conn(0x7f742c0cb7d0 0x7f742c1629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.049+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 >> v2:172.21.15.114:3300/0 conn(0x7f742c0c8870 msgr2=0x7f742c158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.049+0000 7f7428a00640 1 --2- 172.21.15.114:0/1087014944 >> v2:172.21.15.114:3300/0 conn(0x7f742c0c8870 0x7f742c158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c0c8250 con 0x7f742c06de70 2024-05-09T00:18:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f74180016f0 con 0x7f742c06de70 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 >> v1:172.21.15.153:6789/0 conn(0x7f742c06de70 legacy=0x7f742c06cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7410003b10 0x7f7410003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7410004920 0x7f7410004d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74100121c0 0x7f74100145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1583a0 con 0x7f7410004920 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0c7f70 con 0x7f7410003b10 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.050+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7410014e30 con 0x7f74100121c0 2024-05-09T00:18:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.051+0000 7f742a800640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74100121c0 0x7f74100145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.053+0000 7f7429400640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7410004920 0x7f7410004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.056+0000 7f7429400640 1 -- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74100121c0 msgr2=0x7f74100145e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.056+0000 7f7429400640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74100121c0 0x7f74100145e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.056+0000 7f7429400640 1 -- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7410003b10 msgr2=0x7f7410003fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:18:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.056+0000 7f7429e00640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7410003b10 0x7f7410003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.056+0000 7f7429400640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7410003b10 0x7f7410003fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.057+0000 7f7429400640 1 -- 172.21.15.114:0/1087014944 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7410003520 con 0x7f7410004920 2024-05-09T00:18:49.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.056+0000 7f742a800640 1 -- 172.21.15.114:0/1087014944 reap_dead start 2024-05-09T00:18:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.072+0000 7f7429400640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7410004920 0x7f7410004d70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f741800c210 tx=0x7f7410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee04339cf3de3ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:49.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.073+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418007ce0 con 0x7f7410004920 2024-05-09T00:18:49.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.073+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7418005ad0 con 0x7f7410004920 2024-05-09T00:18:49.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.073+0000 7f7428a00640 1 -- 172.21.15.114:0/1087014944 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418007ce0 con 0x7f7410004920 2024-05-09T00:18:49.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.074+0000 7f742b200640 1 -- 172.21.15.114:0/1087014944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7410004920 msgr2=0x7f7410004d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:49.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.074+0000 7f742b200640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7410004920 0x7f7410004d70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f741800c210 tx=0x7f7410005830 comp rx=0 tx=0).stop 2024-05-09T00:18:49.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.076+0000 7f742b200640 1 -- 172.21.15.114:0/1087014944 shutdown_connections 2024-05-09T00:18:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.076+0000 7f742b200640 1 --2- 172.21.15.114:0/1087014944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7410004920 0x7f7410004d70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.076+0000 7f742b200640 1 -- 172.21.15.114:0/1087014944 >> 172.21.15.114:0/1087014944 conn(0x7f742c0cd650 msgr2=0x7f742c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:49.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.084+0000 7f742b200640 1 -- 172.21.15.114:0/1087014944 shutdown_connections 2024-05-09T00:18:49.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.084+0000 7f742b200640 1 -- 172.21.15.114:0/1087014944 wait complete. 2024-05-09T00:18:49.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.092+0000 7f742b200640 1 Processor -- start 2024-05-09T00:18:49.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.092+0000 7f742b200640 1 -- start start 2024-05-09T00:18:49.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.098+0000 7f742b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7410004920 0x7f742c1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.099+0000 7f742b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f742c157a10 0x7f742c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.099+0000 7f742b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f742c14dde0 0x7f742c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.099+0000 7f7429e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7410004920 0x7f742c1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.099+0000 7f7429400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f742c157a10 0x7f742c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.099+0000 7f7429400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f742c157a10 0x7f742c14d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44878/0 (socket says 172.21.15.114:44878) 2024-05-09T00:18:49.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.100+0000 7f7429400640 1 -- 172.21.15.114:0/3597227009 learned_addr learned my addr 172.21.15.114:0/3597227009 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:49.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.100+0000 7f742b200640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0c3fc0 con 0x7f742c14dde0 2024-05-09T00:18:49.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.100+0000 7f742b200640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0cd100 con 0x7f742c157a10 2024-05-09T00:18:49.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.100+0000 7f742b200640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f742c0c4140 con 0x7f7410004920 2024-05-09T00:18:49.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.101+0000 7f742a800640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f742c14dde0 0x7f742c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.101+0000 7f7429e00640 1 -- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f742c157a10 msgr2=0x7f742c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:49.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.101+0000 7f7429e00640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f742c157a10 0x7f742c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.101+0000 7f7429e00640 1 -- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f742c14dde0 msgr2=0x7f742c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:49.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.101+0000 7f7429e00640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f742c14dde0 0x7f742c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.101+0000 7f7429e00640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c157fe0 con 0x7f7410004920 2024-05-09T00:18:49.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.103+0000 7f7429e00640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7410004920 0x7f742c1574d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f742c06a230 tx=0x7f741c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:49.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.103+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c015070 con 0x7f7410004920 2024-05-09T00:18:49.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.104+0000 7f742b200640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c14e1f0 con 0x7f7410004920 2024-05-09T00:18:49.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.104+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c011800 con 0x7f7410004920 2024-05-09T00:18:49.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.104+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c011bf0 con 0x7f7410004920 2024-05-09T00:18:49.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.105+0000 7f742b200640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c0b2750 con 0x7f7410004920 2024-05-09T00:18:49.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.108+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c14e3c0 con 0x7f7410004920 2024-05-09T00:18:49.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.110+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f741c018070 con 0x7f7410004920 2024-05-09T00:18:49.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.112+0000 7f7422000640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f740c076350 0x7f740c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:49.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.112+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f741c0979b0 con 0x7f7410004920 2024-05-09T00:18:49.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.113+0000 7f7429400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f740c076350 0x7f740c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:49.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.115+0000 7f7429400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f740c076350 0x7f740c078860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f742c0cdbd0 tx=0x7f7418009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:49.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.126+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f741c060530 con 0x7f7410004920 2024-05-09T00:18:49.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.652+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f742c078350 con 0x7f7410004920 2024-05-09T00:18:49.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.654+0000 7f7422000640 1 -- 172.21.15.114:0/3597227009 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+4836 (secure 0 0 0) 0x7f741c064830 con 0x7f7410004920 2024-05-09T00:18:49.654 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:49.657 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:48.075529+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:49.657 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 60 2024-05-09T00:18:49.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.662+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f740c076350 msgr2=0x7f740c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:49.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.662+0000 7f7417400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f740c076350 0x7f740c078860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f742c0cdbd0 tx=0x7f7418009030 comp rx=0 tx=0).stop 2024-05-09T00:18:49.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.662+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7410004920 msgr2=0x7f742c1574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:49.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.662+0000 7f7417400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7410004920 0x7f742c1574d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f742c06a230 tx=0x7f741c00c900 comp rx=0 tx=0).stop 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.663+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 shutdown_connections 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.663+0000 7f7417400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f740c076350 0x7f740c078860 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.663+0000 7f7417400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f742c14dde0 0x7f742c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.663+0000 7f7417400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f742c157a10 0x7f742c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.663+0000 7f7417400640 1 --2- 172.21.15.114:0/3597227009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7410004920 0x7f742c1574d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.664+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 >> 172.21.15.114:0/3597227009 conn(0x7f742c0cd650 msgr2=0x7f742c0ad2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.664+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 shutdown_connections 2024-05-09T00:18:49.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:49.665+0000 7f7417400640 1 -- 172.21.15.114:0/3597227009 wait complete. 2024-05-09T00:18:49.720 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:18:49.912 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.478+0000 7efde8000640 1 Processor -- start 2024-05-09T00:18:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.480+0000 7efde8000640 1 -- start start 2024-05-09T00:18:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.485+0000 7efde8000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde0159dc0 0x7efde015c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.485+0000 7efde8000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 0x7efde00c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.485+0000 7efde8000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde015a1d0 con 0x7efde00c4300 2024-05-09T00:18:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.485+0000 7efde8000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efde00c4f20 con 0x7efde0159dc0 2024-05-09T00:18:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.485+0000 7efde8000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efde00c5680 con 0x7efde00c60f0 2024-05-09T00:18:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.486+0000 7efde6000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 0x7efde00c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.487+0000 7efde4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde0159dc0 0x7efde015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.487+0000 7efde6000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 0x7efde00c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45750/0 (socket says 172.21.15.114:45750) 2024-05-09T00:18:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.487+0000 7efde6000640 1 -- 172.21.15.114:0/3249354139 learned_addr learned my addr 172.21.15.114:0/3249354139 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:50.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.488+0000 7efde6000640 1 -- 172.21.15.114:0/3249354139 >> v2:172.21.15.114:3300/0 conn(0x7efde0159dc0 msgr2=0x7efde015c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:50.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.488+0000 7efde6000640 1 --2- 172.21.15.114:0/3249354139 >> v2:172.21.15.114:3300/0 conn(0x7efde0159dc0 0x7efde015c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:50.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.488+0000 7efde6000640 1 -- 172.21.15.114:0/3249354139 >> v1:172.21.15.114:6789/0 conn(0x7efde00c4300 legacy=0x7efde0072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.488+0000 7efde6000640 1 -- 172.21.15.114:0/3249354139 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde0160820 con 0x7efde00c60f0 2024-05-09T00:18:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.490+0000 7efde4c00640 1 --2- 172.21.15.114:0/3249354139 >> v2:172.21.15.114:3300/0 conn(0x7efde0159dc0 0x7efde015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.493+0000 7efde6000640 1 --2- 172.21.15.114:0/3249354139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 0x7efde00c6500 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009870 tx=0x7efdd402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da37907903011e4d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.495+0000 7efddfe00640 1 -- 172.21.15.114:0/3249354139 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4037070 con 0x7efde00c60f0 2024-05-09T00:18:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.495+0000 7efddfe00640 1 -- 172.21.15.114:0/3249354139 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd4032440 con 0x7efde00c60f0 2024-05-09T00:18:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.495+0000 7efddfe00640 1 -- 172.21.15.114:0/3249354139 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4032810 con 0x7efde00c60f0 2024-05-09T00:18:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.496+0000 7efde8000640 1 -- 172.21.15.114:0/3249354139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 msgr2=0x7efde00c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.496+0000 7efde8000640 1 --2- 172.21.15.114:0/3249354139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 0x7efde00c6500 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009870 tx=0x7efdd402a140 comp rx=0 tx=0).stop 2024-05-09T00:18:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.500+0000 7efde8000640 1 -- 172.21.15.114:0/3249354139 shutdown_connections 2024-05-09T00:18:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.500+0000 7efde8000640 1 --2- 172.21.15.114:0/3249354139 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde00c60f0 0x7efde00c6500 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:50.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.500+0000 7efde8000640 1 --2- 172.21.15.114:0/3249354139 >> v2:172.21.15.114:3300/0 conn(0x7efde0159dc0 0x7efde015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.500+0000 7efde8000640 1 -- 172.21.15.114:0/3249354139 >> 172.21.15.114:0/3249354139 conn(0x7efde006c680 msgr2=0x7efde006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.500+0000 7efde8000640 1 -- 172.21.15.114:0/3249354139 shutdown_connections 2024-05-09T00:18:50.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.500+0000 7efde8000640 1 -- 172.21.15.114:0/3249354139 wait complete. 2024-05-09T00:18:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.508+0000 7efde8000640 1 Processor -- start 2024-05-09T00:18:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.509+0000 7efde8000640 1 -- start start 2024-05-09T00:18:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.516+0000 7efde8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 0x7efde015f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:50.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.517+0000 7efde8000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 0x7efde015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.517+0000 7efde5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 0x7efde015f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.517+0000 7efde8000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde0159dc0 0x7efde0150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.518+0000 7efde5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 0x7efde015f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40364/0 (socket says 172.21.15.114:40364) 2024-05-09T00:18:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.518+0000 7efde4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 0x7efde015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.518+0000 7efde4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 0x7efde015db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44888/0 (socket says 172.21.15.114:44888) 2024-05-09T00:18:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.518+0000 7efde4c00640 1 -- 172.21.15.114:0/3990118717 learned_addr learned my addr 172.21.15.114:0/3990118717 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.522+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efde00c49c0 con 0x7efde00c4300 2024-05-09T00:18:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.522+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efde00c5170 con 0x7efde00c60f0 2024-05-09T00:18:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.523+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efde00c4b40 con 0x7efde0159dc0 2024-05-09T00:18:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.524+0000 7efde5600640 1 -- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde0159dc0 msgr2=0x7efde0150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.523+0000 7efde6000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde0159dc0 0x7efde0150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.527+0000 7efde5600640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde0159dc0 0x7efde0150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.528+0000 7efde5600640 1 -- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 msgr2=0x7efde015db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.528+0000 7efde5600640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 0x7efde015db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.528+0000 7efde5600640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde01f28e0 con 0x7efde00c4300 2024-05-09T00:18:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.529+0000 7efde4c00640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 0x7efde015db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.529+0000 7efde6000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde0159dc0 0x7efde0150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.530+0000 7efde5600640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 0x7efde015f760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c8a0 tx=0x7efdd800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.532+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8003b70 con 0x7efde00c4300 2024-05-09T00:18:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.532+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd8003d10 con 0x7efde00c4300 2024-05-09T00:18:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.532+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8005310 con 0x7efde00c4300 2024-05-09T00:18:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.534+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde01f2bc0 con 0x7efde00c4300 2024-05-09T00:18:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.534+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde01f3180 con 0x7efde00c4300 2024-05-09T00:18:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.537+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde0077430 con 0x7efde00c4300 2024-05-09T00:18:50.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.549+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efdd80054b0 con 0x7efde00c4300 2024-05-09T00:18:50.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.551+0000 7efddd600640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efdc0076350 0x7efdc0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:50.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.551+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7efdd8097990 con 0x7efde00c4300 2024-05-09T00:18:50.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.559+0000 7efde4c00640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efdc0076350 0x7efdc0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.560+0000 7efde4c00640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efdc0076350 0x7efdc0078860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0095e0 tx=0x7efdcc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:50.563+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efdd8060cf0 con 0x7efde00c4300 2024-05-09T00:18:51.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.125+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efde00c47a0 con 0x7efde00c4300 2024-05-09T00:18:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.128+0000 7efddd600640 1 -- 172.21.15.114:0/3990118717 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+4833 (secure 0 0 0) 0x7efdd80605f0 con 0x7efde00c4300 2024-05-09T00:18:51.130 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:51.130 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:49.629505+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:51.130 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 61 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efdc0076350 msgr2=0x7efdc0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efdc0076350 0x7efdc0078860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0095e0 tx=0x7efdcc009190 comp rx=0 tx=0).stop 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 msgr2=0x7efde015f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 0x7efde015f760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c8a0 tx=0x7efdd800cd60 comp rx=0 tx=0).stop 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 shutdown_connections 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efdc0076350 0x7efdc0078860 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde0159dc0 0x7efde0150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde00c60f0 0x7efde015db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:51.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 --2- 172.21.15.114:0/3990118717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efde00c4300 0x7efde015f760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:51.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 >> 172.21.15.114:0/3990118717 conn(0x7efde006c680 msgr2=0x7efde00c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:51.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 shutdown_connections 2024-05-09T00:18:51.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:51.139+0000 7efde8000640 1 -- 172.21.15.114:0/3990118717 wait complete. 2024-05-09T00:18:51.204 INFO:tasks.mds_thrash.fs.[a]:no change 2024-05-09T00:18:51.720 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.355+0000 7ffb1cc00640 1 Processor -- start 2024-05-09T00:18:52.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.356+0000 7ffb1cc00640 1 -- start start 2024-05-09T00:18:52.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.366+0000 7ffb1cc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffb100466c0 0x7ffb1000b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:52.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.371+0000 7ffb15e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ffb10007770 0x7ffb10006bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:48460/0 (socket says 172.21.15.114:48460) 2024-05-09T00:18:52.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.372+0000 7ffb15e00640 1 -- 172.21.15.114:0/697875195 learned_addr learned my addr 172.21.15.114:0/697875195 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:18:52.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/697875195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100d4070 0x7ffb100d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:52.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1000bab0 con 0x7ffb10007770 2024-05-09T00:18:52.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1000bd90 con 0x7ffb100466c0 2024-05-09T00:18:52.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffb100473c0 con 0x7ffb100d4070 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb15400640 1 --2- 172.21.15.114:0/697875195 >> v2:172.21.15.153:3300/0 conn(0x7ffb100466c0 0x7ffb1000b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb14a00640 1 -- 172.21.15.114:0/697875195 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586201490 0 0) 0x7ffb1000bab0 con 0x7ffb10007770 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb14a00640 1 -- 172.21.15.114:0/697875195 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffafc003520 con 0x7ffb10007770 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.376+0000 7ffb16800640 1 --2- 172.21.15.114:0/697875195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100d4070 0x7ffb100d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.377+0000 7ffb16800640 1 -- 172.21.15.114:0/697875195 >> v2:172.21.15.153:3300/0 conn(0x7ffb100466c0 msgr2=0x7ffb1000b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.377+0000 7ffb16800640 1 --2- 172.21.15.114:0/697875195 >> v2:172.21.15.153:3300/0 conn(0x7ffb100466c0 0x7ffb1000b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.377+0000 7ffb16800640 1 -- 172.21.15.114:0/697875195 >> v1:172.21.15.153:6789/0 conn(0x7ffb10007770 legacy=0x7ffb10006bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.377+0000 7ffb16800640 1 -- 172.21.15.114:0/697875195 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10047050 con 0x7ffb100d4070 2024-05-09T00:18:52.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.380+0000 7ffb16800640 1 --2- 172.21.15.114:0/697875195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100d4070 0x7ffb100d4480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb18066140 tx=0x7ffb180a7e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e527b6418fe555 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:52.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.380+0000 7ffb14a00640 1 -- 172.21.15.114:0/697875195 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb180b5070 con 0x7ffb100d4070 2024-05-09T00:18:52.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.380+0000 7ffb14a00640 1 -- 172.21.15.114:0/697875195 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb180a8a10 con 0x7ffb100d4070 2024-05-09T00:18:52.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.380+0000 7ffb14a00640 1 -- 172.21.15.114:0/697875195 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb180b0440 con 0x7ffb100d4070 2024-05-09T00:18:52.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.383+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100d4070 msgr2=0x7ffb100d4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:52.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.383+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/697875195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100d4070 0x7ffb100d4480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb18066140 tx=0x7ffb180a7e10 comp rx=0 tx=0).stop 2024-05-09T00:18:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.385+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 shutdown_connections 2024-05-09T00:18:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.385+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/697875195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100d4070 0x7ffb100d4480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.385+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/697875195 >> v2:172.21.15.153:3300/0 conn(0x7ffb100466c0 0x7ffb1000b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.385+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 >> 172.21.15.114:0/697875195 conn(0x7ffb100060b0 msgr2=0x7ffb100064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.385+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 shutdown_connections 2024-05-09T00:18:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.385+0000 7ffb1cc00640 1 -- 172.21.15.114:0/697875195 wait complete. 2024-05-09T00:18:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.396+0000 7ffb1cc00640 1 Processor -- start 2024-05-09T00:18:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.396+0000 7ffb1cc00640 1 -- start start 2024-05-09T00:18:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.401+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 0x7ffb10030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.401+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb100d4070 0x7ffb10170c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.401+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb101711b0 0x7ffb100ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.401+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100072e0 con 0x7ffb101711b0 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.401+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100d49c0 con 0x7ffb100d4070 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.401+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffb10007460 con 0x7ffb100466c0 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 0x7ffb10030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 0x7ffb10030440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:45780/0 (socket says 172.21.15.114:45780) 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 -- 172.21.15.114:0/2225361521 learned_addr learned my addr 172.21.15.114:0/2225361521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 -- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb100d4070 msgr2=0x7ffb10170c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb100d4070 0x7ffb10170c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 -- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb101711b0 msgr2=0x7ffb100ce770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb101711b0 0x7ffb100ce770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.402+0000 7ffb15e00640 1 -- 172.21.15.114:0/2225361521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10045290 con 0x7ffb100466c0 2024-05-09T00:18:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.404+0000 7ffb15e00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 0x7ffb10030440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400c440 tx=0x7ffb0400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.404+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04017070 con 0x7ffb100466c0 2024-05-09T00:18:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.404+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb04005da0 con 0x7ffb100466c0 2024-05-09T00:18:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.404+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb040072d0 con 0x7ffb100466c0 2024-05-09T00:18:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.407+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb10045570 con 0x7ffb100466c0 2024-05-09T00:18:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.407+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb10170750 con 0x7ffb100466c0 2024-05-09T00:18:52.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.409+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb10005e90 con 0x7ffb100466c0 2024-05-09T00:18:52.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.412+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb0401a070 con 0x7ffb100466c0 2024-05-09T00:18:52.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.414+0000 7ffb0e000640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffaf8076300 0x7ffaf8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:52.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.415+0000 7ffb15400640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffaf8076300 0x7ffaf8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:52.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.415+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7ffb040973b0 con 0x7ffb100466c0 2024-05-09T00:18:52.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.416+0000 7ffb15400640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffaf8076300 0x7ffaf8078810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffb100d1180 tx=0x7ffb08009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:52.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.422+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb0403a020 con 0x7ffb100466c0 2024-05-09T00:18:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.985+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb1000c5c0 con 0x7ffb100466c0 2024-05-09T00:18:52.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.987+0000 7ffb0e000640 1 -- 172.21.15.114:0/2225361521 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+4840 (secure 0 0 0) 0x7ffb0405ffa0 con 0x7ffb100466c0 2024-05-09T00:18:52.991 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:52.991 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:52.991 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 62 2024-05-09T00:18:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.995+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffaf8076300 msgr2=0x7ffaf8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.995+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffaf8076300 0x7ffaf8078810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffb100d1180 tx=0x7ffb08009190 comp rx=0 tx=0).stop 2024-05-09T00:18:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.995+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 msgr2=0x7ffb10030440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:52.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.995+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 0x7ffb10030440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400c440 tx=0x7ffb0400c900 comp rx=0 tx=0).stop 2024-05-09T00:18:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 shutdown_connections 2024-05-09T00:18:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ffaf8076300 0x7ffaf8078810 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb101711b0 0x7ffb100ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb100d4070 0x7ffb10170c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 --2- 172.21.15.114:0/2225361521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb100466c0 0x7ffb10030440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 >> 172.21.15.114:0/2225361521 conn(0x7ffb100060b0 msgr2=0x7ffb1002b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 shutdown_connections 2024-05-09T00:18:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:52.997+0000 7ffb1cc00640 1 -- 172.21.15.114:0/2225361521 wait complete. 2024-05-09T00:18:53.081 INFO:tasks.mds_thrash.fs.[b]:no change 2024-05-09T00:18:53.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.981+0000 7fa4e3c00640 1 Processor -- start 2024-05-09T00:18:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.981+0000 7fa4e3c00640 1 -- start start 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.985+0000 7fa4e3c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ae680 0x7fa4dc0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.985+0000 7fa4e3c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa4dc0c74a0 0x7fa4dc0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.985+0000 7fa4e3c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0aee90 con 0x7fa4dc159650 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.985+0000 7fa4e3c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa4dc0c6100 con 0x7fa4dc0c74a0 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.985+0000 7fa4e3c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc06f7a0 con 0x7fa4dc0ae680 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.986+0000 7fa4dbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa4dc0c74a0 0x7fa4dc0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:53.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.986+0000 7fa4dbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa4dc0c74a0 0x7fa4dc0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40378/0 (socket says 172.21.15.114:40378) 2024-05-09T00:18:53.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.986+0000 7fa4dbe00640 1 -- 172.21.15.114:0/2867465669 learned_addr learned my addr 172.21.15.114:0/2867465669 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:53.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.987+0000 7fa4e1200640 1 --2- 172.21.15.114:0/2867465669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ae680 0x7fa4dc0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:53.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.987+0000 7fa4dbe00640 1 -- 172.21.15.114:0/2867465669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ae680 msgr2=0x7fa4dc0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:53.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.987+0000 7fa4dbe00640 1 --2- 172.21.15.114:0/2867465669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ae680 0x7fa4dc0b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:53.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.987+0000 7fa4dbe00640 1 -- 172.21.15.114:0/2867465669 >> v1:172.21.15.114:6789/0 conn(0x7fa4dc159650 legacy=0x7fa4dc159a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:18:53.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.989+0000 7fa4dbe00640 1 -- 172.21.15.114:0/2867465669 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0aebb0 con 0x7fa4dc0c74a0 2024-05-09T00:18:53.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.991+0000 7fa4dbe00640 1 --2- 172.21.15.114:0/2867465669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0c74a0 0x7fa4dc0c78b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009e50 tx=0x7fa4d402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03a81dcc1611760 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:53.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.992+0000 7fa4db400640 1 -- 172.21.15.114:0/2867465669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4036070 con 0x7fa4dc0c74a0 2024-05-09T00:18:53.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.992+0000 7fa4db400640 1 -- 172.21.15.114:0/2867465669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d4031600 con 0x7fa4dc0c74a0 2024-05-09T00:18:53.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.992+0000 7fa4db400640 1 -- 172.21.15.114:0/2867465669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40319d0 con 0x7fa4dc0c74a0 2024-05-09T00:18:53.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.993+0000 7fa4e3c00640 1 -- 172.21.15.114:0/2867465669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0c74a0 msgr2=0x7fa4dc0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:53.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.993+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/2867465669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0c74a0 0x7fa4dc0c78b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009e50 tx=0x7fa4d402a5f0 comp rx=0 tx=0).stop 2024-05-09T00:18:53.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.994+0000 7fa4e3c00640 1 -- 172.21.15.114:0/2867465669 shutdown_connections 2024-05-09T00:18:53.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.994+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/2867465669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0c74a0 0x7fa4dc0c78b0 secure :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009e50 tx=0x7fa4d402a5f0 comp rx=0 tx=0).stop 2024-05-09T00:18:53.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.994+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/2867465669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ae680 0x7fa4dc0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:53.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.994+0000 7fa4e3c00640 1 -- 172.21.15.114:0/2867465669 >> 172.21.15.114:0/2867465669 conn(0x7fa4dc0cb7b0 msgr2=0x7fa4dc0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:53.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.995+0000 7fa4e3c00640 1 -- 172.21.15.114:0/2867465669 shutdown_connections 2024-05-09T00:18:53.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:53.995+0000 7fa4e3c00640 1 -- 172.21.15.114:0/2867465669 wait complete. 2024-05-09T00:18:54.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.000+0000 7fa4e3c00640 1 Processor -- start 2024-05-09T00:18:54.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.000+0000 7fa4e3c00640 1 -- start start 2024-05-09T00:18:54.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.003+0000 7fa4e3c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 0x7fa4dc144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:54.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.003+0000 7fa4e3c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4dc159650 0x7fa4dc0abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:54.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.003+0000 7fa4e3c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ac1a0 0x7fa4dc155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4e3c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc150560 con 0x7fa4dc0ae680 2024-05-09T00:18:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4e3c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc0c6680 con 0x7fa4dc159650 2024-05-09T00:18:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4e1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 0x7fa4dc144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4e1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 0x7fa4dc144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40384/0 (socket says 172.21.15.114:40384) 2024-05-09T00:18:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4e1200640 1 -- 172.21.15.114:0/802861825 learned_addr learned my addr 172.21.15.114:0/802861825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc0c6ba0 con 0x7fa4dc0ac1a0 2024-05-09T00:18:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.004+0000 7fa4dbe00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4dc159650 0x7fa4dc0abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.005+0000 7fa4e1c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ac1a0 0x7fa4dc155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:54.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.007+0000 7fa4e1200640 1 -- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ac1a0 msgr2=0x7fa4dc155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.007+0000 7fa4e1200640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ac1a0 0x7fa4dc155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.007+0000 7fa4e1200640 1 -- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4dc159650 msgr2=0x7fa4dc0abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.007+0000 7fa4e1200640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4dc159650 0x7fa4dc0abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.008+0000 7fa4e1200640 1 -- 172.21.15.114:0/802861825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc154020 con 0x7fa4dc0ae680 2024-05-09T00:18:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.008+0000 7fa4dbe00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4dc159650 0x7fa4dc0abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.008+0000 7fa4e1c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ac1a0 0x7fa4dc155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.009+0000 7fa4e1200640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 0x7fa4dc144160 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800e8a0 tx=0x7fa4c800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.010+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8017070 con 0x7fa4dc0ae680 2024-05-09T00:18:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.011+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c800c940 con 0x7fa4dc0ae680 2024-05-09T00:18:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.011+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc154300 con 0x7fa4dc0ae680 2024-05-09T00:18:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.011+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800cd30 con 0x7fa4dc0ae680 2024-05-09T00:18:54.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.014+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc0adf70 con 0x7fa4dc0ae680 2024-05-09T00:18:54.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.019+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc077430 con 0x7fa4dc0ae680 2024-05-09T00:18:54.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.019+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa4c801a070 con 0x7fa4dc0ae680 2024-05-09T00:18:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.021+0000 7fa4d8c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa4bc076300 0x7fa4bc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.021+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fa4c8097fa0 con 0x7fa4dc0ae680 2024-05-09T00:18:54.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.028+0000 7fa4dbe00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa4bc076300 0x7fa4bc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:54.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.034+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4c8060aa0 con 0x7fa4dc0ae680 2024-05-09T00:18:54.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.035+0000 7fa4dbe00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa4bc076300 0x7fa4bc078810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4033000 tx=0x7fa4d4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.570+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4dc0cb280 con 0x7fa4dc0ae680 2024-05-09T00:18:54.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.572+0000 7fa4d8c00640 1 -- 172.21.15.114:0/802861825 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+4840 (secure 0 0 0) 0x7fa4c8064da0 con 0x7fa4dc0ae680 2024-05-09T00:18:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:54.577 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:35.026289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:54.577 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 62 2024-05-09T00:18:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.584+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa4bc076300 msgr2=0x7fa4bc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.584+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa4bc076300 0x7fa4bc078810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4033000 tx=0x7fa4d4009000 comp rx=0 tx=0).stop 2024-05-09T00:18:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.584+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 msgr2=0x7fa4dc144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.584+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 0x7fa4dc144160 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800e8a0 tx=0x7fa4c800ed60 comp rx=0 tx=0).stop 2024-05-09T00:18:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.585+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 shutdown_connections 2024-05-09T00:18:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fa4bc076300 0x7fa4bc078810 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4dc0ac1a0 0x7fa4dc155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4dc159650 0x7fa4dc0abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 --2- 172.21.15.114:0/802861825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4dc0ae680 0x7fa4dc144160 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 >> 172.21.15.114:0/802861825 conn(0x7fa4dc0cb7b0 msgr2=0x7fa4dc158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 shutdown_connections 2024-05-09T00:18:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:54.586+0000 7fa4e3c00640 1 -- 172.21.15.114:0/802861825 wait complete. 2024-05-09T00:18:54.642 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=5017 2024-05-09T00:18:54.642 INFO:tasks.mds_thrash.fs.[a]:waiting for 9 secs before reviving mds.d 2024-05-09T00:18:55.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:55.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.743+0000 7fca3f600640 1 Processor -- start 2024-05-09T00:18:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.744+0000 7fca3f600640 1 -- start start 2024-05-09T00:18:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.747+0000 7fca3f600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca3808db70 0x7fca381621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.747+0000 7fca3f600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fca380c6030 0x7fca380c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.747+0000 7fca3f600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca38168e90 con 0x7fca38168370 2024-05-09T00:18:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.747+0000 7fca3f600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fca38165d80 con 0x7fca3808db70 2024-05-09T00:18:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.747+0000 7fca3f600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fca380c5de0 con 0x7fca380c6030 2024-05-09T00:18:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.747+0000 7fca3cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca3808db70 0x7fca381621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:55.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.748+0000 7fca3cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca3808db70 0x7fca381621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40386/0 (socket says 172.21.15.114:40386) 2024-05-09T00:18:55.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.748+0000 7fca3cc00640 1 -- 172.21.15.114:0/3724904679 learned_addr learned my addr 172.21.15.114:0/3724904679 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:55.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.748+0000 7fca37e00640 1 --2- 172.21.15.114:0/3724904679 >> v2:172.21.15.153:3300/0 conn(0x7fca380c6030 0x7fca380c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:55.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.751+0000 7fca3cc00640 1 -- 172.21.15.114:0/3724904679 >> v2:172.21.15.153:3300/0 conn(0x7fca380c6030 msgr2=0x7fca380c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:55.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.751+0000 7fca3cc00640 1 --2- 172.21.15.114:0/3724904679 >> v2:172.21.15.153:3300/0 conn(0x7fca380c6030 0x7fca380c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:55.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.751+0000 7fca3cc00640 1 -- 172.21.15.114:0/3724904679 >> v1:172.21.15.153:6789/0 conn(0x7fca38168370 legacy=0x7fca38168780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:18:55.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.752+0000 7fca3cc00640 1 -- 172.21.15.114:0/3724904679 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca38072d30 con 0x7fca3808db70 2024-05-09T00:18:55.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.755+0000 7fca37e00640 1 --2- 172.21.15.114:0/3724904679 >> v2:172.21.15.153:3300/0 conn(0x7fca380c6030 0x7fca380c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:55.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.766+0000 7fca3cc00640 1 --2- 172.21.15.114:0/3724904679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca381621f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fca380c3cb0 tx=0x7fca2c02c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fd1f852a4cd9d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:55.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.778+0000 7fca37400640 1 -- 172.21.15.114:0/3724904679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03a070 con 0x7fca3808db70 2024-05-09T00:18:55.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.778+0000 7fca37400640 1 -- 172.21.15.114:0/3724904679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c032480 con 0x7fca3808db70 2024-05-09T00:18:55.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.778+0000 7fca37400640 1 -- 172.21.15.114:0/3724904679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c032890 con 0x7fca3808db70 2024-05-09T00:18:55.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.780+0000 7fca3f600640 1 -- 172.21.15.114:0/3724904679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 msgr2=0x7fca381621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:55.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.780+0000 7fca3f600640 1 --2- 172.21.15.114:0/3724904679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca381621f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fca380c3cb0 tx=0x7fca2c02c660 comp rx=0 tx=0).stop 2024-05-09T00:18:55.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.780+0000 7fca3f600640 1 -- 172.21.15.114:0/3724904679 shutdown_connections 2024-05-09T00:18:55.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.780+0000 7fca3f600640 1 --2- 172.21.15.114:0/3724904679 >> v2:172.21.15.153:3300/0 conn(0x7fca380c6030 0x7fca380c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:55.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.780+0000 7fca3f600640 1 --2- 172.21.15.114:0/3724904679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca381621f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:55.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.780+0000 7fca3f600640 1 -- 172.21.15.114:0/3724904679 >> 172.21.15.114:0/3724904679 conn(0x7fca380c95f0 msgr2=0x7fca380c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:55.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.781+0000 7fca3f600640 1 -- 172.21.15.114:0/3724904679 shutdown_connections 2024-05-09T00:18:55.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.781+0000 7fca3f600640 1 -- 172.21.15.114:0/3724904679 wait complete. 2024-05-09T00:18:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.792+0000 7fca3f600640 1 Processor -- start 2024-05-09T00:18:55.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.793+0000 7fca3f600640 1 -- start start 2024-05-09T00:18:55.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.802+0000 7fca3f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca38202520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.804+0000 7fca3f600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca380c6030 0x7fca38164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.805+0000 7fca3f600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca38168370 0x7fca3820bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:55.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.807+0000 7fca3f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fca38162730 con 0x7fca3808db70 2024-05-09T00:18:55.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.807+0000 7fca37e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca380c6030 0x7fca38164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:55.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.808+0000 7fca3f600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca38165860 con 0x7fca380c6030 2024-05-09T00:18:55.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.808+0000 7fca3f600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fca3820ff80 con 0x7fca38168370 2024-05-09T00:18:55.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.808+0000 7fca3cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca38202520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:55.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.809+0000 7fca3cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca38202520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40394/0 (socket says 172.21.15.114:40394) 2024-05-09T00:18:55.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.809+0000 7fca3cc00640 1 -- 172.21.15.114:0/3313797715 learned_addr learned my addr 172.21.15.114:0/3313797715 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:55.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.811+0000 7fca3cc00640 1 -- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca38168370 msgr2=0x7fca3820bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:55.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.808+0000 7fca3e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca38168370 0x7fca3820bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:55.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.812+0000 7fca3cc00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca38168370 0x7fca3820bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:55.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.812+0000 7fca3cc00640 1 -- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca380c6030 msgr2=0x7fca38164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:55.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.812+0000 7fca3cc00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca380c6030 0x7fca38164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:55.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.813+0000 7fca3cc00640 1 -- 172.21.15.114:0/3313797715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3820fa00 con 0x7fca3808db70 2024-05-09T00:18:55.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.813+0000 7fca3e000640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca38168370 0x7fca3820bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:55.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.814+0000 7fca37e00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca380c6030 0x7fca38164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:55.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.816+0000 7fca3cc00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca38202520 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fca2c008960 tx=0x7fca2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:55.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.818+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c045070 con 0x7fca3808db70 2024-05-09T00:18:55.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.818+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c00b0b0 con 0x7fca3808db70 2024-05-09T00:18:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.822+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03a070 con 0x7fca3808db70 2024-05-09T00:18:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.826+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3820fca0 con 0x7fca3808db70 2024-05-09T00:18:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.826+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca380acfa0 con 0x7fca3808db70 2024-05-09T00:18:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.827+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca38077430 con 0x7fca3808db70 2024-05-09T00:18:55.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.836+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca2c048070 con 0x7fca3808db70 2024-05-09T00:18:55.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.838+0000 7fca34c00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fca18076320 0x7fca18078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:55.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.838+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fca2c0b8280 con 0x7fca3808db70 2024-05-09T00:18:55.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.844+0000 7fca37e00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fca18076320 0x7fca18078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:55.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.845+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca3820fa00 con 0x7fca3808db70 2024-05-09T00:18:55.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:55.846+0000 7fca37e00640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fca18076320 0x7fca18078830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca24006fd0 tx=0x7fca24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:56.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.409+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca380c4300 con 0x7fca3808db70 2024-05-09T00:18:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:54.771164+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:reconnect","state_seq":77,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:18:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.415+0000 7fca34c00640 1 -- 172.21.15.114:0/3313797715 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+4844 (secure 0 0 0) 0x7fca2c080f90 con 0x7fca3808db70 2024-05-09T00:18:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2024-05-09T00:18:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.422+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fca18076320 msgr2=0x7fca18078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:56.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.423+0000 7fca3f600640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fca18076320 0x7fca18078830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca24006fd0 tx=0x7fca24008040 comp rx=0 tx=0).stop 2024-05-09T00:18:56.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.425+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 msgr2=0x7fca38202520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:56.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.425+0000 7fca3f600640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca38202520 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fca2c008960 tx=0x7fca2c0046c0 comp rx=0 tx=0).stop 2024-05-09T00:18:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 shutdown_connections 2024-05-09T00:18:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fca18076320 0x7fca18078830 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca38168370 0x7fca3820bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca380c6030 0x7fca38164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 --2- 172.21.15.114:0/3313797715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca3808db70 0x7fca38202520 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 >> 172.21.15.114:0/3313797715 conn(0x7fca380c95f0 msgr2=0x7fca3815e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.426+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 shutdown_connections 2024-05-09T00:18:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:56.427+0000 7fca3f600640 1 -- 172.21.15.114:0/3313797715 wait complete. 2024-05-09T00:18:56.490 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 63, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:44.610847+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 62, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5406": { "addr": "172.21.15.114:6837/2437507270", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2437507270, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2437507270, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5406, "incarnation": 58, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 20 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T00:18:52.267982+0000", "qdb_cluster": [ 5406 ], "qdb_leader": 5406, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5406 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T00:08:54.746296+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 63, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4616": { "addr": "172.21.15.153:6833/1507999433", "addrs": { "addrvec": [ { "addr": "172.21.15.153:6832", "nonce": 1507999433, "type": "v2" }, { "addr": "172.21.15.153:6833", "nonce": 1507999433, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4616, "incarnation": 59, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:reconnect", "state_seq": 77 } }, "last_failure": 0, "last_failure_osd_epoch": 38, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T00:18:54.771164+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4616 } } } ], "standbys": [] } 2024-05-09T00:18:56.669 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-05-09T00:18:56.669+0000 7ff2d0600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:18:58.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.036+0000 7f9d39400640 1 Processor -- start 2024-05-09T00:18:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.037+0000 7f9d39400640 1 -- start start 2024-05-09T00:18:59.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.044+0000 7f9d39400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9d340af570 0x7f9d34154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:59.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.044+0000 7f9d39400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c5bb0 0x7f9d340c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.044+0000 7f9d39400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d340748f0 con 0x7f9d340c6630 2024-05-09T00:18:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.045+0000 7f9d32800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9d340af570 0x7f9d34154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.046+0000 7f9d39400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9d341553e0 con 0x7f9d340af570 2024-05-09T00:18:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.046+0000 7f9d39400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9d34154420 con 0x7f9d340c5bb0 2024-05-09T00:18:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.046+0000 7f9d32800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9d340af570 0x7f9d34154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44418/0 (socket says 172.21.15.114:44418) 2024-05-09T00:18:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.046+0000 7f9d32800640 1 -- 172.21.15.114:0/2521284861 learned_addr learned my addr 172.21.15.114:0/2521284861 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.045+0000 7f9d31e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c5bb0 0x7f9d340c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.046+0000 7f9d33200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9d340c6630 0x7f9d34157d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:45056/0 (socket says 172.21.15.114:45056) 2024-05-09T00:18:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.048+0000 7f9d32800640 1 -- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c5bb0 msgr2=0x7f9d340c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:18:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.048+0000 7f9d32800640 1 --2- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c5bb0 0x7f9d340c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.048+0000 7f9d32800640 1 -- 172.21.15.114:0/2521284861 >> v1:172.21.15.153:6789/0 conn(0x7f9d340c6630 legacy=0x7f9d34157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.048+0000 7f9d32800640 1 -- 172.21.15.114:0/2521284861 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d34073430 con 0x7f9d340af570 2024-05-09T00:18:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.056+0000 7f9d32800640 1 --2- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340af570 0x7f9d34154ea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009870 tx=0x7f9d2402a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72c785bb475ae45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.059+0000 7f9d31400640 1 -- 172.21.15.114:0/2521284861 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24037070 con 0x7f9d340af570 2024-05-09T00:18:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.062+0000 7f9d31400640 1 -- 172.21.15.114:0/2521284861 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24032440 con 0x7f9d340af570 2024-05-09T00:18:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.062+0000 7f9d31400640 1 -- 172.21.15.114:0/2521284861 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24032850 con 0x7f9d340af570 2024-05-09T00:18:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.063+0000 7f9d39400640 1 -- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340af570 msgr2=0x7f9d34154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.063+0000 7f9d39400640 1 --2- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340af570 0x7f9d34154ea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009870 tx=0x7f9d2402a160 comp rx=0 tx=0).stop 2024-05-09T00:18:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.066+0000 7f9d39400640 1 -- 172.21.15.114:0/2521284861 shutdown_connections 2024-05-09T00:18:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.066+0000 7f9d39400640 1 --2- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c5bb0 0x7f9d340c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.066+0000 7f9d39400640 1 --2- 172.21.15.114:0/2521284861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340af570 0x7f9d34154ea0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.066+0000 7f9d39400640 1 -- 172.21.15.114:0/2521284861 >> 172.21.15.114:0/2521284861 conn(0x7f9d3406c680 msgr2=0x7f9d3406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.066+0000 7f9d39400640 1 -- 172.21.15.114:0/2521284861 shutdown_connections 2024-05-09T00:18:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.066+0000 7f9d39400640 1 -- 172.21.15.114:0/2521284861 wait complete. 2024-05-09T00:18:59.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.084+0000 7f9d39400640 1 Processor -- start 2024-05-09T00:18:59.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.085+0000 7f9d39400640 1 -- start start 2024-05-09T00:18:59.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.095+0000 7f9d39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d340af570 0x7f9d341edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:59.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.097+0000 7f9d39400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 0x7f9d341ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:59.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.097+0000 7f9d39400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c6630 0x7f9d340adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:59.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.098+0000 7f9d31e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 0x7f9d341ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:59.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.098+0000 7f9d32800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d340af570 0x7f9d341edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:59.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.099+0000 7f9d31e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 0x7f9d341ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44434/0 (socket says 172.21.15.114:44434) 2024-05-09T00:18:59.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.099+0000 7f9d39400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9d34073130 con 0x7f9d340af570 2024-05-09T00:18:59.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.099+0000 7f9d31e00640 1 -- 172.21.15.114:0/397953089 learned_addr learned my addr 172.21.15.114:0/397953089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:18:59.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.099+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9d340c4fe0 con 0x7f9d340c5bb0 2024-05-09T00:18:59.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.099+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9d34073710 con 0x7f9d340c6630 2024-05-09T00:18:59.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.099+0000 7f9d33200640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c6630 0x7f9d340adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.103+0000 7f9d32800640 1 -- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c6630 msgr2=0x7f9d340adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.104+0000 7f9d32800640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c6630 0x7f9d340adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.104+0000 7f9d32800640 1 -- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 msgr2=0x7f9d341ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.104+0000 7f9d32800640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 0x7f9d341ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.105+0000 7f9d32800640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d341ee020 con 0x7f9d340af570 2024-05-09T00:18:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.105+0000 7f9d33200640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c6630 0x7f9d340adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.107+0000 7f9d31e00640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 0x7f9d341ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:18:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.108+0000 7f9d32800640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d340af570 0x7f9d341edae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9d24031000 tx=0x7f9d240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.109+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24041020 con 0x7f9d340af570 2024-05-09T00:18:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.109+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24030990 con 0x7f9d340af570 2024-05-09T00:18:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.109+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d340c9880 con 0x7f9d340af570 2024-05-09T00:18:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.110+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d341e9d20 con 0x7f9d340af570 2024-05-09T00:18:59.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.110+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24037040 con 0x7f9d340af570 2024-05-09T00:18:59.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.114+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c005290 con 0x7f9d340af570 2024-05-09T00:18:59.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.125+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d24044020 con 0x7f9d340af570 2024-05-09T00:18:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.128+0000 7f9d2aa00640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9d140763a0 0x7f9d140788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:18:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.128+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f9d240b88b0 con 0x7f9d340af570 2024-05-09T00:18:59.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.130+0000 7f9d31e00640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9d140763a0 0x7f9d140788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.133+0000 7f9d31e00640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9d140763a0 0x7f9d140788b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d34150b70 tx=0x7f9d2000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:59.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.136+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9d24081460 con 0x7f9d340af570 2024-05-09T00:18:59.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.730+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d0c005580 con 0x7f9d340af570 2024-05-09T00:18:59.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.731+0000 7f9d2aa00640 1 -- 172.21.15.114:0/397953089 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+4848 (secure 0 0 0) 0x7f9d24085760 con 0x7f9d340af570 2024-05-09T00:18:59.731 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:18:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:18:59.732 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 65 2024-05-09T00:18:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9d140763a0 msgr2=0x7f9d140788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9d140763a0 0x7f9d140788b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d34150b70 tx=0x7f9d2000d040 comp rx=0 tx=0).stop 2024-05-09T00:18:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d340af570 msgr2=0x7f9d341edae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d340af570 0x7f9d341edae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9d24031000 tx=0x7f9d240046c0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 shutdown_connections 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f9d140763a0 0x7f9d140788b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d340c6630 0x7f9d340adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d340c5bb0 0x7f9d341ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 --2- 172.21.15.114:0/397953089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d340af570 0x7f9d341edae0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 >> 172.21.15.114:0/397953089 conn(0x7f9d3406c680 msgr2=0x7f9d340c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 shutdown_connections 2024-05-09T00:18:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:18:59.738+0000 7f9d39400640 1 -- 172.21.15.114:0/397953089 wait complete. 2024-05-09T00:18:59.790 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=5334 2024-05-09T00:18:59.790 INFO:tasks.mds_thrash.fs.[b]:waiting for 6 secs before reviving mds.c 2024-05-09T00:19:01.815 INFO:tasks.ceph.mds.b.smithi153.stderr:2024-05-09T00:19:01.816+0000 7f0b15600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:19:03.643 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-05-09T00:19:03.643 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T00:19:03.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T00:19:03.653 INFO:tasks.ceph.mds.d:Started 2024-05-09T00:19:03.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:19:04.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.151+0000 7f7d3f200640 1 Processor -- start 2024-05-09T00:19:04.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.152+0000 7f7d3f200640 1 -- start start 2024-05-09T00:19:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.154+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d400c5370 0x7f7d40153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.155+0000 7f7d3f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d4006f0d0 0x7f7d4006fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:04.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.155+0000 7f7d3e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d4006f0d0 0x7f7d4006fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d4006f0d0 0x7f7d4006fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35830/0 (socket says 172.21.15.114:35830) 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d400c5370 0x7f7d40153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d400c5370 0x7f7d40153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:44494/0 (socket says 172.21.15.114:44494) 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3d400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7d4015d030 0x7f7d40072110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:45068/0 (socket says 172.21.15.114:45068) 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3e800640 1 -- 172.21.15.114:0/871022606 learned_addr learned my addr 172.21.15.114:0/871022606 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d400c5950 con 0x7f7d4015d030 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4015d440 con 0x7f7d4006f0d0 2024-05-09T00:19:04.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.156+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d40072820 con 0x7f7d400c5370 2024-05-09T00:19:04.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.157+0000 7f7d3ca00640 1 -- 172.21.15.114:0/871022606 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204461199 0 0) 0x7f7d400c5950 con 0x7f7d4015d030 2024-05-09T00:19:04.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.157+0000 7f7d3e800640 1 -- 172.21.15.114:0/871022606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d400c5370 msgr2=0x7f7d40153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:19:04.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.157+0000 7f7d3e800640 1 --2- 172.21.15.114:0/871022606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d400c5370 0x7f7d40153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.157+0000 7f7d3e800640 1 -- 172.21.15.114:0/871022606 >> v1:172.21.15.153:6789/0 conn(0x7f7d4015d030 legacy=0x7f7d40072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:04.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.157+0000 7f7d3e800640 1 -- 172.21.15.114:0/871022606 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4006e350 con 0x7f7d4006f0d0 2024-05-09T00:19:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.159+0000 7f7d3e800640 1 --2- 172.21.15.114:0/871022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d4006f0d0 0x7f7d4006fbf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800b1a0 tx=0x7f7d3802a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd49f1ba314fc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.161+0000 7f7d3ca00640 1 -- 172.21.15.114:0/871022606 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380303f0 con 0x7f7d4006f0d0 2024-05-09T00:19:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.161+0000 7f7d3ca00640 1 -- 172.21.15.114:0/871022606 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d38035070 con 0x7f7d4006f0d0 2024-05-09T00:19:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.161+0000 7f7d3ca00640 1 -- 172.21.15.114:0/871022606 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380307b0 con 0x7f7d4006f0d0 2024-05-09T00:19:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.163+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d4006f0d0 msgr2=0x7f7d4006fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.163+0000 7f7d3f200640 1 --2- 172.21.15.114:0/871022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d4006f0d0 0x7f7d4006fbf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800b1a0 tx=0x7f7d3802a900 comp rx=0 tx=0).stop 2024-05-09T00:19:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.164+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 shutdown_connections 2024-05-09T00:19:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.164+0000 7f7d3f200640 1 --2- 172.21.15.114:0/871022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d4006f0d0 0x7f7d4006fbf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.164+0000 7f7d3f200640 1 --2- 172.21.15.114:0/871022606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d400c5370 0x7f7d40153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.164+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 >> 172.21.15.114:0/871022606 conn(0x7f7d400c5ea0 msgr2=0x7f7d400c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:19:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.167+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 shutdown_connections 2024-05-09T00:19:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.167+0000 7f7d3f200640 1 -- 172.21.15.114:0/871022606 wait complete. 2024-05-09T00:19:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.173+0000 7f7d3f200640 1 Processor -- start 2024-05-09T00:19:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.173+0000 7f7d3f200640 1 -- start start 2024-05-09T00:19:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.176+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4006f0d0 0x7f7d4015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.176+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d400c5370 0x7f7d401fe500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.176+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d4015d030 0x7f7d401f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.176+0000 7f7d3f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4006e5f0 con 0x7f7d400c5370 2024-05-09T00:19:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.176+0000 7f7d3f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4006ec40 con 0x7f7d4006f0d0 2024-05-09T00:19:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.176+0000 7f7d3f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4006e8d0 con 0x7f7d4015d030 2024-05-09T00:19:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.178+0000 7f7d3e800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d4015d030 0x7f7d401f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.178+0000 7f7d3de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4006f0d0 0x7f7d4015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.178+0000 7f7d3de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4006f0d0 0x7f7d4015edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44448/0 (socket says 172.21.15.114:44448) 2024-05-09T00:19:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.178+0000 7f7d3de00640 1 -- 172.21.15.114:0/2817832598 learned_addr learned my addr 172.21.15.114:0/2817832598 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:19:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.178+0000 7f7d3d400640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d400c5370 0x7f7d401fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.180+0000 7f7d3d400640 1 -- 172.21.15.114:0/2817832598 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d4015d030 msgr2=0x7f7d401f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.180+0000 7f7d3d400640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d4015d030 0x7f7d401f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.180+0000 7f7d3d400640 1 -- 172.21.15.114:0/2817832598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4006f0d0 msgr2=0x7f7d4015edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.180+0000 7f7d3d400640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4006f0d0 0x7f7d4015edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.180+0000 7f7d3d400640 1 -- 172.21.15.114:0/2817832598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4015e310 con 0x7f7d400c5370 2024-05-09T00:19:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.181+0000 7f7d3d400640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d400c5370 0x7f7d401fe500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d400ac050 tx=0x7f7d2c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.181+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0074e0 con 0x7f7d400c5370 2024-05-09T00:19:04.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.182+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d401feed0 con 0x7f7d400c5370 2024-05-09T00:19:04.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.182+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4015e890 con 0x7f7d400c5370 2024-05-09T00:19:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.189+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0047e0 con 0x7f7d400c5370 2024-05-09T00:19:04.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.189+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0074e0 con 0x7f7d400c5370 2024-05-09T00:19:04.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.191+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d18005290 con 0x7f7d400c5370 2024-05-09T00:19:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.192+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d2c011070 con 0x7f7d400c5370 2024-05-09T00:19:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.194+0000 7f7d36000640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7d20076500 0x7f7d20078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:04.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.197+0000 7f7d3de00640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7d20076500 0x7f7d20078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.202+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f7d2c05c4f0 con 0x7f7d400c5370 2024-05-09T00:19:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.206+0000 7f7d3de00640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7d20076500 0x7f7d20078a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006e80 tx=0x7f7d30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:04.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.215+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d2c060600 con 0x7f7d400c5370 2024-05-09T00:19:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.714+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d18005850 con 0x7f7d400c5370 2024-05-09T00:19:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.716+0000 7f7d36000640 1 -- 172.21.15.114:0/2817832598 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+4848 (secure 0 0 0) 0x7f7d2c05ff00 con 0x7f7d400c5370 2024-05-09T00:19:04.715 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:19:04.715 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:19:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 65 2024-05-09T00:19:04.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7d20076500 msgr2=0x7f7d20078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7d20076500 0x7f7d20078a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006e80 tx=0x7f7d30008040 comp rx=0 tx=0).stop 2024-05-09T00:19:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d400c5370 msgr2=0x7f7d401fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d400c5370 0x7f7d401fe500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d400ac050 tx=0x7f7d2c00c820 comp rx=0 tx=0).stop 2024-05-09T00:19:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 shutdown_connections 2024-05-09T00:19:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7d20076500 0x7f7d20078a10 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006e80 tx=0x7f7d30008040 comp rx=0 tx=0).stop 2024-05-09T00:19:04.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d4015d030 0x7f7d401f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d400c5370 0x7f7d401fe500 secure :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d400ac050 tx=0x7f7d2c00c820 comp rx=0 tx=0).stop 2024-05-09T00:19:04.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 --2- 172.21.15.114:0/2817832598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4006f0d0 0x7f7d4015edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:04.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.723+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 >> 172.21.15.114:0/2817832598 conn(0x7f7d400c5ea0 msgr2=0x7f7d40150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:19:04.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.724+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 shutdown_connections 2024-05-09T00:19:04.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:04.724+0000 7f7d3f200640 1 -- 172.21.15.114:0/2817832598 wait complete. 2024-05-09T00:19:04.791 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-09T00:19:05.666 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-09T00:19:05.791 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-05-09T00:19:05.792 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T00:19:05.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T00:19:05.805 INFO:tasks.ceph.mds.c:Started 2024-05-09T00:19:05.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:19:06.385 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-05-09T00:19:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.419+0000 7f1564400640 1 Processor -- start 2024-05-09T00:19:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.419+0000 7f1564400640 1 -- start start 2024-05-09T00:19:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.421+0000 7f1564400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15540df9a0 0x7f155403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.421+0000 7f1564400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1554006f90 0x7f15540e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.422+0000 7f1564400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155400bf30 con 0x7f155403f0e0 2024-05-09T00:19:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.422+0000 7f1564400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f155404ba50 con 0x7f15540df9a0 2024-05-09T00:19:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.422+0000 7f1564400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f15540dfe60 con 0x7f1554006f90 2024-05-09T00:19:06.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.424+0000 7f1561000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f155403f0e0 0x7f1554047be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47594/0 (socket says 172.21.15.114:47594) 2024-05-09T00:19:06.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.424+0000 7f1561000640 1 -- 172.21.15.114:0/3661386927 learned_addr learned my addr 172.21.15.114:0/3661386927 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:19:06.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.431+0000 7f1561a00640 1 --2- 172.21.15.114:0/3661386927 >> v2:172.21.15.153:3300/0 conn(0x7f15540df9a0 0x7f155403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:06.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.431+0000 7f1562e00640 1 --2- 172.21.15.114:0/3661386927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1554006f90 0x7f15540e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:06.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.432+0000 7f1562e00640 1 -- 172.21.15.114:0/3661386927 >> v2:172.21.15.153:3300/0 conn(0x7f15540df9a0 msgr2=0x7f155403eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:19:06.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.432+0000 7f1562e00640 1 --2- 172.21.15.114:0/3661386927 >> v2:172.21.15.153:3300/0 conn(0x7f15540df9a0 0x7f155403eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:06.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.432+0000 7f1562e00640 1 -- 172.21.15.114:0/3661386927 >> v1:172.21.15.114:6789/0 conn(0x7f155403f0e0 legacy=0x7f1554047be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:06.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.432+0000 7f1562e00640 1 -- 172.21.15.114:0/3661386927 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155404b490 con 0x7f1554006f90 2024-05-09T00:19:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.440+0000 7f1562e00640 1 --2- 172.21.15.114:0/3661386927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1554006f90 0x7f15540e97c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15500097a0 tx=0x7f155002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7342706bd0bd81b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:06.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.440+0000 7f155be00640 1 -- 172.21.15.114:0/3661386927 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550037070 con 0x7f1554006f90 2024-05-09T00:19:06.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.441+0000 7f155be00640 1 -- 172.21.15.114:0/3661386927 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550032440 con 0x7f1554006f90 2024-05-09T00:19:06.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.441+0000 7f155be00640 1 -- 172.21.15.114:0/3661386927 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155002ae60 con 0x7f1554006f90 2024-05-09T00:19:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.449+0000 7f1564400640 1 -- 172.21.15.114:0/3661386927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1554006f90 msgr2=0x7f15540e97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.449+0000 7f1564400640 1 --2- 172.21.15.114:0/3661386927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1554006f90 0x7f15540e97c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15500097a0 tx=0x7f155002a110 comp rx=0 tx=0).stop 2024-05-09T00:19:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.450+0000 7f1564400640 1 -- 172.21.15.114:0/3661386927 shutdown_connections 2024-05-09T00:19:06.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.450+0000 7f1564400640 1 --2- 172.21.15.114:0/3661386927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1554006f90 0x7f15540e97c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:06.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.450+0000 7f1564400640 1 --2- 172.21.15.114:0/3661386927 >> v2:172.21.15.153:3300/0 conn(0x7f15540df9a0 0x7f155403eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:06.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.450+0000 7f1564400640 1 -- 172.21.15.114:0/3661386927 >> 172.21.15.114:0/3661386927 conn(0x7f1554006260 msgr2=0x7f1554006670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:19:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.454+0000 7f1564400640 1 -- 172.21.15.114:0/3661386927 shutdown_connections 2024-05-09T00:19:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.455+0000 7f1564400640 1 -- 172.21.15.114:0/3661386927 wait complete. 2024-05-09T00:19:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.466+0000 7f1564400640 1 Processor -- start 2024-05-09T00:19:06.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.468+0000 7f1564400640 1 -- start start 2024-05-09T00:19:06.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.474+0000 7f1564400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 0x7f15540de230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:06.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.474+0000 7f1564400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155403f0e0 0x7f1554174c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.475+0000 7f1564400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15540d3180 0x7f15540d3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.475+0000 7f1561a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 0x7f15540de230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.475+0000 7f1561a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 0x7f15540de230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35866/0 (socket says 172.21.15.114:35866) 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.475+0000 7f1561000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155403f0e0 0x7f1554174c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.475+0000 7f1561000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155403f0e0 0x7f1554174c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44470/0 (socket says 172.21.15.114:44470) 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.475+0000 7f1561000640 1 -- 172.21.15.114:0/2839913486 learned_addr learned my addr 172.21.15.114:0/2839913486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:19:06.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.476+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f15540482f0 con 0x7f1554006f90 2024-05-09T00:19:06.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.476+0000 7f1562e00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15540d3180 0x7f15540d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:06.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.476+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1554049ad0 con 0x7f155403f0e0 2024-05-09T00:19:06.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.476+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1554048470 con 0x7f15540d3180 2024-05-09T00:19:06.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.477+0000 7f1562e00640 1 -- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155403f0e0 msgr2=0x7f1554174c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:06.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.477+0000 7f1562e00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155403f0e0 0x7f1554174c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:06.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.477+0000 7f1562e00640 1 -- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 msgr2=0x7f15540de230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:06.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.477+0000 7f1562e00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 0x7f15540de230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:06.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.477+0000 7f1562e00640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15540e1150 con 0x7f15540d3180 2024-05-09T00:19:06.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.478+0000 7f1561a00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 0x7f15540de230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:19:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.478+0000 7f1562e00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15540d3180 0x7f15540d3590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f15540e0030 tx=0x7f15500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:06.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.479+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550040020 con 0x7f15540d3180 2024-05-09T00:19:06.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.479+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550038040 con 0x7f15540d3180 2024-05-09T00:19:06.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.481+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550037070 con 0x7f15540d3180 2024-05-09T00:19:06.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.481+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1554178c60 con 0x7f15540d3180 2024-05-09T00:19:06.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.481+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541754e0 con 0x7f15540d3180 2024-05-09T00:19:06.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.482+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1554175740 con 0x7f15540d3180 2024-05-09T00:19:06.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.495+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1550043020 con 0x7f15540d3180 2024-05-09T00:19:06.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.497+0000 7f1559600640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f153c0763d0 0x7f153c0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:06.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.497+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f15500b8b00 con 0x7f15540d3180 2024-05-09T00:19:06.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.499+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1550081d60 con 0x7f15540d3180 2024-05-09T00:19:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.502+0000 7f1561a00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f153c0763d0 0x7f153c0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:06.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:06.504+0000 7f1561a00640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f153c0763d0 0x7f153c0788e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f155c051620 tx=0x7f155c091040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:06.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:19:07.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.170+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15540e0a90 con 0x7f15540d3180 2024-05-09T00:19:07.176 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:19:07.177 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:19:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.175+0000 7f1559600640 1 -- 172.21.15.114:0/2839913486 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+6503 (secure 0 0 0) 0x7f1550081660 con 0x7f15540d3180 2024-05-09T00:19:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 66 2024-05-09T00:19:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.179+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f153c0763d0 msgr2=0x7f153c0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.179+0000 7f1564400640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f153c0763d0 0x7f153c0788e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f155c051620 tx=0x7f155c091040 comp rx=0 tx=0).stop 2024-05-09T00:19:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.179+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15540d3180 msgr2=0x7f15540d3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.179+0000 7f1564400640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15540d3180 0x7f15540d3590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f15540e0030 tx=0x7f15500046c0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.180+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 shutdown_connections 2024-05-09T00:19:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.180+0000 7f1564400640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f153c0763d0 0x7f153c0788e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.180+0000 7f1564400640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15540d3180 0x7f15540d3590 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.180+0000 7f1564400640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155403f0e0 0x7f1554174c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.180+0000 7f1564400640 1 --2- 172.21.15.114:0/2839913486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1554006f90 0x7f15540de230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.180+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 >> 172.21.15.114:0/2839913486 conn(0x7f1554006260 msgr2=0x7f1554049c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:19:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.181+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 shutdown_connections 2024-05-09T00:19:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.181+0000 7f1564400640 1 -- 172.21.15.114:0/2839913486 wait complete. 2024-05-09T00:19:07.242 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-05-09T00:19:07.242 INFO:tasks.mds_thrash.fs.[b]:waiting for 106 secs before thrashing 2024-05-09T00:19:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.422+0000 7f63e4000640 1 Processor -- start 2024-05-09T00:19:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.422+0000 7f63e4000640 1 -- start start 2024-05-09T00:19:07.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.436+0000 7f63e4000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63dc0c31b0 0x7f63dc158e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:07.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.436+0000 7f63e4000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0740e0 0x7f63dc0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:07.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.436+0000 7f63e4000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc159340 con 0x7f63dc0735c0 2024-05-09T00:19:07.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.436+0000 7f63e4000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f63dc15c620 con 0x7f63dc0c31b0 2024-05-09T00:19:07.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.436+0000 7f63e4000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc15ba10 con 0x7f63dc0740e0 2024-05-09T00:19:07.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.437+0000 7f63e1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63dc0c31b0 0x7f63dc158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:07.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.438+0000 7f63e1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63dc0c31b0 0x7f63dc158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35868/0 (socket says 172.21.15.114:35868) 2024-05-09T00:19:07.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.438+0000 7f63e1600640 1 -- 172.21.15.114:0/1315317303 learned_addr learned my addr 172.21.15.114:0/1315317303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:19:07.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.438+0000 7f63e1600640 1 -- 172.21.15.114:0/1315317303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0740e0 msgr2=0x7f63dc0c5a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:19:07.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.439+0000 7f63e1600640 1 --2- 172.21.15.114:0/1315317303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0740e0 0x7f63dc0c5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.439+0000 7f63e1600640 1 -- 172.21.15.114:0/1315317303 >> v1:172.21.15.114:6789/0 conn(0x7f63dc0735c0 legacy=0x7f63dc0739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:19:07.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.439+0000 7f63e1600640 1 -- 172.21.15.114:0/1315317303 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc15bcf0 con 0x7f63dc0c31b0 2024-05-09T00:19:07.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.441+0000 7f63e1600640 1 --2- 172.21.15.114:0/1315317303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc0c31b0 0x7f63dc158e00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f63dc071570 tx=0x7f63d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f46b6a779ea4db7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:07.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.442+0000 7f63dbe00640 1 -- 172.21.15.114:0/1315317303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4036070 con 0x7f63dc0c31b0 2024-05-09T00:19:07.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.442+0000 7f63dbe00640 1 -- 172.21.15.114:0/1315317303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d4031600 con 0x7f63dc0c31b0 2024-05-09T00:19:07.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.442+0000 7f63dbe00640 1 -- 172.21.15.114:0/1315317303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d40319d0 con 0x7f63dc0c31b0 2024-05-09T00:19:07.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.444+0000 7f63e4000640 1 -- 172.21.15.114:0/1315317303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc0c31b0 msgr2=0x7f63dc158e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:07.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.445+0000 7f63e4000640 1 --2- 172.21.15.114:0/1315317303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc0c31b0 0x7f63dc158e00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f63dc071570 tx=0x7f63d402a680 comp rx=0 tx=0).stop 2024-05-09T00:19:07.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.447+0000 7f63e4000640 1 -- 172.21.15.114:0/1315317303 shutdown_connections 2024-05-09T00:19:07.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.447+0000 7f63e4000640 1 --2- 172.21.15.114:0/1315317303 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0740e0 0x7f63dc0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.448+0000 7f63e4000640 1 --2- 172.21.15.114:0/1315317303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc0c31b0 0x7f63dc158e00 secure :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f63dc071570 tx=0x7f63d402a680 comp rx=0 tx=0).stop 2024-05-09T00:19:07.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.448+0000 7f63e4000640 1 -- 172.21.15.114:0/1315317303 >> 172.21.15.114:0/1315317303 conn(0x7f63dc06c680 msgr2=0x7f63dc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:19:07.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.450+0000 7f63e4000640 1 -- 172.21.15.114:0/1315317303 shutdown_connections 2024-05-09T00:19:07.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.451+0000 7f63e4000640 1 -- 172.21.15.114:0/1315317303 wait complete. 2024-05-09T00:19:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.459+0000 7f63e4000640 1 Processor -- start 2024-05-09T00:19:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.460+0000 7f63e4000640 1 -- start start 2024-05-09T00:19:07.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.463+0000 7f63e4000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0735c0 0x7f63dc0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.463+0000 7f63e4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc152e50 0x7f63dc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.463+0000 7f63e4000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63dc13fc70 0x7f63dc140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.463+0000 7f63e4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc0c5fd0 con 0x7f63dc152e50 2024-05-09T00:19:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.463+0000 7f63e4000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc15c2b0 con 0x7f63dc13fc70 2024-05-09T00:19:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.463+0000 7f63e4000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc0c6150 con 0x7f63dc0735c0 2024-05-09T00:19:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.468+0000 7f63e2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63dc13fc70 0x7f63dc140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.468+0000 7f63e2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63dc13fc70 0x7f63dc140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44484/0 (socket says 172.21.15.114:44484) 2024-05-09T00:19:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.469+0000 7f63e2000640 1 -- 172.21.15.114:0/451741668 learned_addr learned my addr 172.21.15.114:0/451741668 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:19:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.469+0000 7f63e1600640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0735c0 0x7f63dc0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.469+0000 7f63e0c00640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc152e50 0x7f63dc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.475+0000 7f63e1600640 1 -- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63dc13fc70 msgr2=0x7f63dc140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.475+0000 7f63e1600640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63dc13fc70 0x7f63dc140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.475+0000 7f63e1600640 1 -- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc152e50 msgr2=0x7f63dc153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.475+0000 7f63e1600640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc152e50 0x7f63dc153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.475+0000 7f63e1600640 1 -- 172.21.15.114:0/451741668 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc0aec20 con 0x7f63dc0735c0 2024-05-09T00:19:07.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.476+0000 7f63e1600640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0735c0 0x7f63dc0add40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63d4030000 tx=0x7f63d4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.478+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4041030 con 0x7f63dc0735c0 2024-05-09T00:19:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.479+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d4037040 con 0x7f63dc0735c0 2024-05-09T00:19:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.479+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4036070 con 0x7f63dc0735c0 2024-05-09T00:19:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.483+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc154110 con 0x7f63dc0735c0 2024-05-09T00:19:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.483+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc0acf80 con 0x7f63dc0735c0 2024-05-09T00:19:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.485+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc0c3b80 con 0x7f63dc0735c0 2024-05-09T00:19:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.499+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63d4044070 con 0x7f63dc0735c0 2024-05-09T00:19:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.501+0000 7f63d9600640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63bc0762d0 0x7f63bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:19:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.501+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f63d40b8f40 con 0x7f63dc0735c0 2024-05-09T00:19:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.502+0000 7f63e0c00640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63bc0762d0 0x7f63bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:19:07.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.506+0000 7f63e0c00640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63bc0762d0 0x7f63bc0787e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63c8006fd0 tx=0x7f63c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:19:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:07.514+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f63dc0aec20 con 0x7f63dc0735c0 2024-05-09T00:19:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.110+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63dc077430 con 0x7f63dc0735c0 2024-05-09T00:19:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.117+0000 7f63d9600640 1 -- 172.21.15.114:0/451741668 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+6503 (secure 0 0 0) 0x7f63d408a070 con 0x7f63dc0735c0 2024-05-09T00:19:08.124 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:19:08.124 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:19:08.125 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 66 2024-05-09T00:19:08.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.127+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63bc0762d0 msgr2=0x7f63bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:08.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.127+0000 7f63e4000640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63bc0762d0 0x7f63bc0787e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63c8006fd0 tx=0x7f63c8008040 comp rx=0 tx=0).stop 2024-05-09T00:19:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.127+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0735c0 msgr2=0x7f63dc0add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0735c0 0x7f63dc0add40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63d4030000 tx=0x7f63d4004a40 comp rx=0 tx=0).stop 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 shutdown_connections 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f63bc0762d0 0x7f63bc0787e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63dc13fc70 0x7f63dc140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63dc152e50 0x7f63dc153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 --2- 172.21.15.114:0/451741668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc0735c0 0x7f63dc0add40 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63d4030000 tx=0x7f63d4004a40 comp rx=0 tx=0).stop 2024-05-09T00:19:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.128+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 >> 172.21.15.114:0/451741668 conn(0x7f63dc06c680 msgr2=0x7f63dc075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:19:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.133+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 shutdown_connections 2024-05-09T00:19:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:19:08.135+0000 7f63e4000640 1 -- 172.21.15.114:0/451741668 wait complete. 2024-05-09T00:19:08.199 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-05-09T00:19:08.199 INFO:tasks.mds_thrash.fs.[a]:waiting for 116 secs before thrashing 2024-05-09T00:19:17.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:19:17.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:19:43.190 INFO:tasks.workunit.client.1.smithi153.stdout:Syncing()...99 sec 2024-05-09T00:19:43.190 INFO:tasks.workunit.client.1.smithi153.stdout:FFSB benchmark finished at: Thu May 9 00:19:43 2024 2024-05-09T00:19:43.190 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:Results: 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:Benchmark took 412.17 sec 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:Total Results 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:=============== 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout: ======= ============ ========= ======= =========== ========== 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout: write : 11985920 29080.23 100.000% 100.000% 114MB/sec 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:- 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:29080.23 Transactions per Second 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:Throughput Results 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:=================== 2024-05-09T00:19:43.191 INFO:tasks.workunit.client.1.smithi153.stdout:Write Throughput: 114MB/sec 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout:System Call Latency statistics in millisecs 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout:===== 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout: Min Avg Max Total Calls 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout: ======== ======== ======== ============ 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout:[ open] 0.020000 34.887109 21721.078125 9364 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[0] 5000.000000 - 10000.000000 : 1 2024-05-09T00:19:43.312 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[1] 2000.000000 - 5000.000000 : 58 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[2] 1000.000000 - 2000.000000 : 19 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[3] 500.000000 - 1000.000000 : 51 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[4] 200.000000 - 500.000000 : 100 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[5] 100.000000 - 200.000000 : 38 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[6] 50.000000 - 100.000000 : 34 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[7] 20.000000 - 50.000000 : 40 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[8] 10.000000 - 20.000000 : 46 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[9] 5.000000 - 10.000000 : 43 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[10] 2.000000 - 5.000000 : 74 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[11] 1.000000 - 2.000000 : 56 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[12] 0.500000 - 1.000000 : 30 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[13] 0.200000 - 0.500000 : 74 2024-05-09T00:19:43.313 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[14] 0.100000 - 0.200000 : 178 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[15] 0.050000 - 0.100000 : 1223 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[16] 0.020000 - 0.050000 : 7296 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout:[ write] 0.003000 0.782767 24837.671875 11985920 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[0] 5000.000000 - 10000.000000 : 310 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[1] 2000.000000 - 5000.000000 : 647 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[2] 1000.000000 - 2000.000000 : 453 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[3] 500.000000 - 1000.000000 : 422 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[4] 200.000000 - 500.000000 : 754 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[5] 100.000000 - 200.000000 : 3461 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[6] 50.000000 - 100.000000 : 17196 2024-05-09T00:19:43.314 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[7] 20.000000 - 50.000000 : 6365 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[8] 10.000000 - 20.000000 : 2506 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[9] 5.000000 - 10.000000 : 3699 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[10] 2.000000 - 5.000000 : 7062 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[11] 1.000000 - 2.000000 : 4891 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[12] 0.500000 - 1.000000 : 4656 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[13] 0.200000 - 0.500000 : 7877 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[14] 0.100000 - 0.200000 : 11968 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[15] 0.050000 - 0.100000 : 32468 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[16] 0.020000 - 0.050000 : 213501 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[17] 0.010000 - 0.020000 : 3428168 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[18] 0.000000 - 0.010000 : 8239394 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout:[ lseek] 0.000000 0.002178 157.285995 11985920 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-09T00:19:43.315 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[5] 100.000000 - 200.000000 : 4 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[6] 50.000000 - 100.000000 : 31 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[7] 20.000000 - 50.000000 : 92 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[8] 10.000000 - 20.000000 : 170 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[9] 5.000000 - 10.000000 : 285 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[10] 2.000000 - 5.000000 : 634 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[11] 1.000000 - 2.000000 : 418 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[12] 0.500000 - 1.000000 : 449 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[13] 0.200000 - 0.500000 : 718 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[14] 0.100000 - 0.200000 : 839 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[15] 0.050000 - 0.100000 : 1682 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[16] 0.020000 - 0.050000 : 6793 2024-05-09T00:19:43.316 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[17] 0.010000 - 0.020000 : 9666 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[18] 0.000000 - 0.010000 : 11964139 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout:[ close] 0.003000 0.013416 6.049000 9364 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[10] 2.000000 - 5.000000 : 4 2024-05-09T00:19:43.317 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[11] 1.000000 - 2.000000 : 3 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[12] 0.500000 - 1.000000 : 4 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[13] 0.200000 - 0.500000 : 6 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[14] 0.100000 - 0.200000 : 10 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[15] 0.050000 - 0.100000 : 12 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[16] 0.020000 - 0.050000 : 84 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[17] 0.010000 - 0.020000 : 5814 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: msec_range[18] 0.000000 - 0.010000 : 3426 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout: 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout:1.9% User Time 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout:30.2% System Time 2024-05-09T00:19:43.318 INFO:tasks.workunit.client.1.smithi153.stdout:32.1% CPU Utilization 2024-05-09T00:19:43.338 INFO:tasks.workunit.client.1.smithi153.stderr:+ cd .. 2024-05-09T00:19:43.340 INFO:tasks.workunit.client.1.smithi153.stderr:+ rm -r tmp ffsb 2024-05-09T00:19:48.127 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T00:19:48.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-09T00:19:48.261 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-05-09T00:19:48.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-09T00:19:48.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:19:48.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:19:49.647 DEBUG:teuthology.parallel:result is None 2024-05-09T00:19:51.542 INFO:tasks.workunit.client.0.smithi114.stdout:Syncing()...45 sec 2024-05-09T00:19:51.542 INFO:tasks.workunit.client.0.smithi114.stdout:FFSB benchmark finished at: Thu May 9 00:19:51 2024 2024-05-09T00:19:51.542 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.542 INFO:tasks.workunit.client.0.smithi114.stdout:Results: 2024-05-09T00:19:51.542 INFO:tasks.workunit.client.0.smithi114.stdout:Benchmark took 350.66 sec 2024-05-09T00:19:51.542 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:Total Results 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:=============== 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout: ======= ============ ========= ======= =========== ========== 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout: write : 8961280 25555.23 100.000% 100.000% 99.8MB/sec 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:- 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:25555.23 Transactions per Second 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:Throughput Results 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:=================== 2024-05-09T00:19:51.543 INFO:tasks.workunit.client.0.smithi114.stdout:Write Throughput: 99.8MB/sec 2024-05-09T00:19:51.704 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.704 INFO:tasks.workunit.client.0.smithi114.stdout:System Call Latency statistics in millisecs 2024-05-09T00:19:51.704 INFO:tasks.workunit.client.0.smithi114.stdout:===== 2024-05-09T00:19:51.704 INFO:tasks.workunit.client.0.smithi114.stdout: Min Avg Max Total Calls 2024-05-09T00:19:51.706 INFO:tasks.workunit.client.0.smithi114.stdout: ======== ======== ======== ============ 2024-05-09T00:19:51.706 INFO:tasks.workunit.client.0.smithi114.stdout:[ open] 0.018000 142.869291 27857.939453 7001 2024-05-09T00:19:51.706 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[0] 5000.000000 - 10000.000000 : 6 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[1] 2000.000000 - 5000.000000 : 56 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[2] 1000.000000 - 2000.000000 : 56 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[3] 500.000000 - 1000.000000 : 3 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[4] 200.000000 - 500.000000 : 45 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[5] 100.000000 - 200.000000 : 21 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[6] 50.000000 - 100.000000 : 56 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[7] 20.000000 - 50.000000 : 60 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[8] 10.000000 - 20.000000 : 61 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[9] 5.000000 - 10.000000 : 74 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[10] 2.000000 - 5.000000 : 78 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[11] 1.000000 - 2.000000 : 34 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[12] 0.500000 - 1.000000 : 19 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[13] 0.200000 - 0.500000 : 31 2024-05-09T00:19:51.707 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[14] 0.100000 - 0.200000 : 94 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[15] 0.050000 - 0.100000 : 459 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[16] 0.020000 - 0.050000 : 5823 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[17] 0.010000 - 0.020000 : 2 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout:[ write] 0.003000 0.960109 38487.328125 8961280 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[0] 5000.000000 - 10000.000000 : 227 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[1] 2000.000000 - 5000.000000 : 550 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[2] 1000.000000 - 2000.000000 : 344 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[3] 500.000000 - 1000.000000 : 322 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[4] 200.000000 - 500.000000 : 2452 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[5] 100.000000 - 200.000000 : 4029 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[6] 50.000000 - 100.000000 : 13022 2024-05-09T00:19:51.708 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[7] 20.000000 - 50.000000 : 8339 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[8] 10.000000 - 20.000000 : 3088 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[9] 5.000000 - 10.000000 : 4542 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[10] 2.000000 - 5.000000 : 8245 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[11] 1.000000 - 2.000000 : 5290 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[12] 0.500000 - 1.000000 : 4977 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[13] 0.200000 - 0.500000 : 8083 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[14] 0.100000 - 0.200000 : 12199 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[15] 0.050000 - 0.100000 : 28472 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[16] 0.020000 - 0.050000 : 283329 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[17] 0.010000 - 0.020000 : 3952385 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[18] 0.000000 - 0.010000 : 4621276 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout:[ lseek] 0.000000 0.002651 136.718002 8961280 2024-05-09T00:19:51.709 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[5] 100.000000 - 200.000000 : 6 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[6] 50.000000 - 100.000000 : 39 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[7] 20.000000 - 50.000000 : 93 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[8] 10.000000 - 20.000000 : 177 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[9] 5.000000 - 10.000000 : 321 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[10] 2.000000 - 5.000000 : 660 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[11] 1.000000 - 2.000000 : 433 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[12] 0.500000 - 1.000000 : 425 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[13] 0.200000 - 0.500000 : 590 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[14] 0.100000 - 0.200000 : 534 2024-05-09T00:19:51.710 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[15] 0.050000 - 0.100000 : 1301 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[16] 0.020000 - 0.050000 : 5215 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[17] 0.010000 - 0.020000 : 6099 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[18] 0.000000 - 0.010000 : 8945387 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout:[ close] 0.003000 0.015271 15.759000 7001 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[8] 10.000000 - 20.000000 : 1 2024-05-09T00:19:51.711 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[9] 5.000000 - 10.000000 : 2 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[11] 1.000000 - 2.000000 : 3 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[13] 0.200000 - 0.500000 : 2 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[15] 0.050000 - 0.100000 : 17 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[16] 0.020000 - 0.050000 : 55 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[17] 0.010000 - 0.020000 : 4007 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: msec_range[18] 0.000000 - 0.010000 : 2907 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.712 INFO:tasks.workunit.client.0.smithi114.stdout: 2024-05-09T00:19:51.713 INFO:tasks.workunit.client.0.smithi114.stdout:1.7% User Time 2024-05-09T00:19:51.713 INFO:tasks.workunit.client.0.smithi114.stdout:31.1% System Time 2024-05-09T00:19:51.713 INFO:tasks.workunit.client.0.smithi114.stdout:32.7% CPU Utilization 2024-05-09T00:19:51.737 INFO:tasks.workunit.client.0.smithi114.stderr:+ cd .. 2024-05-09T00:19:51.738 INFO:tasks.workunit.client.0.smithi114.stderr:+ rm -r tmp ffsb 2024-05-09T00:20:00.162 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T00:20:00.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T00:20:00.248 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-05-09T00:20:00.249 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T00:20:01.210 DEBUG:teuthology.parallel:result is None 2024-05-09T00:20:01.210 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T00:20:01.349 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T00:20:01.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T00:20:01.452 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T00:20:01.452 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-05-09T00:20:01.464 INFO:tasks.mds_thrash:joining mds_thrasher 2024-05-09T00:20:01.464 ERROR:tasks.mds_thrash.fs.[b]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 121, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 237, in do_thrash self.sleep_unless_stopped(delay) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-05-09T00:20:01.465 INFO:tasks.mds_thrash:done joining 2024-05-09T00:20:01.465 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T00:20:01.489 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T00:20:01.489 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:20:01.489 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:20:01.552 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-09T00:20:01.552 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:20:01.619 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T00:20:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.045+0000 7f5bff200640 1 Processor -- start 2024-05-09T00:20:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.045+0000 7f5bff200640 1 -- start start 2024-05-09T00:20:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bff200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 0x7f5c000b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bff200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c000c86e0 0x7f5c000aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bff200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000af520 0x7f5c000cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bff200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5c000cd290 con 0x7f5c000c86e0 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bff200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5c000c8af0 con 0x7f5c000c09c0 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bff200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0015d250 con 0x7f5c000af520 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bfde00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 0x7f5c000b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bfd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c000c86e0 0x7f5c000aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bfde00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 0x7f5c000b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44412/0 (socket says 172.21.15.114:44412) 2024-05-09T00:20:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bfde00640 1 -- 172.21.15.114:0/648499531 learned_addr learned my addr 172.21.15.114:0/648499531 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.048+0000 7f5bfe800640 1 --2- 172.21.15.114:0/648499531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000af520 0x7f5c000cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.049+0000 7f5bfd400640 1 -- 172.21.15.114:0/648499531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000af520 msgr2=0x7f5c000cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.049+0000 7f5bfd400640 1 --2- 172.21.15.114:0/648499531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000af520 0x7f5c000cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.049+0000 7f5bfd400640 1 -- 172.21.15.114:0/648499531 >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 msgr2=0x7f5c000b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.049+0000 7f5bfd400640 1 --2- 172.21.15.114:0/648499531 >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 0x7f5c000b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.049+0000 7f5bfd400640 1 -- 172.21.15.114:0/648499531 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0015d530 con 0x7f5c000c86e0 2024-05-09T00:20:02.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.049+0000 7f5bfde00640 1 --2- 172.21.15.114:0/648499531 >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 0x7f5c000b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:20:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.050+0000 7f5bfd400640 1 --2- 172.21.15.114:0/648499531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000c86e0 0x7f5c000aefe0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5c0008ee80 tx=0x7f5bf002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ce6c856f371ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.051+0000 7f5bfca00640 1 -- 172.21.15.114:0/648499531 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0037070 con 0x7f5c000c86e0 2024-05-09T00:20:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.051+0000 7f5bfca00640 1 -- 172.21.15.114:0/648499531 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf002add0 con 0x7f5c000c86e0 2024-05-09T00:20:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.051+0000 7f5bfca00640 1 -- 172.21.15.114:0/648499531 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0032660 con 0x7f5c000c86e0 2024-05-09T00:20:02.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.052+0000 7f5bff200640 1 -- 172.21.15.114:0/648499531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000c86e0 msgr2=0x7f5c000aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:02.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.052+0000 7f5bff200640 1 --2- 172.21.15.114:0/648499531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000c86e0 0x7f5c000aefe0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5c0008ee80 tx=0x7f5bf002a080 comp rx=0 tx=0).stop 2024-05-09T00:20:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.055+0000 7f5bff200640 1 -- 172.21.15.114:0/648499531 shutdown_connections 2024-05-09T00:20:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.055+0000 7f5bff200640 1 --2- 172.21.15.114:0/648499531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000af520 0x7f5c000cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.055+0000 7f5bff200640 1 --2- 172.21.15.114:0/648499531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000c86e0 0x7f5c000aefe0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.055+0000 7f5bff200640 1 --2- 172.21.15.114:0/648499531 >> v2:172.21.15.153:3300/0 conn(0x7f5c000c09c0 0x7f5c000b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.055+0000 7f5bff200640 1 -- 172.21.15.114:0/648499531 >> 172.21.15.114:0/648499531 conn(0x7f5c000cd4e0 msgr2=0x7f5c000cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.055+0000 7f5bff200640 1 -- 172.21.15.114:0/648499531 shutdown_connections 2024-05-09T00:20:02.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.058+0000 7f5bff200640 1 -- 172.21.15.114:0/648499531 wait complete. 2024-05-09T00:20:02.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.061+0000 7f5bff200640 1 Processor -- start 2024-05-09T00:20:02.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.061+0000 7f5bff200640 1 -- start start 2024-05-09T00:20:02.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.063+0000 7f5bff200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 0x7f5c0015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.063+0000 7f5bff200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000c09c0 0x7f5c0015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.063+0000 7f5bff200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c000c86e0 0x7f5c00160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.063+0000 7f5bff200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5c000cbf30 con 0x7f5c000af520 2024-05-09T00:20:02.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.063+0000 7f5bff200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c000ccf20 con 0x7f5c000c86e0 2024-05-09T00:20:02.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.063+0000 7f5bff200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c000cc0b0 con 0x7f5c000c09c0 2024-05-09T00:20:02.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.064+0000 7f5bfde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 0x7f5c0015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.064+0000 7f5bfde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 0x7f5c0015ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59108/0 (socket says 172.21.15.114:59108) 2024-05-09T00:20:02.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.064+0000 7f5bfe800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c000c86e0 0x7f5c00160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.064+0000 7f5bfe800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c000c86e0 0x7f5c00160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:44424/0 (socket says 172.21.15.114:44424) 2024-05-09T00:20:02.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.064+0000 7f5bfe800640 1 -- 172.21.15.114:0/3722701092 learned_addr learned my addr 172.21.15.114:0/3722701092 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:02.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.065+0000 7f5bfd400640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000c09c0 0x7f5c0015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.065+0000 7f5bfde00640 1 -- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000c09c0 msgr2=0x7f5c0015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:02.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.065+0000 7f5bfde00640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000c09c0 0x7f5c0015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.065+0000 7f5bfde00640 1 -- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c000c86e0 msgr2=0x7f5c00160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:02.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.065+0000 7f5bfde00640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c000c86e0 0x7f5c00160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.065+0000 7f5bfde00640 1 -- 172.21.15.114:0/3722701092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c000c0dd0 con 0x7f5c000af520 2024-05-09T00:20:02.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.066+0000 7f5bfde00640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 0x7f5c0015ed40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5c0008f170 tx=0x7f5bec00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:02.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.067+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec017070 con 0x7f5c000af520 2024-05-09T00:20:02.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.067+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bec00c8e0 con 0x7f5c000af520 2024-05-09T00:20:02.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.067+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00ccd0 con 0x7f5c000af520 2024-05-09T00:20:02.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.067+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0015f280 con 0x7f5c000af520 2024-05-09T00:20:02.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.067+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c000c39e0 con 0x7f5c000af520 2024-05-09T00:20:02.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.071+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c00078430 con 0x7f5c000af520 2024-05-09T00:20:02.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.075+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5bec01a070 con 0x7f5c000af520 2024-05-09T00:20:02.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.076+0000 7f5bf6000640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5be0076300 0x7f5be0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:02.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.076+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f5bec0981e0 con 0x7f5c000af520 2024-05-09T00:20:02.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.078+0000 7f5bfd400640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5be0076300 0x7f5be0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:02.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.080+0000 7f5bfd400640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5be0076300 0x7f5be0078810 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0034000 tx=0x7f5bf002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:02.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.082+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5bec060cd0 con 0x7f5c000af520 2024-05-09T00:20:02.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.470+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c000cb620 con 0x7f5c000af520 2024-05-09T00:20:02.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.471+0000 7f5bf6000640 1 -- 172.21.15.114:0/3722701092 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 22 entries v38) ==== 81+0+1358 (secure 0 0 0) 0x7f5bec064fd0 con 0x7f5c000af520 2024-05-09T00:20:02.472 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2312453128 2024-05-10T00:18:35.025950+0000 2024-05-09T00:20:02.472 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2312453128 2024-05-10T00:18:35.025950+0000 2024-05-09T00:20:02.472 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/372512194 2024-05-10T00:17:25.004758+0000 2024-05-09T00:20:02.472 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/281438172 2024-05-10T00:16:34.973324+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/4100525107 2024-05-10T00:15:44.956406+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/1232162808 2024-05-10T00:18:25.023032+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/3829412957 2024-05-10T00:11:14.866186+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1891949153 2024-05-10T00:15:04.943103+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/281438172 2024-05-10T00:16:34.973324+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/3829412957 2024-05-10T00:11:14.866186+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1498992114 2024-05-10T00:11:24.870997+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/2960717153 2024-05-10T00:14:19.928294+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1498992114 2024-05-10T00:11:24.870997+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/1585617173 2024-05-10T00:13:34.914248+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/1232162808 2024-05-10T00:18:25.023032+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/1585617173 2024-05-10T00:13:34.914248+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6833/690310809 2024-05-10T00:13:34.914171+0000 2024-05-09T00:20:02.473 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1891949153 2024-05-10T00:15:04.943103+0000 2024-05-09T00:20:02.474 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6832/690310809 2024-05-10T00:13:34.914171+0000 2024-05-09T00:20:02.474 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/2960717153 2024-05-10T00:14:19.928294+0000 2024-05-09T00:20:02.474 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/372512194 2024-05-10T00:17:25.004758+0000 2024-05-09T00:20:02.474 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/4100525107 2024-05-10T00:15:44.956406+0000 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:listed 22 entries 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5be0076300 msgr2=0x7f5be0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5be0076300 0x7f5be0078810 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0034000 tx=0x7f5bf002e000 comp rx=0 tx=0).stop 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 msgr2=0x7f5c0015ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 0x7f5c0015ed40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5c0008f170 tx=0x7f5bec00ecd0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 shutdown_connections 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f5be0076300 0x7f5be0078810 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0034000 tx=0x7f5bf002e000 comp rx=0 tx=0).stop 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c000c86e0 0x7f5c00160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c000c09c0 0x7f5c0015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 --2- 172.21.15.114:0/3722701092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c000af520 0x7f5c0015ed40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.474+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 >> 172.21.15.114:0/3722701092 conn(0x7f5c000cd4e0 msgr2=0x7f5c000aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.475+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 shutdown_connections 2024-05-09T00:20:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:02.475+0000 7f5bff200640 1 -- 172.21.15.114:0/3722701092 wait complete. 2024-05-09T00:20:02.508 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T00:20:02.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:02.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T00:20:02.620 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:20:02.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:02.620 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T00:20:02.660 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:20:02.660 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:20:02.717 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-09T00:20:02.717 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:20:02.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T00:20:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.077+0000 7ff217200640 1 Processor -- start 2024-05-09T00:20:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.078+0000 7ff217200640 1 -- start start 2024-05-09T00:20:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff217200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff218074170 0x7ff2180aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff217200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff21814a7a0 0x7ff21814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff217200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff218073d60 con 0x7ff2180ae670 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff217200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff218070510 con 0x7ff218074170 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff217200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff218074580 con 0x7ff21814a7a0 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff215e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff218074170 0x7ff2180aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff215e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff218074170 0x7ff2180aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59116/0 (socket says 172.21.15.114:59116) 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff215e00640 1 -- 172.21.15.114:0/3159543927 learned_addr learned my addr 172.21.15.114:0/3159543927 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff216800640 1 --2- 172.21.15.114:0/3159543927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff21814a7a0 0x7ff21814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff215e00640 1 -- 172.21.15.114:0/3159543927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff21814a7a0 msgr2=0x7ff21814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff215e00640 1 --2- 172.21.15.114:0/3159543927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff21814a7a0 0x7ff21814abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.080+0000 7ff215e00640 1 -- 172.21.15.114:0/3159543927 >> v1:172.21.15.153:6789/0 conn(0x7ff2180ae670 legacy=0x7ff218073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:03.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.081+0000 7ff215e00640 1 -- 172.21.15.114:0/3159543927 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2180af530 con 0x7ff218074170 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.082+0000 7ff215e00640 1 --2- 172.21.15.114:0/3159543927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218074170 0x7ff2180aeff0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff20800bb10 tx=0x7ff20802c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7d3db8c8cb4964 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.082+0000 7ff214a00640 1 -- 172.21.15.114:0/3159543927 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208031710 con 0x7ff218074170 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.082+0000 7ff214a00640 1 -- 172.21.15.114:0/3159543927 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080318b0 con 0x7ff218074170 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.082+0000 7ff214a00640 1 -- 172.21.15.114:0/3159543927 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208031c80 con 0x7ff218074170 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 -- 172.21.15.114:0/3159543927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218074170 msgr2=0x7ff2180aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 --2- 172.21.15.114:0/3159543927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218074170 0x7ff2180aeff0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff20800bb10 tx=0x7ff20802c750 comp rx=0 tx=0).stop 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 -- 172.21.15.114:0/3159543927 shutdown_connections 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 --2- 172.21.15.114:0/3159543927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff21814a7a0 0x7ff21814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 --2- 172.21.15.114:0/3159543927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218074170 0x7ff2180aeff0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 -- 172.21.15.114:0/3159543927 >> 172.21.15.114:0/3159543927 conn(0x7ff2180c5ea0 msgr2=0x7ff2180c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 -- 172.21.15.114:0/3159543927 shutdown_connections 2024-05-09T00:20:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.083+0000 7ff217200640 1 -- 172.21.15.114:0/3159543927 wait complete. 2024-05-09T00:20:03.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.085+0000 7ff217200640 1 Processor -- start 2024-05-09T00:20:03.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.085+0000 7ff217200640 1 -- start start 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.086+0000 7ff217200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff218074170 0x7ff2180c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.086+0000 7ff217200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 0x7ff2181f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.086+0000 7ff217200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff21814a7a0 0x7ff218149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.086+0000 7ff217200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2180701a0 con 0x7ff2180ae670 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.086+0000 7ff217200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff218072740 con 0x7ff21814a7a0 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.086+0000 7ff217200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff2180aea80 con 0x7ff218074170 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 0x7ff2181f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 0x7ff2181f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59120/0 (socket says 172.21.15.114:59120) 2024-05-09T00:20:03.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 -- 172.21.15.114:0/1896081346 learned_addr learned my addr 172.21.15.114:0/1896081346 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 -- 172.21.15.114:0/1896081346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff218074170 msgr2=0x7ff2180c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff218074170 0x7ff2180c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 -- 172.21.15.114:0/1896081346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff21814a7a0 msgr2=0x7ff218149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff21814a7a0 0x7ff218149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 -- 172.21.15.114:0/1896081346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff218152730 con 0x7ff2180ae670 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff215400640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 0x7ff2181f16d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff20000b3f0 tx=0x7ff20000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200015020 con 0x7ff2180ae670 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff200011830 con 0x7ff2180ae670 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff218152a10 con 0x7ff2180ae670 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.087+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200011c20 con 0x7ff2180ae670 2024-05-09T00:20:03.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.088+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff218152fd0 con 0x7ff2180ae670 2024-05-09T00:20:03.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.089+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff218078430 con 0x7ff2180ae670 2024-05-09T00:20:03.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.090+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff200018020 con 0x7ff2180ae670 2024-05-09T00:20:03.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.091+0000 7ff20e000640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff1f40762d0 0x7ff1f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:03.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.091+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7ff200097a40 con 0x7ff2180ae670 2024-05-09T00:20:03.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.091+0000 7ff215e00640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff1f40762d0 0x7ff1f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:03.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.092+0000 7ff215e00640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff1f40762d0 0x7ff1f40787e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff208036000 tx=0x7ff208030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.095+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff20001f030 con 0x7ff2180ae670 2024-05-09T00:20:03.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.457+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff2181eedd0 con 0x7ff2180ae670 2024-05-09T00:20:03.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.459+0000 7ff20e000640 1 -- 172.21.15.114:0/1896081346 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 22 entries v38) ==== 81+0+1358 (secure 0 0 0) 0x7ff200060b90 con 0x7ff2180ae670 2024-05-09T00:20:03.459 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2312453128 2024-05-10T00:18:35.025950+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2312453128 2024-05-10T00:18:35.025950+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/372512194 2024-05-10T00:17:25.004758+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/281438172 2024-05-10T00:16:34.973324+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/4100525107 2024-05-10T00:15:44.956406+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/1232162808 2024-05-10T00:18:25.023032+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/3829412957 2024-05-10T00:11:14.866186+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1891949153 2024-05-10T00:15:04.943103+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/281438172 2024-05-10T00:16:34.973324+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/3829412957 2024-05-10T00:11:14.866186+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1498992114 2024-05-10T00:11:24.870997+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/2960717153 2024-05-10T00:14:19.928294+0000 2024-05-09T00:20:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1498992114 2024-05-10T00:11:24.870997+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/1585617173 2024-05-10T00:13:34.914248+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/1232162808 2024-05-10T00:18:25.023032+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6835/1585617173 2024-05-10T00:13:34.914248+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6833/690310809 2024-05-10T00:13:34.914171+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1891949153 2024-05-10T00:15:04.943103+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6832/690310809 2024-05-10T00:13:34.914171+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/2960717153 2024-05-10T00:14:19.928294+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/372512194 2024-05-10T00:17:25.004758+0000 2024-05-09T00:20:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.153:6834/4100525107 2024-05-10T00:15:44.956406+0000 2024-05-09T00:20:03.462 INFO:teuthology.orchestra.run.smithi114.stderr:listed 22 entries 2024-05-09T00:20:03.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.462+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff1f40762d0 msgr2=0x7ff1f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.462+0000 7ff217200640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff1f40762d0 0x7ff1f40787e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff208036000 tx=0x7ff208030000 comp rx=0 tx=0).stop 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.462+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 msgr2=0x7ff2181f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.462+0000 7ff217200640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 0x7ff2181f16d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff20000b3f0 tx=0x7ff20000b8b0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.463+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 shutdown_connections 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.463+0000 7ff217200640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff1f40762d0 0x7ff1f40787e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.463+0000 7ff217200640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff21814a7a0 0x7ff218149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.463+0000 7ff217200640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2180ae670 0x7ff2181f16d0 secure :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff20000b3f0 tx=0x7ff20000b8b0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.463+0000 7ff217200640 1 --2- 172.21.15.114:0/1896081346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff218074170 0x7ff2180c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:03.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.463+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 >> 172.21.15.114:0/1896081346 conn(0x7ff2180c5ea0 msgr2=0x7ff21814e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:03.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.464+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 shutdown_connections 2024-05-09T00:20:03.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:03.464+0000 7ff217200640 1 -- 172.21.15.114:0/1896081346 wait complete. 2024-05-09T00:20:03.507 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-09T00:20:03.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:03.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-09T00:20:03.662 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:20:03.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:03.663 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T00:20:03.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:03.712 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-05-09T00:20:03.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T00:20:03.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:03.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T00:20:03.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:03.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-05-09T00:20:04.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:04.001 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-09T00:20:04.073 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T00:20:04.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:04.074 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T00:20:04.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:20:04.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-05-09T00:20:04.241 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T00:20:04.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T00:20:04.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:20:04.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.485+0000 7fe5e8a00640 1 Processor -- start 2024-05-09T00:20:04.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.486+0000 7fe5e8a00640 1 -- start start 2024-05-09T00:20:04.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.487+0000 7fe5e8a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e4073510 0x7fe5e414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.487+0000 7fe5e8a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5e40ae880 0x7fe5e40aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.487+0000 7fe5e8a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e40ac210 con 0x7fe5e40af1d0 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.487+0000 7fe5e8a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e4073e20 con 0x7fe5e40ae880 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.487+0000 7fe5e8a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e40abf30 con 0x7fe5e4073510 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5e3200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe5e40af1d0 0x7fe5e40c3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52140/0 (socket says 172.21.15.114:52140) 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5e3200640 1 -- 172.21.15.114:0/391191525 learned_addr learned my addr 172.21.15.114:0/391191525 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5d9e00640 1 --2- 172.21.15.114:0/391191525 >> v2:172.21.15.114:3300/0 conn(0x7fe5e40ae880 0x7fe5e40aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5e2800640 1 --2- 172.21.15.114:0/391191525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e4073510 0x7fe5e414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5e1e00640 1 -- 172.21.15.114:0/391191525 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528358675 0 0) 0x7fe5e40ac210 con 0x7fe5e40af1d0 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5e1e00640 1 -- 172.21.15.114:0/391191525 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c8005730 con 0x7fe5e40af1d0 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5d9e00640 1 -- 172.21.15.114:0/391191525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e4073510 msgr2=0x7fe5e414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5d9e00640 1 --2- 172.21.15.114:0/391191525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e4073510 0x7fe5e414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5d9e00640 1 -- 172.21.15.114:0/391191525 >> v1:172.21.15.114:6789/0 conn(0x7fe5e40af1d0 legacy=0x7fe5e40c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:04.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.488+0000 7fe5d9e00640 1 -- 172.21.15.114:0/391191525 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e4155830 con 0x7fe5e40ae880 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.489+0000 7fe5d9e00640 1 --2- 172.21.15.114:0/391191525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e40ae880 0x7fe5e40aec90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009d90 tx=0x7fe5cc02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a6afb34618acae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e1e00640 1 -- 172.21.15.114:0/391191525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc007740 con 0x7fe5e40ae880 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e1e00640 1 -- 172.21.15.114:0/391191525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0078e0 con 0x7fe5e40ae880 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e1e00640 1 -- 172.21.15.114:0/391191525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc007cb0 con 0x7fe5e40ae880 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e8a00640 1 -- 172.21.15.114:0/391191525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e40ae880 msgr2=0x7fe5e40aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/391191525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e40ae880 0x7fe5e40aec90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009d90 tx=0x7fe5cc02a530 comp rx=0 tx=0).stop 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e8a00640 1 -- 172.21.15.114:0/391191525 shutdown_connections 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/391191525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e40ae880 0x7fe5e40aec90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/391191525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e4073510 0x7fe5e414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.490+0000 7fe5e8a00640 1 -- 172.21.15.114:0/391191525 >> 172.21.15.114:0/391191525 conn(0x7fe5e40c9730 msgr2=0x7fe5e40c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:04.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.491+0000 7fe5e8a00640 1 -- 172.21.15.114:0/391191525 shutdown_connections 2024-05-09T00:20:04.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.491+0000 7fe5e8a00640 1 -- 172.21.15.114:0/391191525 wait complete. 2024-05-09T00:20:04.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.493+0000 7fe5e8a00640 1 Processor -- start 2024-05-09T00:20:04.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.493+0000 7fe5e8a00640 1 -- start start 2024-05-09T00:20:04.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 0x7fe5e414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:04.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e40ae880 0x7fe5e41f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:04.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e8a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e40af1d0 0x7fe5e40c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e40c4420 con 0x7fe5e4073510 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e8a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e4074070 con 0x7fe5e40ae880 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e8a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e40c45a0 con 0x7fe5e40af1d0 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 0x7fe5e414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 0x7fe5e414d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59134/0 (socket says 172.21.15.114:59134) 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.494+0000 7fe5e2800640 1 -- 172.21.15.114:0/457121799 learned_addr learned my addr 172.21.15.114:0/457121799 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e2800640 1 -- 172.21.15.114:0/457121799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e40af1d0 msgr2=0x7fe5e40c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e2800640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e40af1d0 0x7fe5e40c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e2800640 1 -- 172.21.15.114:0/457121799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e40ae880 msgr2=0x7fe5e41f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e2800640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e40ae880 0x7fe5e41f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e2800640 1 -- 172.21.15.114:0/457121799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e4156b10 con 0x7fe5e4073510 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e2800640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 0x7fe5e414d210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400d5d0 tx=0x7fe5d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4004240 con 0x7fe5e4073510 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d40043e0 con 0x7fe5e4073510 2024-05-09T00:20:04.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4003830 con 0x7fe5e4073510 2024-05-09T00:20:04.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e4158690 con 0x7fe5e4073510 2024-05-09T00:20:04.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.495+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e414df40 con 0x7fe5e4073510 2024-05-09T00:20:04.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.496+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e4078430 con 0x7fe5e4073510 2024-05-09T00:20:04.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.498+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe5d40039d0 con 0x7fe5e4073510 2024-05-09T00:20:04.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.499+0000 7fe5db400640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5c00762d0 0x7fe5c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:04.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.499+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fe5d4097fd0 con 0x7fe5e4073510 2024-05-09T00:20:04.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.499+0000 7fe5d9e00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5c00762d0 0x7fe5c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:04.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.500+0000 7fe5d9e00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5c00762d0 0x7fe5c00787e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc034000 tx=0x7fe5cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:04.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.504+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe5d40611b0 con 0x7fe5e4073510 2024-05-09T00:20:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.691+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5e40748d0 con 0x7fe5c00762d0 2024-05-09T00:20:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.736+0000 7fe5db400640 1 -- 172.21.15.114:0/457121799 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495216 (secure 0 0 0) 0x7fe5e40748d0 con 0x7fe5c00762d0 2024-05-09T00:20:04.744 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:04.748 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5c00762d0 msgr2=0x7fe5c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5c00762d0 0x7fe5c00787e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc034000 tx=0x7fe5cc02e000 comp rx=0 tx=0).stop 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 msgr2=0x7fe5e414d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 0x7fe5e414d210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400d5d0 tx=0x7fe5d400da90 comp rx=0 tx=0).stop 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 shutdown_connections 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5c00762d0 0x7fe5c00787e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5e40af1d0 0x7fe5e40c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e40ae880 0x7fe5e41f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 --2- 172.21.15.114:0/457121799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5e4073510 0x7fe5e414d210 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.746+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 >> 172.21.15.114:0/457121799 conn(0x7fe5e40c9730 msgr2=0x7fe5e40c3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.747+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 shutdown_connections 2024-05-09T00:20:04.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:04.747+0000 7fe5e8a00640 1 -- 172.21.15.114:0/457121799 wait complete. 2024-05-09T00:20:04.781 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-05-09T00:20:04.633342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4879991612,"num_objects":1404,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1404,"num_whiteouts":0,"num_read":2535,"num_read_kb":419208,"num_write":6425105,"num_write_kb":81417369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438523,"ondisk_log_size":438523,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":14581828,"kb_used_data":10584004,"kb_used_omap":12,"kb_used_meta":3948595,"kb_avail":740392892,"statfs":{"total":773094113280,"available":758162321408,"internally_reserved":0,"allocated":10838020096,"data_stored":10835197841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":4043361840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,0,5,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11795246492,"num_objects":-3017,"num_object_clones":0,"num_object_copies":-6034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3017,"num_whiteouts":0,"num_read":8,"num_read_kb":51,"num_write":3132,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005960"},"pg_stats":[{"pgid":"5.18","version":"38'3510","reported_seq":3569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.649196+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:19:53.649196+0000","last_peered":"2024-05-09T00:19:53.649196+0000","last_clean":"2024-05-09T00:19:53.649196+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:19:53.649196+0000","last_undegraded":"2024-05-09T00:19:53.649196+0000","last_fullsized":"2024-05-09T00:19:53.649196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":51796,"num_write_kb":675575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"32'26","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:53.009330+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:18:53.009330+0000","last_peered":"2024-05-09T00:18:53.009330+0000","last_clean":"2024-05-09T00:18:53.009330+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:18:53.009330+0000","last_undegraded":"2024-05-09T00:18:53.009330+0000","last_fullsized":"2024-05-09T00:18:53.009330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":12312,"num_write":21,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"38'3237","reported_seq":3287,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.067412+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:20:00.067412+0000","last_peered":"2024-05-09T00:20:00.067412+0000","last_clean":"2024-05-09T00:20:00.067412+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:20:00.067412+0000","last_undegraded":"2024-05-09T00:20:00.067412+0000","last_fullsized":"2024-05-09T00:20:00.067412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":48370,"num_write_kb":608968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:54.772350+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:18:54.772350+0000","last_peered":"2024-05-09T00:18:54.772350+0000","last_clean":"2024-05-09T00:18:54.772350+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:18:54.772350+0000","last_undegraded":"2024-05-09T00:18:54.772350+0000","last_fullsized":"2024-05-09T00:18:54.772350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"38'4249","reported_seq":4310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.643116+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:19:53.643116+0000","last_peered":"2024-05-09T00:19:53.643116+0000","last_clean":"2024-05-09T00:19:53.643116+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:19:53.643116+0000","last_undegraded":"2024-05-09T00:19:53.643116+0000","last_fullsized":"2024-05-09T00:19:53.643116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4249,"log_dups_size":0,"ondisk_log_size":4249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":63068,"num_write_kb":790226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'6","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.172629+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:18:41.172629+0000","last_peered":"2024-05-09T00:18:41.172629+0000","last_clean":"2024-05-09T00:18:41.172629+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:18:41.172629+0000","last_undegraded":"2024-05-09T00:18:41.172629+0000","last_fullsized":"2024-05-09T00:18:41.172629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"38'3775","reported_seq":3834,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.123795+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:20:00.123795+0000","last_peered":"2024-05-09T00:20:00.123795+0000","last_clean":"2024-05-09T00:20:00.123795+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:20:00.123795+0000","last_undegraded":"2024-05-09T00:20:00.123795+0000","last_fullsized":"2024-05-09T00:20:00.123795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83947003,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":56252,"num_write_kb":712681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"38'34","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.497193+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:19:53.497193+0000","last_peered":"2024-05-09T00:19:53.497193+0000","last_clean":"2024-05-09T00:19:53.497193+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:19:53.497193+0000","last_undegraded":"2024-05-09T00:19:53.497193+0000","last_fullsized":"2024-05-09T00:19:53.497193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":31,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"38'3172","reported_seq":3223,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587249+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:19:53.587249+0000","last_peered":"2024-05-09T00:19:53.587249+0000","last_clean":"2024-05-09T00:19:53.587249+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:19:53.587249+0000","last_undegraded":"2024-05-09T00:19:53.587249+0000","last_fullsized":"2024-05-09T00:19:53.587249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46816,"num_write_kb":580338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"38'66","reported_seq":134,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:58.071965+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:18:58.071965+0000","last_peered":"2024-05-09T00:18:58.071965+0000","last_clean":"2024-05-09T00:18:58.071965+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:18:58.071965+0000","last_undegraded":"2024-05-09T00:18:58.071965+0000","last_fullsized":"2024-05-09T00:18:58.071965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":24612,"num_write":55,"num_write_kb":12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2281","reported_seq":2331,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.090946+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:20:00.090946+0000","last_peered":"2024-05-09T00:20:00.090946+0000","last_clean":"2024-05-09T00:20:00.090946+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:20:00.090946+0000","last_undegraded":"2024-05-09T00:20:00.090946+0000","last_fullsized":"2024-05-09T00:20:00.090946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54527679,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":33908,"num_write_kb":416723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"38'1159","reported_seq":1205,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:51.399059+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:18:51.399059+0000","last_peered":"2024-05-09T00:18:51.399059+0000","last_clean":"2024-05-09T00:18:51.399059+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:18:51.399059+0000","last_undegraded":"2024-05-09T00:18:51.399059+0000","last_fullsized":"2024-05-09T00:18:51.399059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1156,"num_write_kb":5131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"38'2810","reported_seq":2865,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.553020+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:19:53.553020+0000","last_peered":"2024-05-09T00:19:53.553020+0000","last_clean":"2024-05-09T00:19:53.553020+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:19:53.553020+0000","last_undegraded":"2024-05-09T00:19:53.553020+0000","last_fullsized":"2024-05-09T00:19:53.553020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":41711,"num_write_kb":539991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"38'19","reported_seq":83,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:55.401540+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:18:55.401540+0000","last_peered":"2024-05-09T00:18:55.401540+0000","last_clean":"2024-05-09T00:18:55.401540+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:18:55.401540+0000","last_undegraded":"2024-05-09T00:18:55.401540+0000","last_fullsized":"2024-05-09T00:18:55.401540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"38'3787","reported_seq":3841,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.861949+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:19:59.861949+0000","last_peered":"2024-05-09T00:19:59.861949+0000","last_clean":"2024-05-09T00:19:59.861949+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:19:59.861949+0000","last_undegraded":"2024-05-09T00:19:59.861949+0000","last_fullsized":"2024-05-09T00:19:59.861949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121707303,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56666,"num_write_kb":717087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"38'128","reported_seq":175,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.581503+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:19:53.581503+0000","last_peered":"2024-05-09T00:19:53.581503+0000","last_clean":"2024-05-09T00:19:53.581503+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:19:53.581503+0000","last_undegraded":"2024-05-09T00:19:53.581503+0000","last_fullsized":"2024-05-09T00:19:53.581503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12967,"num_write":119,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"38'3858","reported_seq":3920,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.611332+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:19:53.611332+0000","last_peered":"2024-05-09T00:19:53.611332+0000","last_clean":"2024-05-09T00:19:53.611332+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:19:53.611332+0000","last_undegraded":"2024-05-09T00:19:53.611332+0000","last_fullsized":"2024-05-09T00:19:53.611332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":57322,"num_write_kb":713128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"38'2889","reported_seq":2942,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.178850+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:20:00.178850+0000","last_peered":"2024-05-09T00:20:00.178850+0000","last_clean":"2024-05-09T00:20:00.178850+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:20:00.178850+0000","last_undegraded":"2024-05-09T00:20:00.178850+0000","last_fullsized":"2024-05-09T00:20:00.178850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62915277,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":43134,"num_write_kb":535156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"38'439","reported_seq":504,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.238469+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:19:55.238469+0000","last_peered":"2024-05-09T00:19:55.238469+0000","last_clean":"2024-05-09T00:19:55.238469+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:19:55.238469+0000","last_undegraded":"2024-05-09T00:19:55.238469+0000","last_fullsized":"2024-05-09T00:19:55.238469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":13833,"num_write":428,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"38'28","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:49.858859+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:18:49.858859+0000","last_peered":"2024-05-09T00:18:49.858859+0000","last_clean":"2024-05-09T00:18:49.858859+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:18:49.858859+0000","last_undegraded":"2024-05-09T00:18:49.858859+0000","last_fullsized":"2024-05-09T00:18:49.858859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":25,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"38'3696","reported_seq":3753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644711+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:19:53.644711+0000","last_peered":"2024-05-09T00:19:53.644711+0000","last_clean":"2024-05-09T00:19:53.644711+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:19:53.644711+0000","last_undegraded":"2024-05-09T00:19:53.644711+0000","last_fullsized":"2024-05-09T00:19:53.644711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54745,"num_write_kb":690364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"38'2633","reported_seq":2687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.741999+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:20:03.741999+0000","last_peered":"2024-05-09T00:20:03.741999+0000","last_clean":"2024-05-09T00:20:03.741999+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:20:03.741999+0000","last_undegraded":"2024-05-09T00:20:03.741999+0000","last_fullsized":"2024-05-09T00:20:03.741999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2633,"log_dups_size":0,"ondisk_log_size":2633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9666,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":39018,"num_write_kb":478044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"38'68","reported_seq":119,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.906828+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:19:59.906828+0000","last_peered":"2024-05-09T00:19:59.906828+0000","last_clean":"2024-05-09T00:19:59.906828+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:19:59.906828+0000","last_undegraded":"2024-05-09T00:19:59.906828+0000","last_fullsized":"2024-05-09T00:19:59.906828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":857849,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563999+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:19:53.563999+0000","last_peered":"2024-05-09T00:19:53.563999+0000","last_clean":"2024-05-09T00:19:53.563999+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:19:53.563999+0000","last_undegraded":"2024-05-09T00:19:53.563999+0000","last_fullsized":"2024-05-09T00:19:53.563999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"38'3606","reported_seq":3668,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542603+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:19:53.542603+0000","last_peered":"2024-05-09T00:19:53.542603+0000","last_clean":"2024-05-09T00:19:53.542603+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:19:53.542603+0000","last_undegraded":"2024-05-09T00:19:53.542603+0000","last_fullsized":"2024-05-09T00:19:53.542603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":53395,"num_write_kb":656713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"38'3269","reported_seq":3321,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.602843+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:20:01.602843+0000","last_peered":"2024-05-09T00:20:01.602843+0000","last_clean":"2024-05-09T00:20:01.602843+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:20:01.602843+0000","last_undegraded":"2024-05-09T00:20:01.602843+0000","last_fullsized":"2024-05-09T00:20:01.602843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3269,"log_dups_size":0,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71316849,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48667,"num_write_kb":618917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.111833+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:18:35.111833+0000","last_peered":"2024-05-09T00:18:35.111833+0000","last_clean":"2024-05-09T00:18:35.111833+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:18:35.111833+0000","last_undegraded":"2024-05-09T00:18:35.111833+0000","last_fullsized":"2024-05-09T00:18:35.111833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"38'114","reported_seq":163,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.599875+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:19:53.599875+0000","last_peered":"2024-05-09T00:19:53.599875+0000","last_clean":"2024-05-09T00:19:53.599875+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:19:53.599875+0000","last_undegraded":"2024-05-09T00:19:53.599875+0000","last_fullsized":"2024-05-09T00:19:53.599875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4101,"num_write":111,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"38'4190","reported_seq":4250,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.571284+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:19:53.571284+0000","last_peered":"2024-05-09T00:19:53.571284+0000","last_clean":"2024-05-09T00:19:53.571284+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:19:53.571284+0000","last_undegraded":"2024-05-09T00:19:53.571284+0000","last_fullsized":"2024-05-09T00:19:53.571284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":62004,"num_write_kb":783810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"38'2898","reported_seq":2952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.678829+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:19:59.678829+0000","last_peered":"2024-05-09T00:19:59.678829+0000","last_clean":"2024-05-09T00:19:59.678829+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:19:59.678829+0000","last_undegraded":"2024-05-09T00:19:59.678829+0000","last_fullsized":"2024-05-09T00:19:59.678829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92286709,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43352,"num_write_kb":534691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'13","reported_seq":65,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:43.263621+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:18:43.263621+0000","last_peered":"2024-05-09T00:18:43.263621+0000","last_clean":"2024-05-09T00:18:43.263621+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:18:43.263621+0000","last_undegraded":"2024-05-09T00:18:43.263621+0000","last_fullsized":"2024-05-09T00:18:43.263621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":10,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"38'17","reported_seq":71,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.603566+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:19:53.603566+0000","last_peered":"2024-05-09T00:19:53.603566+0000","last_clean":"2024-05-09T00:19:53.603566+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:19:53.603566+0000","last_undegraded":"2024-05-09T00:19:53.603566+0000","last_fullsized":"2024-05-09T00:19:53.603566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":8222,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"38'3415","reported_seq":3470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613984+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:19:53.613984+0000","last_peered":"2024-05-09T00:19:53.613984+0000","last_clean":"2024-05-09T00:19:53.613984+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:19:53.613984+0000","last_undegraded":"2024-05-09T00:19:53.613984+0000","last_fullsized":"2024-05-09T00:19:53.613984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":50480,"num_write_kb":654641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"38'2723","reported_seq":2776,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.592620+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:20:01.592620+0000","last_peered":"2024-05-09T00:20:01.592620+0000","last_clean":"2024-05-09T00:20:01.592620+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:20:01.592620+0000","last_undegraded":"2024-05-09T00:20:01.592620+0000","last_fullsized":"2024-05-09T00:20:01.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46144338,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":40204,"num_write_kb":499329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"38'3","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:30.153303+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:19:30.153303+0000","last_peered":"2024-05-09T00:19:30.153303+0000","last_clean":"2024-05-09T00:19:30.153303+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:19:30.153303+0000","last_undegraded":"2024-05-09T00:19:30.153303+0000","last_fullsized":"2024-05-09T00:19:30.153303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'28","reported_seq":100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.191915+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:19:56.191915+0000","last_peered":"2024-05-09T00:19:56.191915+0000","last_clean":"2024-05-09T00:19:56.191915+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:19:56.191915+0000","last_undegraded":"2024-05-09T00:19:56.191915+0000","last_fullsized":"2024-05-09T00:19:56.191915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":103,"num_write":25,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"38'3402","reported_seq":3461,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.564961+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:19:53.564961+0000","last_peered":"2024-05-09T00:19:53.564961+0000","last_clean":"2024-05-09T00:19:53.564961+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:19:53.564961+0000","last_undegraded":"2024-05-09T00:19:53.564961+0000","last_fullsized":"2024-05-09T00:19:53.564961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":50468,"num_write_kb":661545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"38'3238","reported_seq":3290,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.741136+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:20:01.741136+0000","last_peered":"2024-05-09T00:20:01.741136+0000","last_clean":"2024-05-09T00:20:01.741136+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:20:01.741136+0000","last_undegraded":"2024-05-09T00:20:01.741136+0000","last_fullsized":"2024-05-09T00:20:01.741136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3238,"log_dups_size":0,"ondisk_log_size":3238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62915014,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48101,"num_write_kb":593457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"38'279","reported_seq":336,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.115388+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:20:00.115388+0000","last_peered":"2024-05-09T00:20:00.115388+0000","last_clean":"2024-05-09T00:20:00.115388+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:20:00.115388+0000","last_undegraded":"2024-05-09T00:20:00.115388+0000","last_fullsized":"2024-05-09T00:20:00.115388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":56,"num_write":599,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"38'125","reported_seq":173,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.594126+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:19:53.594126+0000","last_peered":"2024-05-09T00:19:53.594126+0000","last_clean":"2024-05-09T00:19:53.594126+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:19:53.594126+0000","last_undegraded":"2024-05-09T00:19:53.594126+0000","last_fullsized":"2024-05-09T00:19:53.594126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":117,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"38'3842","reported_seq":3900,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.481885+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:19:53.481885+0000","last_peered":"2024-05-09T00:19:53.481885+0000","last_clean":"2024-05-09T00:19:53.481885+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:19:53.481885+0000","last_undegraded":"2024-05-09T00:19:53.481885+0000","last_fullsized":"2024-05-09T00:19:53.481885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":57074,"num_write_kb":711138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"38'3167","reported_seq":3221,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.716024+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:19:59.716024+0000","last_peered":"2024-05-09T00:19:59.716024+0000","last_clean":"2024-05-09T00:19:59.716024+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:19:59.716024+0000","last_undegraded":"2024-05-09T00:19:59.716024+0000","last_fullsized":"2024-05-09T00:19:59.716024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104904879,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":47390,"num_write_kb":602470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.094765+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:18:35.094765+0000","last_peered":"2024-05-09T00:18:35.094765+0000","last_clean":"2024-05-09T00:18:35.094765+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:18:35.094765+0000","last_undegraded":"2024-05-09T00:18:35.094765+0000","last_fullsized":"2024-05-09T00:18:35.094765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'1","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063462+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:18:35.063462+0000","last_peered":"2024-05-09T00:18:35.063462+0000","last_clean":"2024-05-09T00:18:35.063462+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:18:35.063462+0000","last_undegraded":"2024-05-09T00:18:35.063462+0000","last_fullsized":"2024-05-09T00:18:35.063462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"38'3423","reported_seq":3485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563559+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:19:53.563559+0000","last_peered":"2024-05-09T00:19:53.563559+0000","last_clean":"2024-05-09T00:19:53.563559+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:19:53.563559+0000","last_undegraded":"2024-05-09T00:19:53.563559+0000","last_fullsized":"2024-05-09T00:19:53.563559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":50760,"num_write_kb":664501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"38'2699","reported_seq":2753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.188951+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:20:00.188951+0000","last_peered":"2024-05-09T00:20:00.188951+0000","last_clean":"2024-05-09T00:20:00.188951+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:20:00.188951+0000","last_undegraded":"2024-05-09T00:20:00.188951+0000","last_fullsized":"2024-05-09T00:20:00.188951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2699,"log_dups_size":0,"ondisk_log_size":2699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83895086,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40249,"num_write_kb":520250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.132892+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:18:35.132892+0000","last_peered":"2024-05-09T00:18:35.132892+0000","last_clean":"2024-05-09T00:18:35.132892+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:18:35.132892+0000","last_undegraded":"2024-05-09T00:18:35.132892+0000","last_fullsized":"2024-05-09T00:18:35.132892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'61","reported_seq":110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.601835+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:19:53.601835+0000","last_peered":"2024-05-09T00:19:53.601835+0000","last_clean":"2024-05-09T00:19:53.601835+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:19:53.601835+0000","last_undegraded":"2024-05-09T00:19:53.601835+0000","last_fullsized":"2024-05-09T00:19:53.601835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18843,"num_write":53,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"38'3161","reported_seq":3218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.561070+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:19:53.561070+0000","last_peered":"2024-05-09T00:19:53.561070+0000","last_clean":"2024-05-09T00:19:53.561070+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:19:53.561070+0000","last_undegraded":"2024-05-09T00:19:53.561070+0000","last_fullsized":"2024-05-09T00:19:53.561070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3161,"log_dups_size":0,"ondisk_log_size":3161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":46450,"num_write_kb":620498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"38'2908","reported_seq":2962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.970047+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:20:01.970047+0000","last_peered":"2024-05-09T00:20:01.970047+0000","last_clean":"2024-05-09T00:20:01.970047+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:20:01.970047+0000","last_undegraded":"2024-05-09T00:20:01.970047+0000","last_fullsized":"2024-05-09T00:20:01.970047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25172849,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43295,"num_write_kb":562205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'30","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:44.055699+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:18:44.055699+0000","last_peered":"2024-05-09T00:18:44.055699+0000","last_clean":"2024-05-09T00:18:44.055699+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:18:44.055699+0000","last_undegraded":"2024-05-09T00:18:44.055699+0000","last_fullsized":"2024-05-09T00:18:44.055699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":25,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"38'5","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569752+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:19:53.569752+0000","last_peered":"2024-05-09T00:19:53.569752+0000","last_clean":"2024-05-09T00:19:53.569752+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:19:53.569752+0000","last_undegraded":"2024-05-09T00:19:53.569752+0000","last_fullsized":"2024-05-09T00:19:53.569752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"38'3104","reported_seq":3159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.529663+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:19:53.529663+0000","last_peered":"2024-05-09T00:19:53.529663+0000","last_clean":"2024-05-09T00:19:53.529663+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:19:53.529663+0000","last_undegraded":"2024-05-09T00:19:53.529663+0000","last_fullsized":"2024-05-09T00:19:53.529663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45747,"num_write_kb":566089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"38'2887","reported_seq":2944,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.168057+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:20:00.168057+0000","last_peered":"2024-05-09T00:20:00.168057+0000","last_clean":"2024-05-09T00:20:00.168057+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:20:00.168057+0000","last_undegraded":"2024-05-09T00:20:00.168057+0000","last_fullsized":"2024-05-09T00:20:00.168057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2887,"log_dups_size":0,"ondisk_log_size":2887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67121752,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42893,"num_write_kb":561201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"38'34","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.303256+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:20:03.303256+0000","last_peered":"2024-05-09T00:20:03.303256+0000","last_clean":"2024-05-09T00:20:03.303256+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:20:03.303256+0000","last_undegraded":"2024-05-09T00:20:03.303256+0000","last_fullsized":"2024-05-09T00:20:03.303256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":106,"num_write":32,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"38'5","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587860+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:19:53.587860+0000","last_peered":"2024-05-09T00:19:53.587860+0000","last_clean":"2024-05-09T00:19:53.587860+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:19:53.587860+0000","last_undegraded":"2024-05-09T00:19:53.587860+0000","last_fullsized":"2024-05-09T00:19:53.587860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"38'3544","reported_seq":3606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580100+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:19:53.580100+0000","last_peered":"2024-05-09T00:19:53.580100+0000","last_clean":"2024-05-09T00:19:53.580100+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:19:53.580100+0000","last_undegraded":"2024-05-09T00:19:53.580100+0000","last_fullsized":"2024-05-09T00:19:53.580100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":1,"num_write":52513,"num_write_kb":669201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"38'2987","reported_seq":3041,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.785255+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:19:59.785255+0000","last_peered":"2024-05-09T00:19:59.785255+0000","last_clean":"2024-05-09T00:19:59.785255+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:19:59.785255+0000","last_undegraded":"2024-05-09T00:19:59.785255+0000","last_fullsized":"2024-05-09T00:19:59.785255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79703100,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44733,"num_write_kb":572857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"35'440","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:42.443246+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:18:42.443246+0000","last_peered":"2024-05-09T00:18:42.443246+0000","last_clean":"2024-05-09T00:18:42.443246+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:18:42.443246+0000","last_undegraded":"2024-05-09T00:18:42.443246+0000","last_fullsized":"2024-05-09T00:18:42.443246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14538,"num_write":435,"num_write_kb":8538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"38'272","reported_seq":320,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.598361+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:19:53.598361+0000","last_peered":"2024-05-09T00:19:53.598361+0000","last_clean":"2024-05-09T00:19:53.598361+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:19:53.598361+0000","last_undegraded":"2024-05-09T00:19:53.598361+0000","last_fullsized":"2024-05-09T00:19:53.598361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":46,"num_write":564,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"38'3750","reported_seq":3813,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.599370+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:19:53.599370+0000","last_peered":"2024-05-09T00:19:53.599370+0000","last_clean":"2024-05-09T00:19:53.599370+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:19:53.599370+0000","last_undegraded":"2024-05-09T00:19:53.599370+0000","last_fullsized":"2024-05-09T00:19:53.599370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":0,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":55664,"num_write_kb":710441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"38'3156","reported_seq":3209,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.600243+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:20:01.600243+0000","last_peered":"2024-05-09T00:20:01.600243+0000","last_clean":"2024-05-09T00:20:01.600243+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:20:01.600243+0000","last_undegraded":"2024-05-09T00:20:01.600243+0000","last_fullsized":"2024-05-09T00:20:01.600243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3156,"log_dups_size":0,"ondisk_log_size":3156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92282908,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":46914,"num_write_kb":587038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.075720+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:18:35.075720+0000","last_peered":"2024-05-09T00:18:35.075720+0000","last_clean":"2024-05-09T00:18:35.075720+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:18:35.075720+0000","last_undegraded":"2024-05-09T00:18:35.075720+0000","last_fullsized":"2024-05-09T00:18:35.075720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.161123+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:18:35.161123+0000","last_peered":"2024-05-09T00:18:35.161123+0000","last_clean":"2024-05-09T00:18:35.161123+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:18:35.161123+0000","last_undegraded":"2024-05-09T00:18:35.161123+0000","last_fullsized":"2024-05-09T00:18:35.161123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'4","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580602+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:19:53.580602+0000","last_peered":"2024-05-09T00:19:53.580602+0000","last_clean":"2024-05-09T00:19:53.580602+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:19:53.580602+0000","last_undegraded":"2024-05-09T00:19:53.580602+0000","last_fullsized":"2024-05-09T00:19:53.580602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"38'3132","reported_seq":3183,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.597376+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:19:53.597376+0000","last_peered":"2024-05-09T00:19:53.597376+0000","last_clean":"2024-05-09T00:19:53.597376+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:19:53.597376+0000","last_undegraded":"2024-05-09T00:19:53.597376+0000","last_fullsized":"2024-05-09T00:19:53.597376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3132,"log_dups_size":0,"ondisk_log_size":3132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46383,"num_write_kb":562908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'2961","reported_seq":3018,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.553083+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:20:00.553083+0000","last_peered":"2024-05-09T00:20:00.553083+0000","last_clean":"2024-05-09T00:20:00.553083+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:20:00.553083+0000","last_undegraded":"2024-05-09T00:20:00.553083+0000","last_fullsized":"2024-05-09T00:20:00.553083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":0,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54623816,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":44152,"num_write_kb":571148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063786+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:18:35.063786+0000","last_peered":"2024-05-09T00:18:35.063786+0000","last_clean":"2024-05-09T00:18:35.063786+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:18:35.063786+0000","last_undegraded":"2024-05-09T00:18:35.063786+0000","last_fullsized":"2024-05-09T00:18:35.063786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"38'173","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.960698+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:19:55.960698+0000","last_peered":"2024-05-09T00:19:55.960698+0000","last_clean":"2024-05-09T00:19:55.960698+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:19:55.960698+0000","last_undegraded":"2024-05-09T00:19:55.960698+0000","last_fullsized":"2024-05-09T00:19:55.960698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146864,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":38,"num_write":167,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"38'3176","reported_seq":3240,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.578160+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:19:53.578160+0000","last_peered":"2024-05-09T00:19:53.578160+0000","last_clean":"2024-05-09T00:19:53.578160+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:19:53.578160+0000","last_undegraded":"2024-05-09T00:19:53.578160+0000","last_fullsized":"2024-05-09T00:19:53.578160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3176,"log_dups_size":0,"ondisk_log_size":3176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":47105,"num_write_kb":619272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"38'3203","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.790954+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:20:01.790954+0000","last_peered":"2024-05-09T00:20:01.790954+0000","last_clean":"2024-05-09T00:20:01.790954+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:20:01.790954+0000","last_undegraded":"2024-05-09T00:20:01.790954+0000","last_fullsized":"2024-05-09T00:20:01.790954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37761822,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":47550,"num_write_kb":594884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"36'17","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:43.556005+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:18:43.556005+0000","last_peered":"2024-05-09T00:18:43.556005+0000","last_clean":"2024-05-09T00:18:43.556005+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:18:43.556005+0000","last_undegraded":"2024-05-09T00:18:43.556005+0000","last_fullsized":"2024-05-09T00:18:43.556005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"38'246","reported_seq":299,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.619084+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:19:53.619084+0000","last_peered":"2024-05-09T00:19:53.619084+0000","last_clean":"2024-05-09T00:19:53.619084+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:19:53.619084+0000","last_undegraded":"2024-05-09T00:19:53.619084+0000","last_fullsized":"2024-05-09T00:19:53.619084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":16394,"num_write":232,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"38'3503","reported_seq":3561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.618310+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:19:53.618310+0000","last_peered":"2024-05-09T00:19:53.618310+0000","last_clean":"2024-05-09T00:19:53.618310+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:19:53.618310+0000","last_undegraded":"2024-05-09T00:19:53.618310+0000","last_fullsized":"2024-05-09T00:19:53.618310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":51910,"num_write_kb":640187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"38'3567","reported_seq":3620,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.794099+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:20:01.794099+0000","last_peered":"2024-05-09T00:20:01.794099+0000","last_clean":"2024-05-09T00:20:01.794099+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:20:01.794099+0000","last_undegraded":"2024-05-09T00:20:01.794099+0000","last_fullsized":"2024-05-09T00:20:01.794099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46145331,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":53051,"num_write_kb":670486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"36'17","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:55.704465+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:18:55.704465+0000","last_peered":"2024-05-09T00:18:55.704465+0000","last_clean":"2024-05-09T00:18:55.704465+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:18:55.704465+0000","last_undegraded":"2024-05-09T00:18:55.704465+0000","last_fullsized":"2024-05-09T00:18:55.704465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":16,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"38'22","reported_seq":67,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.567706+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:19:53.567706+0000","last_peered":"2024-05-09T00:19:53.567706+0000","last_clean":"2024-05-09T00:19:53.567706+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:19:53.567706+0000","last_undegraded":"2024-05-09T00:19:53.567706+0000","last_fullsized":"2024-05-09T00:19:53.567706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":17,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"38'3625","reported_seq":3683,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.482782+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:19:53.482782+0000","last_peered":"2024-05-09T00:19:53.482782+0000","last_clean":"2024-05-09T00:19:53.482782+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:19:53.482782+0000","last_undegraded":"2024-05-09T00:19:53.482782+0000","last_fullsized":"2024-05-09T00:19:53.482782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53630,"num_write_kb":693205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"38'2877","reported_seq":2932,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.187835+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:20:00.187835+0000","last_peered":"2024-05-09T00:20:00.187835+0000","last_clean":"2024-05-09T00:20:00.187835+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:20:00.187835+0000","last_undegraded":"2024-05-09T00:20:00.187835+0000","last_fullsized":"2024-05-09T00:20:00.187835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88276698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42970,"num_write_kb":541677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"38'135","reported_seq":192,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.424244+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:19:55.424244+0000","last_peered":"2024-05-09T00:19:55.424244+0000","last_clean":"2024-05-09T00:19:55.424244+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:19:55.424244+0000","last_undegraded":"2024-05-09T00:19:55.424244+0000","last_fullsized":"2024-05-09T00:19:55.424244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":134,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"38'3","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587165+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:19:53.587165+0000","last_peered":"2024-05-09T00:19:53.587165+0000","last_clean":"2024-05-09T00:19:53.587165+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:19:53.587165+0000","last_undegraded":"2024-05-09T00:19:53.587165+0000","last_fullsized":"2024-05-09T00:19:53.587165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"38'3203","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.625765+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:19:53.625765+0000","last_peered":"2024-05-09T00:19:53.625765+0000","last_clean":"2024-05-09T00:19:53.625765+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:19:53.625765+0000","last_undegraded":"2024-05-09T00:19:53.625765+0000","last_fullsized":"2024-05-09T00:19:53.625765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47433,"num_write_kb":581618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"38'2964","reported_seq":3019,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.789567+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:19:59.789567+0000","last_peered":"2024-05-09T00:19:59.789567+0000","last_clean":"2024-05-09T00:19:59.789567+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:19:59.789567+0000","last_undegraded":"2024-05-09T00:19:59.789567+0000","last_fullsized":"2024-05-09T00:19:59.789567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2964,"log_dups_size":0,"ondisk_log_size":2964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88106690,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":44134,"num_write_kb":579264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:57.989319+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:18:57.989319+0000","last_peered":"2024-05-09T00:18:57.989319+0000","last_clean":"2024-05-09T00:18:57.989319+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:18:57.989319+0000","last_undegraded":"2024-05-09T00:18:57.989319+0000","last_fullsized":"2024-05-09T00:18:57.989319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"38'4","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588611+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:19:53.588611+0000","last_peered":"2024-05-09T00:19:53.588611+0000","last_clean":"2024-05-09T00:19:53.588611+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:19:53.588611+0000","last_undegraded":"2024-05-09T00:19:53.588611+0000","last_fullsized":"2024-05-09T00:19:53.588611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"38'3658","reported_seq":3715,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.575409+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:19:53.575409+0000","last_peered":"2024-05-09T00:19:53.575409+0000","last_clean":"2024-05-09T00:19:53.575409+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:19:53.575409+0000","last_undegraded":"2024-05-09T00:19:53.575409+0000","last_fullsized":"2024-05-09T00:19:53.575409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54120,"num_write_kb":669829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"38'3290","reported_seq":3346,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.164126+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:20:00.164126+0000","last_peered":"2024-05-09T00:20:00.164126+0000","last_clean":"2024-05-09T00:20:00.164126+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:20:00.164126+0000","last_undegraded":"2024-05-09T00:20:00.164126+0000","last_fullsized":"2024-05-09T00:20:00.164126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104876303,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":48939,"num_write_kb":615876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'2","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.098051+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:18:35.098051+0000","last_peered":"2024-05-09T00:18:35.098051+0000","last_clean":"2024-05-09T00:18:35.098051+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:18:35.098051+0000","last_undegraded":"2024-05-09T00:18:35.098051+0000","last_fullsized":"2024-05-09T00:18:35.098051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:45.156335+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:19:45.156335+0000","last_peered":"2024-05-09T00:19:45.156335+0000","last_clean":"2024-05-09T00:19:45.156335+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:19:45.156335+0000","last_undegraded":"2024-05-09T00:19:45.156335+0000","last_fullsized":"2024-05-09T00:19:45.156335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"38'3403","reported_seq":3462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.514767+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:19:52.514767+0000","last_peered":"2024-05-09T00:19:52.514767+0000","last_clean":"2024-05-09T00:19:52.514767+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:19:52.514767+0000","last_undegraded":"2024-05-09T00:19:52.514767+0000","last_fullsized":"2024-05-09T00:19:52.514767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":50653,"num_write_kb":630818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'3516","reported_seq":3571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.115705+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:20:00.115705+0000","last_peered":"2024-05-09T00:20:00.115705+0000","last_clean":"2024-05-09T00:20:00.115705+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:20:00.115705+0000","last_undegraded":"2024-05-09T00:20:00.115705+0000","last_fullsized":"2024-05-09T00:20:00.115705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3516,"log_dups_size":0,"ondisk_log_size":3516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96479486,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":52591,"num_write_kb":653340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'1","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.069523+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:18:35.069523+0000","last_peered":"2024-05-09T00:18:35.069523+0000","last_clean":"2024-05-09T00:18:35.069523+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:18:35.069523+0000","last_undegraded":"2024-05-09T00:18:35.069523+0000","last_fullsized":"2024-05-09T00:18:35.069523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"38'235","reported_seq":303,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586376+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:19:53.586376+0000","last_peered":"2024-05-09T00:19:53.586376+0000","last_clean":"2024-05-09T00:19:53.586376+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:19:53.586376+0000","last_undegraded":"2024-05-09T00:19:53.586376+0000","last_fullsized":"2024-05-09T00:19:53.586376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":16430,"num_write":226,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"38'4717","reported_seq":4780,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542790+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:19:53.542790+0000","last_peered":"2024-05-09T00:19:53.542790+0000","last_clean":"2024-05-09T00:19:53.542790+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:19:53.542790+0000","last_undegraded":"2024-05-09T00:19:53.542790+0000","last_fullsized":"2024-05-09T00:19:53.542790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":69946,"num_write_kb":894340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"38'2876","reported_seq":2932,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.703135+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:19:59.703135+0000","last_peered":"2024-05-09T00:19:59.703135+0000","last_clean":"2024-05-09T00:19:59.703135+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:19:59.703135+0000","last_undegraded":"2024-05-09T00:19:59.703135+0000","last_fullsized":"2024-05-09T00:19:59.703135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2876,"log_dups_size":0,"ondisk_log_size":2876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100669385,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42818,"num_write_kb":549063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"35'194","reported_seq":260,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:42.698385+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:18:42.698385+0000","last_peered":"2024-05-09T00:18:42.698385+0000","last_clean":"2024-05-09T00:18:42.698385+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:18:42.698385+0000","last_undegraded":"2024-05-09T00:18:42.698385+0000","last_fullsized":"2024-05-09T00:18:42.698385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":12336,"num_write":190,"num_write_kb":8288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"38'20","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:54.377021+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:19:54.377021+0000","last_peered":"2024-05-09T00:19:54.377021+0000","last_clean":"2024-05-09T00:19:54.377021+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:19:54.377021+0000","last_undegraded":"2024-05-09T00:19:54.377021+0000","last_fullsized":"2024-05-09T00:19:54.377021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"38'4177","reported_seq":4234,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627752+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:19:53.627752+0000","last_peered":"2024-05-09T00:19:53.627752+0000","last_clean":"2024-05-09T00:19:53.627752+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:19:53.627752+0000","last_undegraded":"2024-05-09T00:19:53.627752+0000","last_fullsized":"2024-05-09T00:19:53.627752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":61984,"num_write_kb":766120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"38'2845","reported_seq":2897,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.155802+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:20:02.155802+0000","last_peered":"2024-05-09T00:20:02.155802+0000","last_clean":"2024-05-09T00:20:02.155802+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:20:02.155802+0000","last_undegraded":"2024-05-09T00:20:02.155802+0000","last_fullsized":"2024-05-09T00:20:02.155802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":42226,"num_write_kb":541614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"38'236","reported_seq":317,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:51.536810+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:19:51.536810+0000","last_peered":"2024-05-09T00:19:51.536810+0000","last_clean":"2024-05-09T00:19:51.536810+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:19:51.536810+0000","last_undegraded":"2024-05-09T00:19:51.536810+0000","last_fullsized":"2024-05-09T00:19:51.536810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":55,"num_read_kb":20534,"num_write":231,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628479+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:19:53.628479+0000","last_peered":"2024-05-09T00:19:53.628479+0000","last_clean":"2024-05-09T00:19:53.628479+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:19:53.628479+0000","last_undegraded":"2024-05-09T00:19:53.628479+0000","last_fullsized":"2024-05-09T00:19:53.628479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"38'3435","reported_seq":3490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.349109+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:19:53.349109+0000","last_peered":"2024-05-09T00:19:53.349109+0000","last_clean":"2024-05-09T00:19:53.349109+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:19:53.349109+0000","last_undegraded":"2024-05-09T00:19:53.349109+0000","last_fullsized":"2024-05-09T00:19:53.349109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":50796,"num_write_kb":644347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"38'4114","reported_seq":4168,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.541172+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:20:00.541172+0000","last_peered":"2024-05-09T00:20:00.541172+0000","last_clean":"2024-05-09T00:20:00.541172+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:20:00.541172+0000","last_undegraded":"2024-05-09T00:20:00.541172+0000","last_fullsized":"2024-05-09T00:20:00.541172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100863558,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":61418,"num_write_kb":763576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"38'19","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.242855+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:19:55.242855+0000","last_peered":"2024-05-09T00:19:55.242855+0000","last_clean":"2024-05-09T00:19:55.242855+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:19:55.242855+0000","last_undegraded":"2024-05-09T00:19:55.242855+0000","last_fullsized":"2024-05-09T00:19:55.242855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"38'47","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.605921+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:19:53.605921+0000","last_peered":"2024-05-09T00:19:53.605921+0000","last_clean":"2024-05-09T00:19:53.605921+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:19:53.605921+0000","last_undegraded":"2024-05-09T00:19:53.605921+0000","last_fullsized":"2024-05-09T00:19:53.605921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20520,"num_write":39,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"38'3630","reported_seq":3687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.617924+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:19:53.617924+0000","last_peered":"2024-05-09T00:19:53.617924+0000","last_clean":"2024-05-09T00:19:53.617924+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:19:53.617924+0000","last_undegraded":"2024-05-09T00:19:53.617924+0000","last_fullsized":"2024-05-09T00:19:53.617924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53585,"num_write_kb":685544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"38'2733","reported_seq":2790,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.050786+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:20:00.050786+0000","last_peered":"2024-05-09T00:20:00.050786+0000","last_clean":"2024-05-09T00:20:00.050786+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:20:00.050786+0000","last_undegraded":"2024-05-09T00:20:00.050786+0000","last_fullsized":"2024-05-09T00:20:00.050786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62970340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":40562,"num_write_kb":508970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"38'1","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.097987+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:18:35.097987+0000","last_peered":"2024-05-09T00:18:35.097987+0000","last_clean":"2024-05-09T00:18:35.097987+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:18:35.097987+0000","last_undegraded":"2024-05-09T00:18:35.097987+0000","last_fullsized":"2024-05-09T00:18:35.097987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"38'11","reported_seq":81,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569722+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:19:53.569722+0000","last_peered":"2024-05-09T00:19:53.569722+0000","last_clean":"2024-05-09T00:19:53.569722+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:19:53.569722+0000","last_undegraded":"2024-05-09T00:19:53.569722+0000","last_fullsized":"2024-05-09T00:19:53.569722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"38'3942","reported_seq":4002,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615803+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:19:53.615803+0000","last_peered":"2024-05-09T00:19:53.615803+0000","last_clean":"2024-05-09T00:19:53.615803+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:19:53.615803+0000","last_undegraded":"2024-05-09T00:19:53.615803+0000","last_fullsized":"2024-05-09T00:19:53.615803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":58547,"num_write_kb":727316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"38'3053","reported_seq":3110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.661243+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:20:00.661243+0000","last_peered":"2024-05-09T00:20:00.661243+0000","last_clean":"2024-05-09T00:20:00.661243+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:20:00.661243+0000","last_undegraded":"2024-05-09T00:20:00.661243+0000","last_fullsized":"2024-05-09T00:20:00.661243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3053,"log_dups_size":0,"ondisk_log_size":3053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58960980,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":45237,"num_write_kb":566177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"38'2","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.208150+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:18:35.208150+0000","last_peered":"2024-05-09T00:18:35.208150+0000","last_clean":"2024-05-09T00:18:35.208150+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:18:35.208150+0000","last_undegraded":"2024-05-09T00:18:35.208150+0000","last_fullsized":"2024-05-09T00:18:35.208150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"38'6","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.595949+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:19:53.595949+0000","last_peered":"2024-05-09T00:19:53.595949+0000","last_clean":"2024-05-09T00:19:53.595949+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:19:53.595949+0000","last_undegraded":"2024-05-09T00:19:53.595949+0000","last_fullsized":"2024-05-09T00:19:53.595949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4386","reported_seq":4443,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.608899+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:19:53.608899+0000","last_peered":"2024-05-09T00:19:53.608899+0000","last_clean":"2024-05-09T00:19:53.608899+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:19:53.608899+0000","last_undegraded":"2024-05-09T00:19:53.608899+0000","last_fullsized":"2024-05-09T00:19:53.608899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4386,"log_dups_size":0,"ondisk_log_size":4386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":64971,"num_write_kb":841081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"38'49","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586220+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:19:53.586220+0000","last_peered":"2024-05-09T00:19:53.586220+0000","last_clean":"2024-05-09T00:19:53.586220+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:19:53.586220+0000","last_undegraded":"2024-05-09T00:19:53.586220+0000","last_fullsized":"2024-05-09T00:19:53.586220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":42,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"38'3542","reported_seq":3598,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.506333+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:20:01.506333+0000","last_peered":"2024-05-09T00:20:01.506333+0000","last_clean":"2024-05-09T00:20:01.506333+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:20:01.506333+0000","last_undegraded":"2024-05-09T00:20:01.506333+0000","last_fullsized":"2024-05-09T00:20:01.506333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79738804,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":52831,"num_write_kb":662790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"36'39","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:45.381505+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:18:45.381505+0000","last_peered":"2024-05-09T00:18:45.381505+0000","last_clean":"2024-05-09T00:18:45.381505+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:18:45.381505+0000","last_undegraded":"2024-05-09T00:18:45.381505+0000","last_fullsized":"2024-05-09T00:18:45.381505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":36,"num_write_kb":8217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3892","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.486914+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:19:53.486914+0000","last_peered":"2024-05-09T00:19:53.486914+0000","last_clean":"2024-05-09T00:19:53.486914+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:19:53.486914+0000","last_undegraded":"2024-05-09T00:19:53.486914+0000","last_fullsized":"2024-05-09T00:19:53.486914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":57751,"num_write_kb":734560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"30'34","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:02.237009+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:19:02.237009+0000","last_peered":"2024-05-09T00:19:02.237009+0000","last_clean":"2024-05-09T00:19:02.237009+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:19:02.237009+0000","last_undegraded":"2024-05-09T00:19:02.237009+0000","last_fullsized":"2024-05-09T00:19:02.237009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":16404,"num_write":31,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2961","reported_seq":3016,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.611974+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:20:00.611974+0000","last_peered":"2024-05-09T00:20:00.611974+0000","last_clean":"2024-05-09T00:20:00.611974+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:20:00.611974+0000","last_undegraded":"2024-05-09T00:20:00.611974+0000","last_fullsized":"2024-05-09T00:20:00.611974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":0,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67129429,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":43943,"num_write_kb":568639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"38'3","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.056421+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:18:35.056421+0000","last_peered":"2024-05-09T00:18:35.056421+0000","last_clean":"2024-05-09T00:18:35.056421+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:18:35.056421+0000","last_undegraded":"2024-05-09T00:18:35.056421+0000","last_fullsized":"2024-05-09T00:18:35.056421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"38'4410","reported_seq":4472,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.562323+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:19:53.562323+0000","last_peered":"2024-05-09T00:19:53.562323+0000","last_clean":"2024-05-09T00:19:53.562323+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:19:53.562323+0000","last_undegraded":"2024-05-09T00:19:53.562323+0000","last_fullsized":"2024-05-09T00:19:53.562323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":65571,"num_write_kb":822347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"38'27","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.376578+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:18:41.376578+0000","last_peered":"2024-05-09T00:18:41.376578+0000","last_clean":"2024-05-09T00:18:41.376578+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:18:41.376578+0000","last_undegraded":"2024-05-09T00:18:41.376578+0000","last_fullsized":"2024-05-09T00:18:41.376578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2394","reported_seq":2444,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.352199+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:20:01.352199+0000","last_peered":"2024-05-09T00:20:01.352199+0000","last_clean":"2024-05-09T00:20:01.352199+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:20:01.352199+0000","last_undegraded":"2024-05-09T00:20:01.352199+0000","last_fullsized":"2024-05-09T00:20:01.352199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2394,"log_dups_size":0,"ondisk_log_size":2394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62920999,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":35567,"num_write_kb":447799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"38'20","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:05.503439+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:19:05.503439+0000","last_peered":"2024-05-09T00:19:05.503439+0000","last_clean":"2024-05-09T00:19:05.503439+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:19:05.503439+0000","last_undegraded":"2024-05-09T00:19:05.503439+0000","last_fullsized":"2024-05-09T00:19:05.503439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2608","reported_seq":2664,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.505925+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:19:53.505925+0000","last_peered":"2024-05-09T00:19:53.505925+0000","last_clean":"2024-05-09T00:19:53.505925+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:19:53.505925+0000","last_undegraded":"2024-05-09T00:19:53.505925+0000","last_fullsized":"2024-05-09T00:19:53.505925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2608,"log_dups_size":0,"ondisk_log_size":2608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":38767,"num_write_kb":481995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1146","reported_seq":1201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.185803+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:18:41.185803+0000","last_peered":"2024-05-09T00:18:41.185803+0000","last_clean":"2024-05-09T00:18:41.185803+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:18:41.185803+0000","last_undegraded":"2024-05-09T00:18:41.185803+0000","last_fullsized":"2024-05-09T00:18:41.185803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1144,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2573","reported_seq":2624,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.881787+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:19:59.881787+0000","last_peered":"2024-05-09T00:19:59.881787+0000","last_clean":"2024-05-09T00:19:59.881787+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:19:59.881787+0000","last_undegraded":"2024-05-09T00:19:59.881787+0000","last_fullsized":"2024-05-09T00:19:59.881787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2573,"log_dups_size":0,"ondisk_log_size":2573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88103258,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":38306,"num_write_kb":482954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"38'91","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.576346+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:19:53.576346+0000","last_peered":"2024-05-09T00:19:53.576346+0000","last_clean":"2024-05-09T00:19:53.576346+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:19:53.576346+0000","last_undegraded":"2024-05-09T00:19:53.576346+0000","last_fullsized":"2024-05-09T00:19:53.576346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":30171,"num_write":78,"num_write_kb":12339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"38'3350","reported_seq":3396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588764+0000","last_change":"2024-05-09T00:09:31.619347+0000","last_active":"2024-05-09T00:19:53.588764+0000","last_peered":"2024-05-09T00:19:53.588764+0000","last_clean":"2024-05-09T00:19:53.588764+0000","last_became_active":"2024-05-09T00:09:31.617773+0000","last_became_peered":"2024-05-09T00:09:31.617773+0000","last_unstale":"2024-05-09T00:19:53.588764+0000","last_undegraded":"2024-05-09T00:19:53.588764+0000","last_fullsized":"2024-05-09T00:19:53.588764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:19.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":49731,"num_write_kb":622162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"38'3780","reported_seq":3833,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.564087+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:20:00.564087+0000","last_peered":"2024-05-09T00:20:00.564087+0000","last_clean":"2024-05-09T00:20:00.564087+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:20:00.564087+0000","last_undegraded":"2024-05-09T00:20:00.564087+0000","last_fullsized":"2024-05-09T00:20:00.564087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104860365,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56510,"num_write_kb":719929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"38'4248","reported_seq":4304,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629876+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:19:53.629876+0000","last_peered":"2024-05-09T00:19:53.629876+0000","last_clean":"2024-05-09T00:19:53.629876+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:19:53.629876+0000","last_undegraded":"2024-05-09T00:19:53.629876+0000","last_fullsized":"2024-05-09T00:19:53.629876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":62726,"num_write_kb":786275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"38'3362","reported_seq":3413,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.748866+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:20:03.748866+0000","last_peered":"2024-05-09T00:20:03.748866+0000","last_clean":"2024-05-09T00:20:03.748866+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:20:03.748866+0000","last_undegraded":"2024-05-09T00:20:03.748866+0000","last_fullsized":"2024-05-09T00:20:03.748866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":49795,"num_write_kb":622024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"38'3281","reported_seq":3337,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563941+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:19:53.563941+0000","last_peered":"2024-05-09T00:19:53.563941+0000","last_clean":"2024-05-09T00:19:53.563941+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:19:53.563941+0000","last_undegraded":"2024-05-09T00:19:53.563941+0000","last_fullsized":"2024-05-09T00:19:53.563941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":48739,"num_write_kb":615858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"38'3779","reported_seq":3832,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.990627+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:19:59.990627+0000","last_peered":"2024-05-09T00:19:59.990627+0000","last_clean":"2024-05-09T00:19:59.990627+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:19:59.990627+0000","last_undegraded":"2024-05-09T00:19:59.990627+0000","last_fullsized":"2024-05-09T00:19:59.990627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3779,"log_dups_size":0,"ondisk_log_size":3779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121645455,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":56354,"num_write_kb":712291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"38'3855","reported_seq":3921,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.454978+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:19:53.454978+0000","last_peered":"2024-05-09T00:19:53.454978+0000","last_clean":"2024-05-09T00:19:53.454978+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:19:53.454978+0000","last_undegraded":"2024-05-09T00:19:53.454978+0000","last_fullsized":"2024-05-09T00:19:53.454978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":57187,"num_write_kb":738779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"38'2575","reported_seq":2630,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.619381+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:20:00.619381+0000","last_peered":"2024-05-09T00:20:00.619381+0000","last_clean":"2024-05-09T00:20:00.619381+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:20:00.619381+0000","last_undegraded":"2024-05-09T00:20:00.619381+0000","last_fullsized":"2024-05-09T00:20:00.619381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79693826,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":38405,"num_write_kb":503771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"38'4370","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.526382+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:19:53.526382+0000","last_peered":"2024-05-09T00:19:53.526382+0000","last_clean":"2024-05-09T00:19:53.526382+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:19:53.526382+0000","last_undegraded":"2024-05-09T00:19:53.526382+0000","last_fullsized":"2024-05-09T00:19:53.526382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":64728,"num_write_kb":825535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"38'2737","reported_seq":2789,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.609580+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:19:59.609580+0000","last_peered":"2024-05-09T00:19:59.609580+0000","last_clean":"2024-05-09T00:19:59.609580+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:19:59.609580+0000","last_undegraded":"2024-05-09T00:19:59.609580+0000","last_fullsized":"2024-05-09T00:19:59.609580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88110052,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40705,"num_write_kb":512798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"38'3218","reported_seq":3281,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.602708+0000","last_change":"2024-05-09T00:09:31.551214+0000","last_active":"2024-05-09T00:19:53.602708+0000","last_peered":"2024-05-09T00:19:53.602708+0000","last_clean":"2024-05-09T00:19:53.602708+0000","last_became_active":"2024-05-09T00:09:31.550552+0000","last_became_peered":"2024-05-09T00:09:31.550552+0000","last_unstale":"2024-05-09T00:19:53.602708+0000","last_undegraded":"2024-05-09T00:19:53.602708+0000","last_fullsized":"2024-05-09T00:19:53.602708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:09.658798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":47610,"num_write_kb":596071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"38'3259","reported_seq":3310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.638677+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:19:59.638677+0000","last_peered":"2024-05-09T00:19:59.638677+0000","last_clean":"2024-05-09T00:19:59.638677+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:19:59.638677+0000","last_undegraded":"2024-05-09T00:19:59.638677+0000","last_fullsized":"2024-05-09T00:19:59.638677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3259,"log_dups_size":0,"ondisk_log_size":3259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88081110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":48606,"num_write_kb":610539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"38'4466","reported_seq":4526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613481+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:19:53.613481+0000","last_peered":"2024-05-09T00:19:53.613481+0000","last_clean":"2024-05-09T00:19:53.613481+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:19:53.613481+0000","last_undegraded":"2024-05-09T00:19:53.613481+0000","last_fullsized":"2024-05-09T00:19:53.613481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":66102,"num_write_kb":855861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"38'2887","reported_seq":2939,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.569147+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:20:00.569147+0000","last_peered":"2024-05-09T00:20:00.569147+0000","last_clean":"2024-05-09T00:20:00.569147+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:20:00.569147+0000","last_undegraded":"2024-05-09T00:20:00.569147+0000","last_fullsized":"2024-05-09T00:20:00.569147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2887,"log_dups_size":0,"ondisk_log_size":2887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105284448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":43055,"num_write_kb":548362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"38'3894","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.348618+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:19:53.348618+0000","last_peered":"2024-05-09T00:19:53.348618+0000","last_clean":"2024-05-09T00:19:53.348618+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:19:53.348618+0000","last_undegraded":"2024-05-09T00:19:53.348618+0000","last_fullsized":"2024-05-09T00:19:53.348618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":57917,"num_write_kb":734296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"38'3579","reported_seq":3635,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.903073+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:19:59.903073+0000","last_peered":"2024-05-09T00:19:59.903073+0000","last_clean":"2024-05-09T00:19:59.903073+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:19:59.903073+0000","last_undegraded":"2024-05-09T00:19:59.903073+0000","last_fullsized":"2024-05-09T00:19:59.903073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3579,"log_dups_size":0,"ondisk_log_size":3579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121685034,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":53538,"num_write_kb":689167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"38'3075","reported_seq":3129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627461+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:19:53.627461+0000","last_peered":"2024-05-09T00:19:53.627461+0000","last_clean":"2024-05-09T00:19:53.627461+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:19:53.627461+0000","last_undegraded":"2024-05-09T00:19:53.627461+0000","last_fullsized":"2024-05-09T00:19:53.627461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45134,"num_write_kb":543879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"38'2766","reported_seq":2818,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.116179+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:20:00.116179+0000","last_peered":"2024-05-09T00:20:00.116179+0000","last_clean":"2024-05-09T00:20:00.116179+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:20:00.116179+0000","last_undegraded":"2024-05-09T00:20:00.116179+0000","last_fullsized":"2024-05-09T00:20:00.116179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67113963,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":41135,"num_write_kb":511430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"38'4375","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.541127+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:19:53.541127+0000","last_peered":"2024-05-09T00:19:53.541127+0000","last_clean":"2024-05-09T00:19:53.541127+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:19:53.541127+0000","last_undegraded":"2024-05-09T00:19:53.541127+0000","last_fullsized":"2024-05-09T00:19:53.541127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":64891,"num_write_kb":820909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"38'2997","reported_seq":3051,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.598575+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:20:00.598575+0000","last_peered":"2024-05-09T00:20:00.598575+0000","last_clean":"2024-05-09T00:20:00.598575+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:20:00.598575+0000","last_undegraded":"2024-05-09T00:20:00.598575+0000","last_fullsized":"2024-05-09T00:20:00.598575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2997,"log_dups_size":0,"ondisk_log_size":2997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67176152,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44637,"num_write_kb":570209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"38'3563","reported_seq":3621,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.600582+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:19:53.600582+0000","last_peered":"2024-05-09T00:19:53.600582+0000","last_clean":"2024-05-09T00:19:53.600582+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:19:53.600582+0000","last_undegraded":"2024-05-09T00:19:53.600582+0000","last_fullsized":"2024-05-09T00:19:53.600582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":52470,"num_write_kb":678263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"38'3348","reported_seq":3401,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.640957+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:20:00.640957+0000","last_peered":"2024-05-09T00:20:00.640957+0000","last_clean":"2024-05-09T00:20:00.640957+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:20:00.640957+0000","last_undegraded":"2024-05-09T00:20:00.640957+0000","last_fullsized":"2024-05-09T00:20:00.640957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3348,"log_dups_size":0,"ondisk_log_size":3348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79697922,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":49832,"num_write_kb":630819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"38'3672","reported_seq":3731,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627538+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:19:53.627538+0000","last_peered":"2024-05-09T00:19:53.627538+0000","last_clean":"2024-05-09T00:19:53.627538+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:19:53.627538+0000","last_undegraded":"2024-05-09T00:19:53.627538+0000","last_fullsized":"2024-05-09T00:19:53.627538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":54179,"num_write_kb":674825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"38'3206","reported_seq":3264,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.686178+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:20:01.686178+0000","last_peered":"2024-05-09T00:20:01.686178+0000","last_clean":"2024-05-09T00:20:01.686178+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:20:01.686178+0000","last_undegraded":"2024-05-09T00:20:01.686178+0000","last_fullsized":"2024-05-09T00:20:01.686178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3206,"log_dups_size":0,"ondisk_log_size":3206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41955725,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":47595,"num_write_kb":602581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"38'3892","reported_seq":3952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586501+0000","last_change":"2024-05-09T00:09:31.545900+0000","last_active":"2024-05-09T00:19:53.586501+0000","last_peered":"2024-05-09T00:19:53.586501+0000","last_clean":"2024-05-09T00:19:53.586501+0000","last_became_active":"2024-05-09T00:09:31.545211+0000","last_became_peered":"2024-05-09T00:09:31.545211+0000","last_unstale":"2024-05-09T00:19:53.586501+0000","last_undegraded":"2024-05-09T00:19:53.586501+0000","last_fullsized":"2024-05-09T00:19:53.586501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:58.479930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":57743,"num_write_kb":746959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"38'2999","reported_seq":3050,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.935933+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:20:01.935933+0000","last_peered":"2024-05-09T00:20:01.935933+0000","last_clean":"2024-05-09T00:20:01.935933+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:20:01.935933+0000","last_undegraded":"2024-05-09T00:20:01.935933+0000","last_fullsized":"2024-05-09T00:20:01.935933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2999,"log_dups_size":0,"ondisk_log_size":2999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20976898,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":44584,"num_write_kb":561827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"38'3782","reported_seq":3841,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615033+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:19:53.615033+0000","last_peered":"2024-05-09T00:19:53.615033+0000","last_clean":"2024-05-09T00:19:53.615033+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:19:53.615033+0000","last_undegraded":"2024-05-09T00:19:53.615033+0000","last_fullsized":"2024-05-09T00:19:53.615033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3782,"log_dups_size":0,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":56061,"num_write_kb":704361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"38'3120","reported_seq":3171,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.126162+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:20:00.126162+0000","last_peered":"2024-05-09T00:20:00.126162+0000","last_clean":"2024-05-09T00:20:00.126162+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:20:00.126162+0000","last_undegraded":"2024-05-09T00:20:00.126162+0000","last_fullsized":"2024-05-09T00:20:00.126162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3120,"log_dups_size":0,"ondisk_log_size":3120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88127468,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":46597,"num_write_kb":572561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"38'3200","reported_seq":3255,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644724+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:19:53.644724+0000","last_peered":"2024-05-09T00:19:53.644724+0000","last_clean":"2024-05-09T00:19:53.644724+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:19:53.644724+0000","last_undegraded":"2024-05-09T00:19:53.644724+0000","last_fullsized":"2024-05-09T00:19:53.644724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47638,"num_write_kb":598134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"38'2546","reported_seq":2606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.042585+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:20:04.042585+0000","last_peered":"2024-05-09T00:20:04.042585+0000","last_clean":"2024-05-09T00:20:04.042585+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:20:04.042585+0000","last_undegraded":"2024-05-09T00:20:04.042585+0000","last_fullsized":"2024-05-09T00:20:04.042585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":37361,"num_write_kb":466647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"38'3628","reported_seq":3685,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.341019+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:19:53.341019+0000","last_peered":"2024-05-09T00:19:53.341019+0000","last_clean":"2024-05-09T00:19:53.341019+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:19:53.341019+0000","last_undegraded":"2024-05-09T00:19:53.341019+0000","last_fullsized":"2024-05-09T00:19:53.341019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53577,"num_write_kb":665989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"38'3739","reported_seq":3795,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.166579+0000","last_change":"2024-05-09T00:09:31.551757+0000","last_active":"2024-05-09T00:20:00.166579+0000","last_peered":"2024-05-09T00:20:00.166579+0000","last_clean":"2024-05-09T00:20:00.166579+0000","last_became_active":"2024-05-09T00:09:31.551042+0000","last_became_peered":"2024-05-09T00:09:31.551042+0000","last_unstale":"2024-05-09T00:20:00.166579+0000","last_undegraded":"2024-05-09T00:20:00.166579+0000","last_fullsized":"2024-05-09T00:20:00.166579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:57.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121724226,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":55697,"num_write_kb":713868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"38'4117","reported_seq":4177,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.562024+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:19:53.562024+0000","last_peered":"2024-05-09T00:19:53.562024+0000","last_clean":"2024-05-09T00:19:53.562024+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:19:53.562024+0000","last_undegraded":"2024-05-09T00:19:53.562024+0000","last_fullsized":"2024-05-09T00:19:53.562024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":60808,"num_write_kb":797910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"38'2671","reported_seq":2723,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.037302+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:20:00.037302+0000","last_peered":"2024-05-09T00:20:00.037302+0000","last_clean":"2024-05-09T00:20:00.037302+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:20:00.037302+0000","last_undegraded":"2024-05-09T00:20:00.037302+0000","last_fullsized":"2024-05-09T00:20:00.037302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2671,"log_dups_size":0,"ondisk_log_size":2671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79741553,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":39829,"num_write_kb":524211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"38'4344","reported_seq":4407,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.471990+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:19:53.471990+0000","last_peered":"2024-05-09T00:19:53.471990+0000","last_clean":"2024-05-09T00:19:53.471990+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:19:53.471990+0000","last_undegraded":"2024-05-09T00:19:53.471990+0000","last_fullsized":"2024-05-09T00:19:53.471990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":64402,"num_write_kb":850383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"38'3007","reported_seq":3064,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.049229+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:20:00.049229+0000","last_peered":"2024-05-09T00:20:00.049229+0000","last_clean":"2024-05-09T00:20:00.049229+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:20:00.049229+0000","last_undegraded":"2024-05-09T00:20:00.049229+0000","last_fullsized":"2024-05-09T00:20:00.049229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96473039,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":44802,"num_write_kb":567733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"38'3034","reported_seq":3091,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.547327+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:19:53.547327+0000","last_peered":"2024-05-09T00:19:53.547327+0000","last_clean":"2024-05-09T00:19:53.547327+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:19:53.547327+0000","last_undegraded":"2024-05-09T00:19:53.547327+0000","last_fullsized":"2024-05-09T00:19:53.547327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":44931,"num_write_kb":564239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"38'2937","reported_seq":2993,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.666721+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:19:59.666721+0000","last_peered":"2024-05-09T00:19:59.666721+0000","last_clean":"2024-05-09T00:19:59.666721+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:19:59.666721+0000","last_undegraded":"2024-05-09T00:19:59.666721+0000","last_fullsized":"2024-05-09T00:19:59.666721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104934297,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":43707,"num_write_kb":568620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"38'3544","reported_seq":3601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.437269+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:19:53.437269+0000","last_peered":"2024-05-09T00:19:53.437269+0000","last_clean":"2024-05-09T00:19:53.437269+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:19:53.437269+0000","last_undegraded":"2024-05-09T00:19:53.437269+0000","last_fullsized":"2024-05-09T00:19:53.437269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":52851,"num_write_kb":659445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"38'2729","reported_seq":2787,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.576832+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:19:59.576832+0000","last_peered":"2024-05-09T00:19:59.576832+0000","last_clean":"2024-05-09T00:19:59.576832+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:19:59.576832+0000","last_undegraded":"2024-05-09T00:19:59.576832+0000","last_fullsized":"2024-05-09T00:19:59.576832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2729,"log_dups_size":0,"ondisk_log_size":2729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83983091,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":40847,"num_write_kb":526996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"38'3706","reported_seq":3769,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.543864+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:19:53.543864+0000","last_peered":"2024-05-09T00:19:53.543864+0000","last_clean":"2024-05-09T00:19:53.543864+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:19:53.543864+0000","last_undegraded":"2024-05-09T00:19:53.543864+0000","last_fullsized":"2024-05-09T00:19:53.543864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":54772,"num_write_kb":692736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"38'2545","reported_seq":2599,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.445767+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:20:01.445767+0000","last_peered":"2024-05-09T00:20:01.445767+0000","last_clean":"2024-05-09T00:20:01.445767+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:20:01.445767+0000","last_undegraded":"2024-05-09T00:20:01.445767+0000","last_fullsized":"2024-05-09T00:20:01.445767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2545,"log_dups_size":0,"ondisk_log_size":2545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33586309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":37701,"num_write_kb":481655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"38'3255","reported_seq":3315,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.621452+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:19:53.621452+0000","last_peered":"2024-05-09T00:19:53.621452+0000","last_clean":"2024-05-09T00:19:53.621452+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:19:53.621452+0000","last_undegraded":"2024-05-09T00:19:53.621452+0000","last_fullsized":"2024-05-09T00:19:53.621452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":48245,"num_write_kb":626583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"38'2907","reported_seq":2961,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.052055+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:20:02.052055+0000","last_peered":"2024-05-09T00:20:02.052055+0000","last_clean":"2024-05-09T00:20:02.052055+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:20:02.052055+0000","last_undegraded":"2024-05-09T00:20:02.052055+0000","last_fullsized":"2024-05-09T00:20:02.052055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":43217,"num_write_kb":536465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"38'3196","reported_seq":3248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.558142+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:19:53.558142+0000","last_peered":"2024-05-09T00:19:53.558142+0000","last_clean":"2024-05-09T00:19:53.558142+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:19:53.558142+0000","last_undegraded":"2024-05-09T00:19:53.558142+0000","last_fullsized":"2024-05-09T00:19:53.558142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":47414,"num_write_kb":607139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"38'3491","reported_seq":3545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.018459+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:20:02.018459+0000","last_peered":"2024-05-09T00:20:02.018459+0000","last_clean":"2024-05-09T00:20:02.018459+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:20:02.018459+0000","last_undegraded":"2024-05-09T00:20:02.018459+0000","last_fullsized":"2024-05-09T00:20:02.018459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37761741,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":51950,"num_write_kb":660810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"38'3882","reported_seq":3943,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.616124+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:19:53.616124+0000","last_peered":"2024-05-09T00:19:53.616124+0000","last_clean":"2024-05-09T00:19:53.616124+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:19:53.616124+0000","last_undegraded":"2024-05-09T00:19:53.616124+0000","last_fullsized":"2024-05-09T00:19:53.616124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3882,"log_dups_size":0,"ondisk_log_size":3882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":57695,"num_write_kb":692841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"38'3709","reported_seq":3759,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.181755+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:20:00.181755+0000","last_peered":"2024-05-09T00:20:00.181755+0000","last_clean":"2024-05-09T00:20:00.181755+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:20:00.181755+0000","last_undegraded":"2024-05-09T00:20:00.181755+0000","last_fullsized":"2024-05-09T00:20:00.181755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92278530,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":55049,"num_write_kb":708295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"38'4565","reported_seq":4628,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629043+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:19:53.629043+0000","last_peered":"2024-05-09T00:19:53.629043+0000","last_clean":"2024-05-09T00:19:53.629043+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:19:53.629043+0000","last_undegraded":"2024-05-09T00:19:53.629043+0000","last_fullsized":"2024-05-09T00:19:53.629043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":67870,"num_write_kb":862032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"38'3251","reported_seq":3305,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.094121+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:20:00.094121+0000","last_peered":"2024-05-09T00:20:00.094121+0000","last_clean":"2024-05-09T00:20:00.094121+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:20:00.094121+0000","last_undegraded":"2024-05-09T00:20:00.094121+0000","last_fullsized":"2024-05-09T00:20:00.094121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3251,"log_dups_size":0,"ondisk_log_size":3251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92279892,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":48572,"num_write_kb":613070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"38'3191","reported_seq":3248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628082+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:19:53.628082+0000","last_peered":"2024-05-09T00:19:53.628082+0000","last_clean":"2024-05-09T00:19:53.628082+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:19:53.628082+0000","last_undegraded":"2024-05-09T00:19:53.628082+0000","last_fullsized":"2024-05-09T00:19:53.628082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3191,"log_dups_size":0,"ondisk_log_size":3191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":47307,"num_write_kb":598779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"38'2883","reported_seq":2938,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.018082+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:20:02.018082+0000","last_peered":"2024-05-09T00:20:02.018082+0000","last_clean":"2024-05-09T00:20:02.018082+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:20:02.018082+0000","last_undegraded":"2024-05-09T00:20:02.018082+0000","last_fullsized":"2024-05-09T00:20:02.018082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":0,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33626195,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42968,"num_write_kb":536887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"38'3240","reported_seq":3297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.005810+0000","last_change":"2024-05-09T00:09:31.549449+0000","last_active":"2024-05-09T00:19:52.005810+0000","last_peered":"2024-05-09T00:19:52.005810+0000","last_clean":"2024-05-09T00:19:52.005810+0000","last_became_active":"2024-05-09T00:09:31.548548+0000","last_became_peered":"2024-05-09T00:09:31.548548+0000","last_unstale":"2024-05-09T00:19:52.005810+0000","last_undegraded":"2024-05-09T00:19:52.005810+0000","last_fullsized":"2024-05-09T00:19:52.005810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:51.033109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":48187,"num_write_kb":638325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3a","version":"38'2693","reported_seq":2744,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.182129+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:20:00.182129+0000","last_peered":"2024-05-09T00:20:00.182129+0000","last_clean":"2024-05-09T00:20:00.182129+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:20:00.182129+0000","last_undegraded":"2024-05-09T00:20:00.182129+0000","last_fullsized":"2024-05-09T00:20:00.182129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2693,"log_dups_size":0,"ondisk_log_size":2693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79692872,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40116,"num_write_kb":502625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"38'3769","reported_seq":3828,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.606261+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:19:53.606261+0000","last_peered":"2024-05-09T00:19:53.606261+0000","last_clean":"2024-05-09T00:19:53.606261+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:19:53.606261+0000","last_undegraded":"2024-05-09T00:19:53.606261+0000","last_fullsized":"2024-05-09T00:19:53.606261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7,"num_write":55645,"num_write_kb":699546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"38'3719","reported_seq":3778,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.184910+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:20:02.184910+0000","last_peered":"2024-05-09T00:20:02.184910+0000","last_clean":"2024-05-09T00:20:02.184910+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:20:02.184910+0000","last_undegraded":"2024-05-09T00:20:02.184910+0000","last_fullsized":"2024-05-09T00:20:02.184910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62924447,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":55235,"num_write_kb":668332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"38'3188","reported_seq":3243,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.430180+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:19:53.430180+0000","last_peered":"2024-05-09T00:19:53.430180+0000","last_clean":"2024-05-09T00:19:53.430180+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:19:53.430180+0000","last_undegraded":"2024-05-09T00:19:53.430180+0000","last_fullsized":"2024-05-09T00:19:53.430180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":47104,"num_write_kb":589873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"38'2874","reported_seq":2926,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.620350+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:20:00.620350+0000","last_peered":"2024-05-09T00:20:00.620350+0000","last_clean":"2024-05-09T00:20:00.620350+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:20:00.620350+0000","last_undegraded":"2024-05-09T00:20:00.620350+0000","last_fullsized":"2024-05-09T00:20:00.620350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":42933,"num_write_kb":549753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"38'4368","reported_seq":4426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645257+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:19:53.645257+0000","last_peered":"2024-05-09T00:19:53.645257+0000","last_clean":"2024-05-09T00:19:53.645257+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:19:53.645257+0000","last_undegraded":"2024-05-09T00:19:53.645257+0000","last_fullsized":"2024-05-09T00:19:53.645257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":64699,"num_write_kb":791644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"38'3218","reported_seq":3270,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.152430+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:20:00.152430+0000","last_peered":"2024-05-09T00:20:00.152430+0000","last_clean":"2024-05-09T00:20:00.152430+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:20:00.152430+0000","last_undegraded":"2024-05-09T00:20:00.152430+0000","last_fullsized":"2024-05-09T00:20:00.152430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79728345,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":47818,"num_write_kb":582702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"38'3908","reported_seq":3973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.343902+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:19:53.343902+0000","last_peered":"2024-05-09T00:19:53.343902+0000","last_clean":"2024-05-09T00:19:53.343902+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:19:53.343902+0000","last_undegraded":"2024-05-09T00:19:53.343902+0000","last_fullsized":"2024-05-09T00:19:53.343902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":58133,"num_write_kb":728914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"38'3787","reported_seq":3842,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.176946+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:20:00.176946+0000","last_peered":"2024-05-09T00:20:00.176946+0000","last_clean":"2024-05-09T00:20:00.176946+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:20:00.176946+0000","last_undegraded":"2024-05-09T00:20:00.176946+0000","last_fullsized":"2024-05-09T00:20:00.176946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109063306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56637,"num_write_kb":741300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"38'3575","reported_seq":3625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.650608+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:19:53.650608+0000","last_peered":"2024-05-09T00:19:53.650608+0000","last_clean":"2024-05-09T00:19:53.650608+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:19:53.650608+0000","last_undegraded":"2024-05-09T00:19:53.650608+0000","last_fullsized":"2024-05-09T00:19:53.650608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":52889,"num_write_kb":664811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"38'2737","reported_seq":2791,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.151387+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:20:02.151387+0000","last_peered":"2024-05-09T00:20:02.151387+0000","last_clean":"2024-05-09T00:20:02.151387+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:20:02.151387+0000","last_undegraded":"2024-05-09T00:20:02.151387+0000","last_fullsized":"2024-05-09T00:20:02.151387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50353873,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40593,"num_write_kb":513099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1156,"num_read_kb":11,"num_write":3472550,"num_write_kb":43957042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234380,"ondisk_log_size":234380,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":94511102,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":448,"num_read_kb":234535,"num_write":3110,"num_write_kb":94497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":189083648,"data_stored":189021605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2958,"ondisk_log_size":2958,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4691668055,"num_objects":1303,"num_object_clones":0,"num_object_copies":2606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1303,"num_whiteouts":0,"num_read":350,"num_read_kb":0,"num_write":2945821,"num_write_kb":37270707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8880726016,"data_stored":8879859093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197840,"ondisk_log_size":197840,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93222087,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":515,"num_read_kb":184607,"num_write":3523,"num_write_kb":93495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":186671104,"data_stored":186608646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3273,"ondisk_log_size":3273,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509579,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":448512,"kb_used_data":70456,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93923328,"statfs":{"total":96636764160,"available":96177487872,"internally_reserved":0,"allocated":72146944,"data_stored":71832288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":387119562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509576,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2248828,"kb_used_data":1770868,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":92123012,"statfs":{"total":96636764160,"available":94333964288,"internally_reserved":0,"allocated":1813368832,"data_stored":1813035309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":489421254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2213484,"kb_used_data":1718884,"kb_used_omap":1,"kb_used_meta":494590,"kb_avail":92158356,"statfs":{"total":96636764160,"available":94370156544,"internally_reserved":0,"allocated":1760137216,"data_stored":1759749786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":506460613},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2626032,"kb_used_data":2084840,"kb_used_omap":1,"kb_used_meta":504318,"kb_avail":91745808,"statfs":{"total":96636764160,"available":93947707392,"internally_reserved":0,"allocated":2134876160,"data_stored":2134513355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":516422087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509571,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2251800,"kb_used_data":1671056,"kb_used_omap":1,"kb_used_meta":580734,"kb_avail":92120040,"statfs":{"total":96636764160,"available":94330920960,"internally_reserved":0,"allocated":1711161344,"data_stored":1710802379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":594672069},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588776,"kb_used_data":1156512,"kb_used_omap":1,"kb_used_meta":432254,"kb_avail":92783064,"statfs":{"total":96636764160,"available":95009857536,"internally_reserved":0,"allocated":1184268288,"data_stored":1183933072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":442628549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1504080,"kb_used_data":951432,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":92867760,"statfs":{"total":96636764160,"available":95096586240,"internally_reserved":0,"allocated":974266368,"data_stored":973883996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542280,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700316,"kb_used_data":1159956,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":92671524,"statfs":{"total":96636764160,"available":94895640576,"internally_reserved":0,"allocated":1187794944,"data_stored":1187447656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37748792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12583584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37749318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30482432,"data_stored":30470621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13443072,"data_stored":13440761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12671116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831229952,"data_stored":831083962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1132916736,"data_stored":1132817364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1519751168,"data_stored":1519630096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1670828032,"data_stored":1670710660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":755335168,"data_stored":755238754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1636364288,"data_stored":1636219975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1334214656,"data_stored":1334114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31604736,"data_stored":31595106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35807232,"data_stored":35789553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25166406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:20:04.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:20:05.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.098+0000 7f9219000640 1 Processor -- start 2024-05-09T00:20:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.098+0000 7f9219000640 1 -- start start 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9219000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f92140af300 0x7f921406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9219000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9214154730 0x7f9214154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9219000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9214073bc0 con 0x7f92141586e0 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9219000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f92140c54c0 con 0x7f92140af300 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9219000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9214158c30 con 0x7f9214154730 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f92140af300 0x7f921406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f92140af300 0x7f921406fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59136/0 (socket says 172.21.15.114:59136) 2024-05-09T00:20:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 -- 172.21.15.114:0/4113970085 learned_addr learned my addr 172.21.15.114:0/4113970085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 -- 172.21.15.114:0/4113970085 >> v2:172.21.15.153:3300/0 conn(0x7f9214154730 msgr2=0x7f9214154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 --2- 172.21.15.114:0/4113970085 >> v2:172.21.15.153:3300/0 conn(0x7f9214154730 0x7f9214154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 -- 172.21.15.114:0/4113970085 >> v1:172.21.15.153:6789/0 conn(0x7f92141586e0 legacy=0x7f921406f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.101+0000 7f9211400640 1 -- 172.21.15.114:0/4113970085 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9214073600 con 0x7f92140af300 2024-05-09T00:20:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.102+0000 7f9211400640 1 --2- 172.21.15.114:0/4113970085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140af300 0x7f921406fab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9214071e10 tx=0x7f920002c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f541a3c77bcdc5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.103+0000 7f9210a00640 1 -- 172.21.15.114:0/4113970085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200032700 con 0x7f92140af300 2024-05-09T00:20:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.103+0000 7f9210a00640 1 -- 172.21.15.114:0/4113970085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92000328a0 con 0x7f92140af300 2024-05-09T00:20:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.103+0000 7f9210a00640 1 -- 172.21.15.114:0/4113970085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200032c70 con 0x7f92140af300 2024-05-09T00:20:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 -- 172.21.15.114:0/4113970085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140af300 msgr2=0x7f921406fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 --2- 172.21.15.114:0/4113970085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140af300 0x7f921406fab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9214071e10 tx=0x7f920002c800 comp rx=0 tx=0).stop 2024-05-09T00:20:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 -- 172.21.15.114:0/4113970085 shutdown_connections 2024-05-09T00:20:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 --2- 172.21.15.114:0/4113970085 >> v2:172.21.15.153:3300/0 conn(0x7f9214154730 0x7f9214154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 --2- 172.21.15.114:0/4113970085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140af300 0x7f921406fab0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 -- 172.21.15.114:0/4113970085 >> 172.21.15.114:0/4113970085 conn(0x7f921406c680 msgr2=0x7f921406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 -- 172.21.15.114:0/4113970085 shutdown_connections 2024-05-09T00:20:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.104+0000 7f9219000640 1 -- 172.21.15.114:0/4113970085 wait complete. 2024-05-09T00:20:05.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.106+0000 7f9219000640 1 Processor -- start 2024-05-09T00:20:05.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.106+0000 7f9219000640 1 -- start start 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.107+0000 7f9219000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92140af300 0x7f92141229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.107+0000 7f9219000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 0x7f92140c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.107+0000 7f9219000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92141586e0 0x7f921414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9219000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92141520f0 con 0x7f9214154730 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9219000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9214151f70 con 0x7f92141586e0 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9219000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9214155080 con 0x7f92140af300 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 0x7f92140c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 0x7f92140c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59150/0 (socket says 172.21.15.114:59150) 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 -- 172.21.15.114:0/4292129877 learned_addr learned my addr 172.21.15.114:0/4292129877 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 -- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92140af300 msgr2=0x7f92141229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211e00640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92140af300 0x7f92141229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9212800640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92141586e0 0x7f921414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92140af300 0x7f92141229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 -- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92141586e0 msgr2=0x7f921414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92141586e0 0x7f921414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9211400640 1 -- 172.21.15.114:0/4292129877 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92141ee530 con 0x7f9214154730 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.108+0000 7f9212800640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92141586e0 0x7f921414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.109+0000 7f9211400640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 0x7f92140c3870 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f920000b2c0 tx=0x7f92000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.109+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200041070 con 0x7f9214154730 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.109+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9200034bd0 con 0x7f9214154730 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.109+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92140c3070 con 0x7f9214154730 2024-05-09T00:20:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.109+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920003d440 con 0x7f9214154730 2024-05-09T00:20:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.109+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141ebf40 con 0x7f9214154730 2024-05-09T00:20:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.110+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9214077430 con 0x7f9214154730 2024-05-09T00:20:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.111+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9200044070 con 0x7f9214154730 2024-05-09T00:20:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.113+0000 7f920a000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91f4076300 0x7f91f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.113+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f92000b8800 con 0x7f9214154730 2024-05-09T00:20:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.113+0000 7f9211e00640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91f4076300 0x7f91f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.114+0000 7f9211e00640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91f4076300 0x7f91f4078810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f920400a730 tx=0x7f9204008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.118+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9200031070 con 0x7f9214154730 2024-05-09T00:20:05.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.318+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92141ee700 con 0x7f91f4076300 2024-05-09T00:20:05.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.333+0000 7f920a000640 1 -- 172.21.15.114:0/4292129877 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495216 (secure 0 0 0) 0x7f92141ee700 con 0x7f91f4076300 2024-05-09T00:20:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:05.342 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:20:05.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91f4076300 msgr2=0x7f91f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91f4076300 0x7f91f4078810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f920400a730 tx=0x7f9204008040 comp rx=0 tx=0).stop 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 msgr2=0x7f92140c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 0x7f92140c3870 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f920000b2c0 tx=0x7f92000046c0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 shutdown_connections 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f91f4076300 0x7f91f4078810 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92141586e0 0x7f921414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214154730 0x7f92140c3870 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 --2- 172.21.15.114:0/4292129877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92140af300 0x7f92141229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 >> 172.21.15.114:0/4292129877 conn(0x7f921406c680 msgr2=0x7f9214152730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 shutdown_connections 2024-05-09T00:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.340+0000 7f9219000640 1 -- 172.21.15.114:0/4292129877 wait complete. 2024-05-09T00:20:05.370 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-05-09T00:20:04.633342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4879991612,"num_objects":1404,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1404,"num_whiteouts":0,"num_read":2535,"num_read_kb":419208,"num_write":6425105,"num_write_kb":81417369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438523,"ondisk_log_size":438523,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":14581828,"kb_used_data":10584004,"kb_used_omap":12,"kb_used_meta":3948595,"kb_avail":740392892,"statfs":{"total":773094113280,"available":758162321408,"internally_reserved":0,"allocated":10838020096,"data_stored":10835197841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":4043361840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,0,5,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11795246492,"num_objects":-3017,"num_object_clones":0,"num_object_copies":-6034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3017,"num_whiteouts":0,"num_read":8,"num_read_kb":51,"num_write":3132,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005960"},"pg_stats":[{"pgid":"5.18","version":"38'3510","reported_seq":3569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.649196+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:19:53.649196+0000","last_peered":"2024-05-09T00:19:53.649196+0000","last_clean":"2024-05-09T00:19:53.649196+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:19:53.649196+0000","last_undegraded":"2024-05-09T00:19:53.649196+0000","last_fullsized":"2024-05-09T00:19:53.649196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":51796,"num_write_kb":675575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"32'26","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:53.009330+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:18:53.009330+0000","last_peered":"2024-05-09T00:18:53.009330+0000","last_clean":"2024-05-09T00:18:53.009330+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:18:53.009330+0000","last_undegraded":"2024-05-09T00:18:53.009330+0000","last_fullsized":"2024-05-09T00:18:53.009330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":12312,"num_write":21,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"38'3237","reported_seq":3287,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.067412+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:20:00.067412+0000","last_peered":"2024-05-09T00:20:00.067412+0000","last_clean":"2024-05-09T00:20:00.067412+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:20:00.067412+0000","last_undegraded":"2024-05-09T00:20:00.067412+0000","last_fullsized":"2024-05-09T00:20:00.067412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":48370,"num_write_kb":608968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:54.772350+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:18:54.772350+0000","last_peered":"2024-05-09T00:18:54.772350+0000","last_clean":"2024-05-09T00:18:54.772350+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:18:54.772350+0000","last_undegraded":"2024-05-09T00:18:54.772350+0000","last_fullsized":"2024-05-09T00:18:54.772350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"38'4249","reported_seq":4310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.643116+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:19:53.643116+0000","last_peered":"2024-05-09T00:19:53.643116+0000","last_clean":"2024-05-09T00:19:53.643116+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:19:53.643116+0000","last_undegraded":"2024-05-09T00:19:53.643116+0000","last_fullsized":"2024-05-09T00:19:53.643116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4249,"log_dups_size":0,"ondisk_log_size":4249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":63068,"num_write_kb":790226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'6","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.172629+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:18:41.172629+0000","last_peered":"2024-05-09T00:18:41.172629+0000","last_clean":"2024-05-09T00:18:41.172629+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:18:41.172629+0000","last_undegraded":"2024-05-09T00:18:41.172629+0000","last_fullsized":"2024-05-09T00:18:41.172629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"38'3775","reported_seq":3834,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.123795+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:20:00.123795+0000","last_peered":"2024-05-09T00:20:00.123795+0000","last_clean":"2024-05-09T00:20:00.123795+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:20:00.123795+0000","last_undegraded":"2024-05-09T00:20:00.123795+0000","last_fullsized":"2024-05-09T00:20:00.123795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83947003,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":56252,"num_write_kb":712681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"38'34","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.497193+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:19:53.497193+0000","last_peered":"2024-05-09T00:19:53.497193+0000","last_clean":"2024-05-09T00:19:53.497193+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:19:53.497193+0000","last_undegraded":"2024-05-09T00:19:53.497193+0000","last_fullsized":"2024-05-09T00:19:53.497193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":31,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"38'3172","reported_seq":3223,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587249+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:19:53.587249+0000","last_peered":"2024-05-09T00:19:53.587249+0000","last_clean":"2024-05-09T00:19:53.587249+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:19:53.587249+0000","last_undegraded":"2024-05-09T00:19:53.587249+0000","last_fullsized":"2024-05-09T00:19:53.587249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46816,"num_write_kb":580338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"38'66","reported_seq":134,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:58.071965+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:18:58.071965+0000","last_peered":"2024-05-09T00:18:58.071965+0000","last_clean":"2024-05-09T00:18:58.071965+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:18:58.071965+0000","last_undegraded":"2024-05-09T00:18:58.071965+0000","last_fullsized":"2024-05-09T00:18:58.071965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":24612,"num_write":55,"num_write_kb":12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2281","reported_seq":2331,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.090946+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:20:00.090946+0000","last_peered":"2024-05-09T00:20:00.090946+0000","last_clean":"2024-05-09T00:20:00.090946+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:20:00.090946+0000","last_undegraded":"2024-05-09T00:20:00.090946+0000","last_fullsized":"2024-05-09T00:20:00.090946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54527679,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":33908,"num_write_kb":416723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"38'1159","reported_seq":1205,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:51.399059+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:18:51.399059+0000","last_peered":"2024-05-09T00:18:51.399059+0000","last_clean":"2024-05-09T00:18:51.399059+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:18:51.399059+0000","last_undegraded":"2024-05-09T00:18:51.399059+0000","last_fullsized":"2024-05-09T00:18:51.399059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1156,"num_write_kb":5131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"38'2810","reported_seq":2865,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.553020+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:19:53.553020+0000","last_peered":"2024-05-09T00:19:53.553020+0000","last_clean":"2024-05-09T00:19:53.553020+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:19:53.553020+0000","last_undegraded":"2024-05-09T00:19:53.553020+0000","last_fullsized":"2024-05-09T00:19:53.553020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":41711,"num_write_kb":539991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"38'19","reported_seq":83,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:55.401540+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:18:55.401540+0000","last_peered":"2024-05-09T00:18:55.401540+0000","last_clean":"2024-05-09T00:18:55.401540+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:18:55.401540+0000","last_undegraded":"2024-05-09T00:18:55.401540+0000","last_fullsized":"2024-05-09T00:18:55.401540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"38'3787","reported_seq":3841,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.861949+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:19:59.861949+0000","last_peered":"2024-05-09T00:19:59.861949+0000","last_clean":"2024-05-09T00:19:59.861949+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:19:59.861949+0000","last_undegraded":"2024-05-09T00:19:59.861949+0000","last_fullsized":"2024-05-09T00:19:59.861949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121707303,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56666,"num_write_kb":717087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"38'128","reported_seq":175,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.581503+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:19:53.581503+0000","last_peered":"2024-05-09T00:19:53.581503+0000","last_clean":"2024-05-09T00:19:53.581503+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:19:53.581503+0000","last_undegraded":"2024-05-09T00:19:53.581503+0000","last_fullsized":"2024-05-09T00:19:53.581503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12967,"num_write":119,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"38'3858","reported_seq":3920,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.611332+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:19:53.611332+0000","last_peered":"2024-05-09T00:19:53.611332+0000","last_clean":"2024-05-09T00:19:53.611332+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:19:53.611332+0000","last_undegraded":"2024-05-09T00:19:53.611332+0000","last_fullsized":"2024-05-09T00:19:53.611332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":57322,"num_write_kb":713128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"38'2889","reported_seq":2942,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.178850+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:20:00.178850+0000","last_peered":"2024-05-09T00:20:00.178850+0000","last_clean":"2024-05-09T00:20:00.178850+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:20:00.178850+0000","last_undegraded":"2024-05-09T00:20:00.178850+0000","last_fullsized":"2024-05-09T00:20:00.178850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62915277,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":43134,"num_write_kb":535156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"38'439","reported_seq":504,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.238469+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:19:55.238469+0000","last_peered":"2024-05-09T00:19:55.238469+0000","last_clean":"2024-05-09T00:19:55.238469+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:19:55.238469+0000","last_undegraded":"2024-05-09T00:19:55.238469+0000","last_fullsized":"2024-05-09T00:19:55.238469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":13833,"num_write":428,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"38'28","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:49.858859+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:18:49.858859+0000","last_peered":"2024-05-09T00:18:49.858859+0000","last_clean":"2024-05-09T00:18:49.858859+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:18:49.858859+0000","last_undegraded":"2024-05-09T00:18:49.858859+0000","last_fullsized":"2024-05-09T00:18:49.858859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":25,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"38'3696","reported_seq":3753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644711+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:19:53.644711+0000","last_peered":"2024-05-09T00:19:53.644711+0000","last_clean":"2024-05-09T00:19:53.644711+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:19:53.644711+0000","last_undegraded":"2024-05-09T00:19:53.644711+0000","last_fullsized":"2024-05-09T00:19:53.644711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54745,"num_write_kb":690364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"38'2633","reported_seq":2687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.741999+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:20:03.741999+0000","last_peered":"2024-05-09T00:20:03.741999+0000","last_clean":"2024-05-09T00:20:03.741999+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:20:03.741999+0000","last_undegraded":"2024-05-09T00:20:03.741999+0000","last_fullsized":"2024-05-09T00:20:03.741999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2633,"log_dups_size":0,"ondisk_log_size":2633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9666,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":39018,"num_write_kb":478044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"38'68","reported_seq":119,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.906828+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:19:59.906828+0000","last_peered":"2024-05-09T00:19:59.906828+0000","last_clean":"2024-05-09T00:19:59.906828+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:19:59.906828+0000","last_undegraded":"2024-05-09T00:19:59.906828+0000","last_fullsized":"2024-05-09T00:19:59.906828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":857849,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563999+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:19:53.563999+0000","last_peered":"2024-05-09T00:19:53.563999+0000","last_clean":"2024-05-09T00:19:53.563999+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:19:53.563999+0000","last_undegraded":"2024-05-09T00:19:53.563999+0000","last_fullsized":"2024-05-09T00:19:53.563999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"38'3606","reported_seq":3668,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542603+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:19:53.542603+0000","last_peered":"2024-05-09T00:19:53.542603+0000","last_clean":"2024-05-09T00:19:53.542603+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:19:53.542603+0000","last_undegraded":"2024-05-09T00:19:53.542603+0000","last_fullsized":"2024-05-09T00:19:53.542603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":53395,"num_write_kb":656713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"38'3269","reported_seq":3321,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.602843+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:20:01.602843+0000","last_peered":"2024-05-09T00:20:01.602843+0000","last_clean":"2024-05-09T00:20:01.602843+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:20:01.602843+0000","last_undegraded":"2024-05-09T00:20:01.602843+0000","last_fullsized":"2024-05-09T00:20:01.602843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3269,"log_dups_size":0,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71316849,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48667,"num_write_kb":618917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.111833+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:18:35.111833+0000","last_peered":"2024-05-09T00:18:35.111833+0000","last_clean":"2024-05-09T00:18:35.111833+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:18:35.111833+0000","last_undegraded":"2024-05-09T00:18:35.111833+0000","last_fullsized":"2024-05-09T00:18:35.111833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"38'114","reported_seq":163,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.599875+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:19:53.599875+0000","last_peered":"2024-05-09T00:19:53.599875+0000","last_clean":"2024-05-09T00:19:53.599875+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:19:53.599875+0000","last_undegraded":"2024-05-09T00:19:53.599875+0000","last_fullsized":"2024-05-09T00:19:53.599875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4101,"num_write":111,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"38'4190","reported_seq":4250,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.571284+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:19:53.571284+0000","last_peered":"2024-05-09T00:19:53.571284+0000","last_clean":"2024-05-09T00:19:53.571284+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:19:53.571284+0000","last_undegraded":"2024-05-09T00:19:53.571284+0000","last_fullsized":"2024-05-09T00:19:53.571284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":62004,"num_write_kb":783810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"38'2898","reported_seq":2952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.678829+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:19:59.678829+0000","last_peered":"2024-05-09T00:19:59.678829+0000","last_clean":"2024-05-09T00:19:59.678829+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:19:59.678829+0000","last_undegraded":"2024-05-09T00:19:59.678829+0000","last_fullsized":"2024-05-09T00:19:59.678829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92286709,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43352,"num_write_kb":534691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'13","reported_seq":65,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:43.263621+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:18:43.263621+0000","last_peered":"2024-05-09T00:18:43.263621+0000","last_clean":"2024-05-09T00:18:43.263621+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:18:43.263621+0000","last_undegraded":"2024-05-09T00:18:43.263621+0000","last_fullsized":"2024-05-09T00:18:43.263621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":10,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"38'17","reported_seq":71,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.603566+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:19:53.603566+0000","last_peered":"2024-05-09T00:19:53.603566+0000","last_clean":"2024-05-09T00:19:53.603566+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:19:53.603566+0000","last_undegraded":"2024-05-09T00:19:53.603566+0000","last_fullsized":"2024-05-09T00:19:53.603566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":8222,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"38'3415","reported_seq":3470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613984+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:19:53.613984+0000","last_peered":"2024-05-09T00:19:53.613984+0000","last_clean":"2024-05-09T00:19:53.613984+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:19:53.613984+0000","last_undegraded":"2024-05-09T00:19:53.613984+0000","last_fullsized":"2024-05-09T00:19:53.613984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":50480,"num_write_kb":654641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"38'2723","reported_seq":2776,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.592620+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:20:01.592620+0000","last_peered":"2024-05-09T00:20:01.592620+0000","last_clean":"2024-05-09T00:20:01.592620+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:20:01.592620+0000","last_undegraded":"2024-05-09T00:20:01.592620+0000","last_fullsized":"2024-05-09T00:20:01.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46144338,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":40204,"num_write_kb":499329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"38'3","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:30.153303+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:19:30.153303+0000","last_peered":"2024-05-09T00:19:30.153303+0000","last_clean":"2024-05-09T00:19:30.153303+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:19:30.153303+0000","last_undegraded":"2024-05-09T00:19:30.153303+0000","last_fullsized":"2024-05-09T00:19:30.153303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'28","reported_seq":100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.191915+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:19:56.191915+0000","last_peered":"2024-05-09T00:19:56.191915+0000","last_clean":"2024-05-09T00:19:56.191915+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:19:56.191915+0000","last_undegraded":"2024-05-09T00:19:56.191915+0000","last_fullsized":"2024-05-09T00:19:56.191915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":103,"num_write":25,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"38'3402","reported_seq":3461,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.564961+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:19:53.564961+0000","last_peered":"2024-05-09T00:19:53.564961+0000","last_clean":"2024-05-09T00:19:53.564961+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:19:53.564961+0000","last_undegraded":"2024-05-09T00:19:53.564961+0000","last_fullsized":"2024-05-09T00:19:53.564961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":50468,"num_write_kb":661545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"38'3238","reported_seq":3290,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.741136+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:20:01.741136+0000","last_peered":"2024-05-09T00:20:01.741136+0000","last_clean":"2024-05-09T00:20:01.741136+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:20:01.741136+0000","last_undegraded":"2024-05-09T00:20:01.741136+0000","last_fullsized":"2024-05-09T00:20:01.741136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3238,"log_dups_size":0,"ondisk_log_size":3238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62915014,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48101,"num_write_kb":593457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"38'279","reported_seq":336,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.115388+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:20:00.115388+0000","last_peered":"2024-05-09T00:20:00.115388+0000","last_clean":"2024-05-09T00:20:00.115388+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:20:00.115388+0000","last_undegraded":"2024-05-09T00:20:00.115388+0000","last_fullsized":"2024-05-09T00:20:00.115388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":56,"num_write":599,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"38'125","reported_seq":173,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.594126+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:19:53.594126+0000","last_peered":"2024-05-09T00:19:53.594126+0000","last_clean":"2024-05-09T00:19:53.594126+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:19:53.594126+0000","last_undegraded":"2024-05-09T00:19:53.594126+0000","last_fullsized":"2024-05-09T00:19:53.594126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":117,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"38'3842","reported_seq":3900,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.481885+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:19:53.481885+0000","last_peered":"2024-05-09T00:19:53.481885+0000","last_clean":"2024-05-09T00:19:53.481885+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:19:53.481885+0000","last_undegraded":"2024-05-09T00:19:53.481885+0000","last_fullsized":"2024-05-09T00:19:53.481885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":57074,"num_write_kb":711138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"38'3167","reported_seq":3221,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.716024+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:19:59.716024+0000","last_peered":"2024-05-09T00:19:59.716024+0000","last_clean":"2024-05-09T00:19:59.716024+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:19:59.716024+0000","last_undegraded":"2024-05-09T00:19:59.716024+0000","last_fullsized":"2024-05-09T00:19:59.716024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104904879,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":47390,"num_write_kb":602470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.094765+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:18:35.094765+0000","last_peered":"2024-05-09T00:18:35.094765+0000","last_clean":"2024-05-09T00:18:35.094765+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:18:35.094765+0000","last_undegraded":"2024-05-09T00:18:35.094765+0000","last_fullsized":"2024-05-09T00:18:35.094765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'1","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063462+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:18:35.063462+0000","last_peered":"2024-05-09T00:18:35.063462+0000","last_clean":"2024-05-09T00:18:35.063462+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:18:35.063462+0000","last_undegraded":"2024-05-09T00:18:35.063462+0000","last_fullsized":"2024-05-09T00:18:35.063462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"38'3423","reported_seq":3485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563559+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:19:53.563559+0000","last_peered":"2024-05-09T00:19:53.563559+0000","last_clean":"2024-05-09T00:19:53.563559+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:19:53.563559+0000","last_undegraded":"2024-05-09T00:19:53.563559+0000","last_fullsized":"2024-05-09T00:19:53.563559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":50760,"num_write_kb":664501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"38'2699","reported_seq":2753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.188951+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:20:00.188951+0000","last_peered":"2024-05-09T00:20:00.188951+0000","last_clean":"2024-05-09T00:20:00.188951+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:20:00.188951+0000","last_undegraded":"2024-05-09T00:20:00.188951+0000","last_fullsized":"2024-05-09T00:20:00.188951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2699,"log_dups_size":0,"ondisk_log_size":2699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83895086,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40249,"num_write_kb":520250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.132892+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:18:35.132892+0000","last_peered":"2024-05-09T00:18:35.132892+0000","last_clean":"2024-05-09T00:18:35.132892+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:18:35.132892+0000","last_undegraded":"2024-05-09T00:18:35.132892+0000","last_fullsized":"2024-05-09T00:18:35.132892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'61","reported_seq":110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.601835+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:19:53.601835+0000","last_peered":"2024-05-09T00:19:53.601835+0000","last_clean":"2024-05-09T00:19:53.601835+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:19:53.601835+0000","last_undegraded":"2024-05-09T00:19:53.601835+0000","last_fullsized":"2024-05-09T00:19:53.601835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18843,"num_write":53,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"38'3161","reported_seq":3218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.561070+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:19:53.561070+0000","last_peered":"2024-05-09T00:19:53.561070+0000","last_clean":"2024-05-09T00:19:53.561070+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:19:53.561070+0000","last_undegraded":"2024-05-09T00:19:53.561070+0000","last_fullsized":"2024-05-09T00:19:53.561070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3161,"log_dups_size":0,"ondisk_log_size":3161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":46450,"num_write_kb":620498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"38'2908","reported_seq":2962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.970047+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:20:01.970047+0000","last_peered":"2024-05-09T00:20:01.970047+0000","last_clean":"2024-05-09T00:20:01.970047+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:20:01.970047+0000","last_undegraded":"2024-05-09T00:20:01.970047+0000","last_fullsized":"2024-05-09T00:20:01.970047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25172849,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43295,"num_write_kb":562205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'30","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:44.055699+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:18:44.055699+0000","last_peered":"2024-05-09T00:18:44.055699+0000","last_clean":"2024-05-09T00:18:44.055699+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:18:44.055699+0000","last_undegraded":"2024-05-09T00:18:44.055699+0000","last_fullsized":"2024-05-09T00:18:44.055699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":25,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"38'5","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569752+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:19:53.569752+0000","last_peered":"2024-05-09T00:19:53.569752+0000","last_clean":"2024-05-09T00:19:53.569752+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:19:53.569752+0000","last_undegraded":"2024-05-09T00:19:53.569752+0000","last_fullsized":"2024-05-09T00:19:53.569752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"38'3104","reported_seq":3159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.529663+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:19:53.529663+0000","last_peered":"2024-05-09T00:19:53.529663+0000","last_clean":"2024-05-09T00:19:53.529663+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:19:53.529663+0000","last_undegraded":"2024-05-09T00:19:53.529663+0000","last_fullsized":"2024-05-09T00:19:53.529663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45747,"num_write_kb":566089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"38'2887","reported_seq":2944,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.168057+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:20:00.168057+0000","last_peered":"2024-05-09T00:20:00.168057+0000","last_clean":"2024-05-09T00:20:00.168057+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:20:00.168057+0000","last_undegraded":"2024-05-09T00:20:00.168057+0000","last_fullsized":"2024-05-09T00:20:00.168057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2887,"log_dups_size":0,"ondisk_log_size":2887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67121752,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42893,"num_write_kb":561201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"38'34","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.303256+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:20:03.303256+0000","last_peered":"2024-05-09T00:20:03.303256+0000","last_clean":"2024-05-09T00:20:03.303256+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:20:03.303256+0000","last_undegraded":"2024-05-09T00:20:03.303256+0000","last_fullsized":"2024-05-09T00:20:03.303256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":106,"num_write":32,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"38'5","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587860+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:19:53.587860+0000","last_peered":"2024-05-09T00:19:53.587860+0000","last_clean":"2024-05-09T00:19:53.587860+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:19:53.587860+0000","last_undegraded":"2024-05-09T00:19:53.587860+0000","last_fullsized":"2024-05-09T00:19:53.587860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"38'3544","reported_seq":3606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580100+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:19:53.580100+0000","last_peered":"2024-05-09T00:19:53.580100+0000","last_clean":"2024-05-09T00:19:53.580100+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:19:53.580100+0000","last_undegraded":"2024-05-09T00:19:53.580100+0000","last_fullsized":"2024-05-09T00:19:53.580100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":1,"num_write":52513,"num_write_kb":669201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"38'2987","reported_seq":3041,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.785255+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:19:59.785255+0000","last_peered":"2024-05-09T00:19:59.785255+0000","last_clean":"2024-05-09T00:19:59.785255+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:19:59.785255+0000","last_undegraded":"2024-05-09T00:19:59.785255+0000","last_fullsized":"2024-05-09T00:19:59.785255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79703100,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44733,"num_write_kb":572857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"35'440","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:42.443246+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:18:42.443246+0000","last_peered":"2024-05-09T00:18:42.443246+0000","last_clean":"2024-05-09T00:18:42.443246+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:18:42.443246+0000","last_undegraded":"2024-05-09T00:18:42.443246+0000","last_fullsized":"2024-05-09T00:18:42.443246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14538,"num_write":435,"num_write_kb":8538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"38'272","reported_seq":320,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.598361+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:19:53.598361+0000","last_peered":"2024-05-09T00:19:53.598361+0000","last_clean":"2024-05-09T00:19:53.598361+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:19:53.598361+0000","last_undegraded":"2024-05-09T00:19:53.598361+0000","last_fullsized":"2024-05-09T00:19:53.598361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":46,"num_write":564,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"38'3750","reported_seq":3813,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.599370+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:19:53.599370+0000","last_peered":"2024-05-09T00:19:53.599370+0000","last_clean":"2024-05-09T00:19:53.599370+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:19:53.599370+0000","last_undegraded":"2024-05-09T00:19:53.599370+0000","last_fullsized":"2024-05-09T00:19:53.599370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":0,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":55664,"num_write_kb":710441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"38'3156","reported_seq":3209,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.600243+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:20:01.600243+0000","last_peered":"2024-05-09T00:20:01.600243+0000","last_clean":"2024-05-09T00:20:01.600243+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:20:01.600243+0000","last_undegraded":"2024-05-09T00:20:01.600243+0000","last_fullsized":"2024-05-09T00:20:01.600243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3156,"log_dups_size":0,"ondisk_log_size":3156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92282908,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":46914,"num_write_kb":587038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.075720+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:18:35.075720+0000","last_peered":"2024-05-09T00:18:35.075720+0000","last_clean":"2024-05-09T00:18:35.075720+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:18:35.075720+0000","last_undegraded":"2024-05-09T00:18:35.075720+0000","last_fullsized":"2024-05-09T00:18:35.075720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.161123+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:18:35.161123+0000","last_peered":"2024-05-09T00:18:35.161123+0000","last_clean":"2024-05-09T00:18:35.161123+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:18:35.161123+0000","last_undegraded":"2024-05-09T00:18:35.161123+0000","last_fullsized":"2024-05-09T00:18:35.161123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'4","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580602+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:19:53.580602+0000","last_peered":"2024-05-09T00:19:53.580602+0000","last_clean":"2024-05-09T00:19:53.580602+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:19:53.580602+0000","last_undegraded":"2024-05-09T00:19:53.580602+0000","last_fullsized":"2024-05-09T00:19:53.580602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"38'3132","reported_seq":3183,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.597376+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:19:53.597376+0000","last_peered":"2024-05-09T00:19:53.597376+0000","last_clean":"2024-05-09T00:19:53.597376+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:19:53.597376+0000","last_undegraded":"2024-05-09T00:19:53.597376+0000","last_fullsized":"2024-05-09T00:19:53.597376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3132,"log_dups_size":0,"ondisk_log_size":3132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46383,"num_write_kb":562908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'2961","reported_seq":3018,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.553083+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:20:00.553083+0000","last_peered":"2024-05-09T00:20:00.553083+0000","last_clean":"2024-05-09T00:20:00.553083+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:20:00.553083+0000","last_undegraded":"2024-05-09T00:20:00.553083+0000","last_fullsized":"2024-05-09T00:20:00.553083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":0,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54623816,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":44152,"num_write_kb":571148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063786+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:18:35.063786+0000","last_peered":"2024-05-09T00:18:35.063786+0000","last_clean":"2024-05-09T00:18:35.063786+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:18:35.063786+0000","last_undegraded":"2024-05-09T00:18:35.063786+0000","last_fullsized":"2024-05-09T00:18:35.063786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"38'173","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.960698+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:19:55.960698+0000","last_peered":"2024-05-09T00:19:55.960698+0000","last_clean":"2024-05-09T00:19:55.960698+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:19:55.960698+0000","last_undegraded":"2024-05-09T00:19:55.960698+0000","last_fullsized":"2024-05-09T00:19:55.960698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146864,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":38,"num_write":167,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"38'3176","reported_seq":3240,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.578160+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:19:53.578160+0000","last_peered":"2024-05-09T00:19:53.578160+0000","last_clean":"2024-05-09T00:19:53.578160+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:19:53.578160+0000","last_undegraded":"2024-05-09T00:19:53.578160+0000","last_fullsized":"2024-05-09T00:19:53.578160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3176,"log_dups_size":0,"ondisk_log_size":3176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":47105,"num_write_kb":619272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"38'3203","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.790954+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:20:01.790954+0000","last_peered":"2024-05-09T00:20:01.790954+0000","last_clean":"2024-05-09T00:20:01.790954+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:20:01.790954+0000","last_undegraded":"2024-05-09T00:20:01.790954+0000","last_fullsized":"2024-05-09T00:20:01.790954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37761822,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":47550,"num_write_kb":594884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"36'17","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:43.556005+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:18:43.556005+0000","last_peered":"2024-05-09T00:18:43.556005+0000","last_clean":"2024-05-09T00:18:43.556005+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:18:43.556005+0000","last_undegraded":"2024-05-09T00:18:43.556005+0000","last_fullsized":"2024-05-09T00:18:43.556005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"38'246","reported_seq":299,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.619084+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:19:53.619084+0000","last_peered":"2024-05-09T00:19:53.619084+0000","last_clean":"2024-05-09T00:19:53.619084+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:19:53.619084+0000","last_undegraded":"2024-05-09T00:19:53.619084+0000","last_fullsized":"2024-05-09T00:19:53.619084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":16394,"num_write":232,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"38'3503","reported_seq":3561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.618310+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:19:53.618310+0000","last_peered":"2024-05-09T00:19:53.618310+0000","last_clean":"2024-05-09T00:19:53.618310+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:19:53.618310+0000","last_undegraded":"2024-05-09T00:19:53.618310+0000","last_fullsized":"2024-05-09T00:19:53.618310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":51910,"num_write_kb":640187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"38'3567","reported_seq":3620,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.794099+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:20:01.794099+0000","last_peered":"2024-05-09T00:20:01.794099+0000","last_clean":"2024-05-09T00:20:01.794099+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:20:01.794099+0000","last_undegraded":"2024-05-09T00:20:01.794099+0000","last_fullsized":"2024-05-09T00:20:01.794099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46145331,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":53051,"num_write_kb":670486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"36'17","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:55.704465+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:18:55.704465+0000","last_peered":"2024-05-09T00:18:55.704465+0000","last_clean":"2024-05-09T00:18:55.704465+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:18:55.704465+0000","last_undegraded":"2024-05-09T00:18:55.704465+0000","last_fullsized":"2024-05-09T00:18:55.704465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":16,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"38'22","reported_seq":67,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.567706+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:19:53.567706+0000","last_peered":"2024-05-09T00:19:53.567706+0000","last_clean":"2024-05-09T00:19:53.567706+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:19:53.567706+0000","last_undegraded":"2024-05-09T00:19:53.567706+0000","last_fullsized":"2024-05-09T00:19:53.567706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":17,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"38'3625","reported_seq":3683,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.482782+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:19:53.482782+0000","last_peered":"2024-05-09T00:19:53.482782+0000","last_clean":"2024-05-09T00:19:53.482782+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:19:53.482782+0000","last_undegraded":"2024-05-09T00:19:53.482782+0000","last_fullsized":"2024-05-09T00:19:53.482782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53630,"num_write_kb":693205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"38'2877","reported_seq":2932,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.187835+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:20:00.187835+0000","last_peered":"2024-05-09T00:20:00.187835+0000","last_clean":"2024-05-09T00:20:00.187835+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:20:00.187835+0000","last_undegraded":"2024-05-09T00:20:00.187835+0000","last_fullsized":"2024-05-09T00:20:00.187835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88276698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42970,"num_write_kb":541677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"38'135","reported_seq":192,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.424244+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:19:55.424244+0000","last_peered":"2024-05-09T00:19:55.424244+0000","last_clean":"2024-05-09T00:19:55.424244+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:19:55.424244+0000","last_undegraded":"2024-05-09T00:19:55.424244+0000","last_fullsized":"2024-05-09T00:19:55.424244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":134,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"38'3","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587165+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:19:53.587165+0000","last_peered":"2024-05-09T00:19:53.587165+0000","last_clean":"2024-05-09T00:19:53.587165+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:19:53.587165+0000","last_undegraded":"2024-05-09T00:19:53.587165+0000","last_fullsized":"2024-05-09T00:19:53.587165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"38'3203","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.625765+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:19:53.625765+0000","last_peered":"2024-05-09T00:19:53.625765+0000","last_clean":"2024-05-09T00:19:53.625765+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:19:53.625765+0000","last_undegraded":"2024-05-09T00:19:53.625765+0000","last_fullsized":"2024-05-09T00:19:53.625765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47433,"num_write_kb":581618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"38'2964","reported_seq":3019,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.789567+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:19:59.789567+0000","last_peered":"2024-05-09T00:19:59.789567+0000","last_clean":"2024-05-09T00:19:59.789567+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:19:59.789567+0000","last_undegraded":"2024-05-09T00:19:59.789567+0000","last_fullsized":"2024-05-09T00:19:59.789567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2964,"log_dups_size":0,"ondisk_log_size":2964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88106690,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":44134,"num_write_kb":579264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:57.989319+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:18:57.989319+0000","last_peered":"2024-05-09T00:18:57.989319+0000","last_clean":"2024-05-09T00:18:57.989319+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:18:57.989319+0000","last_undegraded":"2024-05-09T00:18:57.989319+0000","last_fullsized":"2024-05-09T00:18:57.989319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"38'4","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588611+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:19:53.588611+0000","last_peered":"2024-05-09T00:19:53.588611+0000","last_clean":"2024-05-09T00:19:53.588611+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:19:53.588611+0000","last_undegraded":"2024-05-09T00:19:53.588611+0000","last_fullsized":"2024-05-09T00:19:53.588611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"38'3658","reported_seq":3715,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.575409+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:19:53.575409+0000","last_peered":"2024-05-09T00:19:53.575409+0000","last_clean":"2024-05-09T00:19:53.575409+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:19:53.575409+0000","last_undegraded":"2024-05-09T00:19:53.575409+0000","last_fullsized":"2024-05-09T00:19:53.575409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54120,"num_write_kb":669829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"38'3290","reported_seq":3346,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.164126+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:20:00.164126+0000","last_peered":"2024-05-09T00:20:00.164126+0000","last_clean":"2024-05-09T00:20:00.164126+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:20:00.164126+0000","last_undegraded":"2024-05-09T00:20:00.164126+0000","last_fullsized":"2024-05-09T00:20:00.164126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104876303,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":48939,"num_write_kb":615876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'2","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.098051+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:18:35.098051+0000","last_peered":"2024-05-09T00:18:35.098051+0000","last_clean":"2024-05-09T00:18:35.098051+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:18:35.098051+0000","last_undegraded":"2024-05-09T00:18:35.098051+0000","last_fullsized":"2024-05-09T00:18:35.098051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:45.156335+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:19:45.156335+0000","last_peered":"2024-05-09T00:19:45.156335+0000","last_clean":"2024-05-09T00:19:45.156335+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:19:45.156335+0000","last_undegraded":"2024-05-09T00:19:45.156335+0000","last_fullsized":"2024-05-09T00:19:45.156335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"38'3403","reported_seq":3462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.514767+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:19:52.514767+0000","last_peered":"2024-05-09T00:19:52.514767+0000","last_clean":"2024-05-09T00:19:52.514767+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:19:52.514767+0000","last_undegraded":"2024-05-09T00:19:52.514767+0000","last_fullsized":"2024-05-09T00:19:52.514767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":50653,"num_write_kb":630818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'3516","reported_seq":3571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.115705+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:20:00.115705+0000","last_peered":"2024-05-09T00:20:00.115705+0000","last_clean":"2024-05-09T00:20:00.115705+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:20:00.115705+0000","last_undegraded":"2024-05-09T00:20:00.115705+0000","last_fullsized":"2024-05-09T00:20:00.115705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3516,"log_dups_size":0,"ondisk_log_size":3516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96479486,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":52591,"num_write_kb":653340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'1","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.069523+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:18:35.069523+0000","last_peered":"2024-05-09T00:18:35.069523+0000","last_clean":"2024-05-09T00:18:35.069523+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:18:35.069523+0000","last_undegraded":"2024-05-09T00:18:35.069523+0000","last_fullsized":"2024-05-09T00:18:35.069523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"38'235","reported_seq":303,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586376+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:19:53.586376+0000","last_peered":"2024-05-09T00:19:53.586376+0000","last_clean":"2024-05-09T00:19:53.586376+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:19:53.586376+0000","last_undegraded":"2024-05-09T00:19:53.586376+0000","last_fullsized":"2024-05-09T00:19:53.586376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":16430,"num_write":226,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"38'4717","reported_seq":4780,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542790+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:19:53.542790+0000","last_peered":"2024-05-09T00:19:53.542790+0000","last_clean":"2024-05-09T00:19:53.542790+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:19:53.542790+0000","last_undegraded":"2024-05-09T00:19:53.542790+0000","last_fullsized":"2024-05-09T00:19:53.542790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":69946,"num_write_kb":894340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"38'2876","reported_seq":2932,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.703135+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:19:59.703135+0000","last_peered":"2024-05-09T00:19:59.703135+0000","last_clean":"2024-05-09T00:19:59.703135+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:19:59.703135+0000","last_undegraded":"2024-05-09T00:19:59.703135+0000","last_fullsized":"2024-05-09T00:19:59.703135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2876,"log_dups_size":0,"ondisk_log_size":2876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100669385,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42818,"num_write_kb":549063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"35'194","reported_seq":260,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:42.698385+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:18:42.698385+0000","last_peered":"2024-05-09T00:18:42.698385+0000","last_clean":"2024-05-09T00:18:42.698385+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:18:42.698385+0000","last_undegraded":"2024-05-09T00:18:42.698385+0000","last_fullsized":"2024-05-09T00:18:42.698385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":12336,"num_write":190,"num_write_kb":8288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"38'20","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:54.377021+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:19:54.377021+0000","last_peered":"2024-05-09T00:19:54.377021+0000","last_clean":"2024-05-09T00:19:54.377021+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:19:54.377021+0000","last_undegraded":"2024-05-09T00:19:54.377021+0000","last_fullsized":"2024-05-09T00:19:54.377021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"38'4177","reported_seq":4234,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627752+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:19:53.627752+0000","last_peered":"2024-05-09T00:19:53.627752+0000","last_clean":"2024-05-09T00:19:53.627752+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:19:53.627752+0000","last_undegraded":"2024-05-09T00:19:53.627752+0000","last_fullsized":"2024-05-09T00:19:53.627752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":61984,"num_write_kb":766120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"38'2845","reported_seq":2897,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.155802+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:20:02.155802+0000","last_peered":"2024-05-09T00:20:02.155802+0000","last_clean":"2024-05-09T00:20:02.155802+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:20:02.155802+0000","last_undegraded":"2024-05-09T00:20:02.155802+0000","last_fullsized":"2024-05-09T00:20:02.155802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":42226,"num_write_kb":541614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"38'236","reported_seq":317,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:51.536810+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:19:51.536810+0000","last_peered":"2024-05-09T00:19:51.536810+0000","last_clean":"2024-05-09T00:19:51.536810+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:19:51.536810+0000","last_undegraded":"2024-05-09T00:19:51.536810+0000","last_fullsized":"2024-05-09T00:19:51.536810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":55,"num_read_kb":20534,"num_write":231,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628479+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:19:53.628479+0000","last_peered":"2024-05-09T00:19:53.628479+0000","last_clean":"2024-05-09T00:19:53.628479+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:19:53.628479+0000","last_undegraded":"2024-05-09T00:19:53.628479+0000","last_fullsized":"2024-05-09T00:19:53.628479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"38'3435","reported_seq":3490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.349109+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:19:53.349109+0000","last_peered":"2024-05-09T00:19:53.349109+0000","last_clean":"2024-05-09T00:19:53.349109+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:19:53.349109+0000","last_undegraded":"2024-05-09T00:19:53.349109+0000","last_fullsized":"2024-05-09T00:19:53.349109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":50796,"num_write_kb":644347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"38'4114","reported_seq":4168,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.541172+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:20:00.541172+0000","last_peered":"2024-05-09T00:20:00.541172+0000","last_clean":"2024-05-09T00:20:00.541172+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:20:00.541172+0000","last_undegraded":"2024-05-09T00:20:00.541172+0000","last_fullsized":"2024-05-09T00:20:00.541172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100863558,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":61418,"num_write_kb":763576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"38'19","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.242855+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:19:55.242855+0000","last_peered":"2024-05-09T00:19:55.242855+0000","last_clean":"2024-05-09T00:19:55.242855+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:19:55.242855+0000","last_undegraded":"2024-05-09T00:19:55.242855+0000","last_fullsized":"2024-05-09T00:19:55.242855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"38'47","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.605921+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:19:53.605921+0000","last_peered":"2024-05-09T00:19:53.605921+0000","last_clean":"2024-05-09T00:19:53.605921+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:19:53.605921+0000","last_undegraded":"2024-05-09T00:19:53.605921+0000","last_fullsized":"2024-05-09T00:19:53.605921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20520,"num_write":39,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"38'3630","reported_seq":3687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.617924+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:19:53.617924+0000","last_peered":"2024-05-09T00:19:53.617924+0000","last_clean":"2024-05-09T00:19:53.617924+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:19:53.617924+0000","last_undegraded":"2024-05-09T00:19:53.617924+0000","last_fullsized":"2024-05-09T00:19:53.617924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53585,"num_write_kb":685544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"38'2733","reported_seq":2790,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.050786+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:20:00.050786+0000","last_peered":"2024-05-09T00:20:00.050786+0000","last_clean":"2024-05-09T00:20:00.050786+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:20:00.050786+0000","last_undegraded":"2024-05-09T00:20:00.050786+0000","last_fullsized":"2024-05-09T00:20:00.050786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62970340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":40562,"num_write_kb":508970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"38'1","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.097987+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:18:35.097987+0000","last_peered":"2024-05-09T00:18:35.097987+0000","last_clean":"2024-05-09T00:18:35.097987+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:18:35.097987+0000","last_undegraded":"2024-05-09T00:18:35.097987+0000","last_fullsized":"2024-05-09T00:18:35.097987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"38'11","reported_seq":81,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569722+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:19:53.569722+0000","last_peered":"2024-05-09T00:19:53.569722+0000","last_clean":"2024-05-09T00:19:53.569722+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:19:53.569722+0000","last_undegraded":"2024-05-09T00:19:53.569722+0000","last_fullsized":"2024-05-09T00:19:53.569722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"38'3942","reported_seq":4002,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615803+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:19:53.615803+0000","last_peered":"2024-05-09T00:19:53.615803+0000","last_clean":"2024-05-09T00:19:53.615803+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:19:53.615803+0000","last_undegraded":"2024-05-09T00:19:53.615803+0000","last_fullsized":"2024-05-09T00:19:53.615803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":58547,"num_write_kb":727316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"38'3053","reported_seq":3110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.661243+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:20:00.661243+0000","last_peered":"2024-05-09T00:20:00.661243+0000","last_clean":"2024-05-09T00:20:00.661243+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:20:00.661243+0000","last_undegraded":"2024-05-09T00:20:00.661243+0000","last_fullsized":"2024-05-09T00:20:00.661243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3053,"log_dups_size":0,"ondisk_log_size":3053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58960980,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":45237,"num_write_kb":566177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"38'2","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.208150+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:18:35.208150+0000","last_peered":"2024-05-09T00:18:35.208150+0000","last_clean":"2024-05-09T00:18:35.208150+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:18:35.208150+0000","last_undegraded":"2024-05-09T00:18:35.208150+0000","last_fullsized":"2024-05-09T00:18:35.208150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"38'6","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.595949+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:19:53.595949+0000","last_peered":"2024-05-09T00:19:53.595949+0000","last_clean":"2024-05-09T00:19:53.595949+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:19:53.595949+0000","last_undegraded":"2024-05-09T00:19:53.595949+0000","last_fullsized":"2024-05-09T00:19:53.595949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4386","reported_seq":4443,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.608899+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:19:53.608899+0000","last_peered":"2024-05-09T00:19:53.608899+0000","last_clean":"2024-05-09T00:19:53.608899+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:19:53.608899+0000","last_undegraded":"2024-05-09T00:19:53.608899+0000","last_fullsized":"2024-05-09T00:19:53.608899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4386,"log_dups_size":0,"ondisk_log_size":4386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":64971,"num_write_kb":841081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"38'49","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586220+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:19:53.586220+0000","last_peered":"2024-05-09T00:19:53.586220+0000","last_clean":"2024-05-09T00:19:53.586220+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:19:53.586220+0000","last_undegraded":"2024-05-09T00:19:53.586220+0000","last_fullsized":"2024-05-09T00:19:53.586220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":42,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"38'3542","reported_seq":3598,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.506333+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:20:01.506333+0000","last_peered":"2024-05-09T00:20:01.506333+0000","last_clean":"2024-05-09T00:20:01.506333+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:20:01.506333+0000","last_undegraded":"2024-05-09T00:20:01.506333+0000","last_fullsized":"2024-05-09T00:20:01.506333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79738804,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":52831,"num_write_kb":662790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"36'39","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:45.381505+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:18:45.381505+0000","last_peered":"2024-05-09T00:18:45.381505+0000","last_clean":"2024-05-09T00:18:45.381505+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:18:45.381505+0000","last_undegraded":"2024-05-09T00:18:45.381505+0000","last_fullsized":"2024-05-09T00:18:45.381505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":36,"num_write_kb":8217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3892","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.486914+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:19:53.486914+0000","last_peered":"2024-05-09T00:19:53.486914+0000","last_clean":"2024-05-09T00:19:53.486914+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:19:53.486914+0000","last_undegraded":"2024-05-09T00:19:53.486914+0000","last_fullsized":"2024-05-09T00:19:53.486914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":57751,"num_write_kb":734560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"30'34","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:02.237009+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:19:02.237009+0000","last_peered":"2024-05-09T00:19:02.237009+0000","last_clean":"2024-05-09T00:19:02.237009+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:19:02.237009+0000","last_undegraded":"2024-05-09T00:19:02.237009+0000","last_fullsized":"2024-05-09T00:19:02.237009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":16404,"num_write":31,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2961","reported_seq":3016,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.611974+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:20:00.611974+0000","last_peered":"2024-05-09T00:20:00.611974+0000","last_clean":"2024-05-09T00:20:00.611974+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:20:00.611974+0000","last_undegraded":"2024-05-09T00:20:00.611974+0000","last_fullsized":"2024-05-09T00:20:00.611974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":0,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67129429,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":43943,"num_write_kb":568639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"38'3","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.056421+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:18:35.056421+0000","last_peered":"2024-05-09T00:18:35.056421+0000","last_clean":"2024-05-09T00:18:35.056421+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:18:35.056421+0000","last_undegraded":"2024-05-09T00:18:35.056421+0000","last_fullsized":"2024-05-09T00:18:35.056421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"38'4410","reported_seq":4472,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.562323+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:19:53.562323+0000","last_peered":"2024-05-09T00:19:53.562323+0000","last_clean":"2024-05-09T00:19:53.562323+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:19:53.562323+0000","last_undegraded":"2024-05-09T00:19:53.562323+0000","last_fullsized":"2024-05-09T00:19:53.562323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":65571,"num_write_kb":822347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"38'27","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.376578+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:18:41.376578+0000","last_peered":"2024-05-09T00:18:41.376578+0000","last_clean":"2024-05-09T00:18:41.376578+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:18:41.376578+0000","last_undegraded":"2024-05-09T00:18:41.376578+0000","last_fullsized":"2024-05-09T00:18:41.376578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2394","reported_seq":2444,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.352199+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:20:01.352199+0000","last_peered":"2024-05-09T00:20:01.352199+0000","last_clean":"2024-05-09T00:20:01.352199+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:20:01.352199+0000","last_undegraded":"2024-05-09T00:20:01.352199+0000","last_fullsized":"2024-05-09T00:20:01.352199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2394,"log_dups_size":0,"ondisk_log_size":2394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62920999,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":35567,"num_write_kb":447799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"38'20","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:05.503439+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:19:05.503439+0000","last_peered":"2024-05-09T00:19:05.503439+0000","last_clean":"2024-05-09T00:19:05.503439+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:19:05.503439+0000","last_undegraded":"2024-05-09T00:19:05.503439+0000","last_fullsized":"2024-05-09T00:19:05.503439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2608","reported_seq":2664,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.505925+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:19:53.505925+0000","last_peered":"2024-05-09T00:19:53.505925+0000","last_clean":"2024-05-09T00:19:53.505925+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:19:53.505925+0000","last_undegraded":"2024-05-09T00:19:53.505925+0000","last_fullsized":"2024-05-09T00:19:53.505925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2608,"log_dups_size":0,"ondisk_log_size":2608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":38767,"num_write_kb":481995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1146","reported_seq":1201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.185803+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:18:41.185803+0000","last_peered":"2024-05-09T00:18:41.185803+0000","last_clean":"2024-05-09T00:18:41.185803+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:18:41.185803+0000","last_undegraded":"2024-05-09T00:18:41.185803+0000","last_fullsized":"2024-05-09T00:18:41.185803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1144,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2573","reported_seq":2624,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.881787+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:19:59.881787+0000","last_peered":"2024-05-09T00:19:59.881787+0000","last_clean":"2024-05-09T00:19:59.881787+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:19:59.881787+0000","last_undegraded":"2024-05-09T00:19:59.881787+0000","last_fullsized":"2024-05-09T00:19:59.881787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2573,"log_dups_size":0,"ondisk_log_size":2573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88103258,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":38306,"num_write_kb":482954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"38'91","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.576346+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:19:53.576346+0000","last_peered":"2024-05-09T00:19:53.576346+0000","last_clean":"2024-05-09T00:19:53.576346+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:19:53.576346+0000","last_undegraded":"2024-05-09T00:19:53.576346+0000","last_fullsized":"2024-05-09T00:19:53.576346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":30171,"num_write":78,"num_write_kb":12339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"38'3350","reported_seq":3396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588764+0000","last_change":"2024-05-09T00:09:31.619347+0000","last_active":"2024-05-09T00:19:53.588764+0000","last_peered":"2024-05-09T00:19:53.588764+0000","last_clean":"2024-05-09T00:19:53.588764+0000","last_became_active":"2024-05-09T00:09:31.617773+0000","last_became_peered":"2024-05-09T00:09:31.617773+0000","last_unstale":"2024-05-09T00:19:53.588764+0000","last_undegraded":"2024-05-09T00:19:53.588764+0000","last_fullsized":"2024-05-09T00:19:53.588764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:19.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":49731,"num_write_kb":622162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"38'3780","reported_seq":3833,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.564087+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:20:00.564087+0000","last_peered":"2024-05-09T00:20:00.564087+0000","last_clean":"2024-05-09T00:20:00.564087+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:20:00.564087+0000","last_undegraded":"2024-05-09T00:20:00.564087+0000","last_fullsized":"2024-05-09T00:20:00.564087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104860365,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56510,"num_write_kb":719929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"38'4248","reported_seq":4304,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629876+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:19:53.629876+0000","last_peered":"2024-05-09T00:19:53.629876+0000","last_clean":"2024-05-09T00:19:53.629876+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:19:53.629876+0000","last_undegraded":"2024-05-09T00:19:53.629876+0000","last_fullsized":"2024-05-09T00:19:53.629876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":62726,"num_write_kb":786275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"38'3362","reported_seq":3413,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.748866+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:20:03.748866+0000","last_peered":"2024-05-09T00:20:03.748866+0000","last_clean":"2024-05-09T00:20:03.748866+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:20:03.748866+0000","last_undegraded":"2024-05-09T00:20:03.748866+0000","last_fullsized":"2024-05-09T00:20:03.748866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":49795,"num_write_kb":622024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"38'3281","reported_seq":3337,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563941+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:19:53.563941+0000","last_peered":"2024-05-09T00:19:53.563941+0000","last_clean":"2024-05-09T00:19:53.563941+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:19:53.563941+0000","last_undegraded":"2024-05-09T00:19:53.563941+0000","last_fullsized":"2024-05-09T00:19:53.563941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":48739,"num_write_kb":615858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"38'3779","reported_seq":3832,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.990627+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:19:59.990627+0000","last_peered":"2024-05-09T00:19:59.990627+0000","last_clean":"2024-05-09T00:19:59.990627+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:19:59.990627+0000","last_undegraded":"2024-05-09T00:19:59.990627+0000","last_fullsized":"2024-05-09T00:19:59.990627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3779,"log_dups_size":0,"ondisk_log_size":3779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121645455,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":56354,"num_write_kb":712291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"38'3855","reported_seq":3921,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.454978+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:19:53.454978+0000","last_peered":"2024-05-09T00:19:53.454978+0000","last_clean":"2024-05-09T00:19:53.454978+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:19:53.454978+0000","last_undegraded":"2024-05-09T00:19:53.454978+0000","last_fullsized":"2024-05-09T00:19:53.454978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":57187,"num_write_kb":738779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"38'2575","reported_seq":2630,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.619381+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:20:00.619381+0000","last_peered":"2024-05-09T00:20:00.619381+0000","last_clean":"2024-05-09T00:20:00.619381+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:20:00.619381+0000","last_undegraded":"2024-05-09T00:20:00.619381+0000","last_fullsized":"2024-05-09T00:20:00.619381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79693826,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":38405,"num_write_kb":503771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"38'4370","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.526382+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:19:53.526382+0000","last_peered":"2024-05-09T00:19:53.526382+0000","last_clean":"2024-05-09T00:19:53.526382+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:19:53.526382+0000","last_undegraded":"2024-05-09T00:19:53.526382+0000","last_fullsized":"2024-05-09T00:19:53.526382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":64728,"num_write_kb":825535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"38'2737","reported_seq":2789,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.609580+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:19:59.609580+0000","last_peered":"2024-05-09T00:19:59.609580+0000","last_clean":"2024-05-09T00:19:59.609580+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:19:59.609580+0000","last_undegraded":"2024-05-09T00:19:59.609580+0000","last_fullsized":"2024-05-09T00:19:59.609580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88110052,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40705,"num_write_kb":512798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"38'3218","reported_seq":3281,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.602708+0000","last_change":"2024-05-09T00:09:31.551214+0000","last_active":"2024-05-09T00:19:53.602708+0000","last_peered":"2024-05-09T00:19:53.602708+0000","last_clean":"2024-05-09T00:19:53.602708+0000","last_became_active":"2024-05-09T00:09:31.550552+0000","last_became_peered":"2024-05-09T00:09:31.550552+0000","last_unstale":"2024-05-09T00:19:53.602708+0000","last_undegraded":"2024-05-09T00:19:53.602708+0000","last_fullsized":"2024-05-09T00:19:53.602708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:09.658798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":47610,"num_write_kb":596071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"38'3259","reported_seq":3310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.638677+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:19:59.638677+0000","last_peered":"2024-05-09T00:19:59.638677+0000","last_clean":"2024-05-09T00:19:59.638677+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:19:59.638677+0000","last_undegraded":"2024-05-09T00:19:59.638677+0000","last_fullsized":"2024-05-09T00:19:59.638677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3259,"log_dups_size":0,"ondisk_log_size":3259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88081110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":48606,"num_write_kb":610539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"38'4466","reported_seq":4526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613481+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:19:53.613481+0000","last_peered":"2024-05-09T00:19:53.613481+0000","last_clean":"2024-05-09T00:19:53.613481+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:19:53.613481+0000","last_undegraded":"2024-05-09T00:19:53.613481+0000","last_fullsized":"2024-05-09T00:19:53.613481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":66102,"num_write_kb":855861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"38'2887","reported_seq":2939,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.569147+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:20:00.569147+0000","last_peered":"2024-05-09T00:20:00.569147+0000","last_clean":"2024-05-09T00:20:00.569147+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:20:00.569147+0000","last_undegraded":"2024-05-09T00:20:00.569147+0000","last_fullsized":"2024-05-09T00:20:00.569147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2887,"log_dups_size":0,"ondisk_log_size":2887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105284448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":43055,"num_write_kb":548362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"38'3894","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.348618+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:19:53.348618+0000","last_peered":"2024-05-09T00:19:53.348618+0000","last_clean":"2024-05-09T00:19:53.348618+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:19:53.348618+0000","last_undegraded":"2024-05-09T00:19:53.348618+0000","last_fullsized":"2024-05-09T00:19:53.348618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":57917,"num_write_kb":734296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"38'3579","reported_seq":3635,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.903073+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:19:59.903073+0000","last_peered":"2024-05-09T00:19:59.903073+0000","last_clean":"2024-05-09T00:19:59.903073+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:19:59.903073+0000","last_undegraded":"2024-05-09T00:19:59.903073+0000","last_fullsized":"2024-05-09T00:19:59.903073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3579,"log_dups_size":0,"ondisk_log_size":3579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121685034,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":53538,"num_write_kb":689167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"38'3075","reported_seq":3129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627461+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:19:53.627461+0000","last_peered":"2024-05-09T00:19:53.627461+0000","last_clean":"2024-05-09T00:19:53.627461+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:19:53.627461+0000","last_undegraded":"2024-05-09T00:19:53.627461+0000","last_fullsized":"2024-05-09T00:19:53.627461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45134,"num_write_kb":543879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"38'2766","reported_seq":2818,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.116179+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:20:00.116179+0000","last_peered":"2024-05-09T00:20:00.116179+0000","last_clean":"2024-05-09T00:20:00.116179+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:20:00.116179+0000","last_undegraded":"2024-05-09T00:20:00.116179+0000","last_fullsized":"2024-05-09T00:20:00.116179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67113963,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":41135,"num_write_kb":511430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"38'4375","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.541127+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:19:53.541127+0000","last_peered":"2024-05-09T00:19:53.541127+0000","last_clean":"2024-05-09T00:19:53.541127+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:19:53.541127+0000","last_undegraded":"2024-05-09T00:19:53.541127+0000","last_fullsized":"2024-05-09T00:19:53.541127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":64891,"num_write_kb":820909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"38'2997","reported_seq":3051,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.598575+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:20:00.598575+0000","last_peered":"2024-05-09T00:20:00.598575+0000","last_clean":"2024-05-09T00:20:00.598575+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:20:00.598575+0000","last_undegraded":"2024-05-09T00:20:00.598575+0000","last_fullsized":"2024-05-09T00:20:00.598575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2997,"log_dups_size":0,"ondisk_log_size":2997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67176152,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44637,"num_write_kb":570209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"38'3563","reported_seq":3621,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.600582+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:19:53.600582+0000","last_peered":"2024-05-09T00:19:53.600582+0000","last_clean":"2024-05-09T00:19:53.600582+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:19:53.600582+0000","last_undegraded":"2024-05-09T00:19:53.600582+0000","last_fullsized":"2024-05-09T00:19:53.600582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":52470,"num_write_kb":678263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"38'3348","reported_seq":3401,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.640957+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:20:00.640957+0000","last_peered":"2024-05-09T00:20:00.640957+0000","last_clean":"2024-05-09T00:20:00.640957+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:20:00.640957+0000","last_undegraded":"2024-05-09T00:20:00.640957+0000","last_fullsized":"2024-05-09T00:20:00.640957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3348,"log_dups_size":0,"ondisk_log_size":3348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79697922,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":49832,"num_write_kb":630819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"38'3672","reported_seq":3731,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627538+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:19:53.627538+0000","last_peered":"2024-05-09T00:19:53.627538+0000","last_clean":"2024-05-09T00:19:53.627538+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:19:53.627538+0000","last_undegraded":"2024-05-09T00:19:53.627538+0000","last_fullsized":"2024-05-09T00:19:53.627538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":54179,"num_write_kb":674825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"38'3206","reported_seq":3264,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.686178+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:20:01.686178+0000","last_peered":"2024-05-09T00:20:01.686178+0000","last_clean":"2024-05-09T00:20:01.686178+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:20:01.686178+0000","last_undegraded":"2024-05-09T00:20:01.686178+0000","last_fullsized":"2024-05-09T00:20:01.686178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3206,"log_dups_size":0,"ondisk_log_size":3206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41955725,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":47595,"num_write_kb":602581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"38'3892","reported_seq":3952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586501+0000","last_change":"2024-05-09T00:09:31.545900+0000","last_active":"2024-05-09T00:19:53.586501+0000","last_peered":"2024-05-09T00:19:53.586501+0000","last_clean":"2024-05-09T00:19:53.586501+0000","last_became_active":"2024-05-09T00:09:31.545211+0000","last_became_peered":"2024-05-09T00:09:31.545211+0000","last_unstale":"2024-05-09T00:19:53.586501+0000","last_undegraded":"2024-05-09T00:19:53.586501+0000","last_fullsized":"2024-05-09T00:19:53.586501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:58.479930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":57743,"num_write_kb":746959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"38'2999","reported_seq":3050,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.935933+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:20:01.935933+0000","last_peered":"2024-05-09T00:20:01.935933+0000","last_clean":"2024-05-09T00:20:01.935933+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:20:01.935933+0000","last_undegraded":"2024-05-09T00:20:01.935933+0000","last_fullsized":"2024-05-09T00:20:01.935933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2999,"log_dups_size":0,"ondisk_log_size":2999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20976898,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":44584,"num_write_kb":561827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"38'3782","reported_seq":3841,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615033+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:19:53.615033+0000","last_peered":"2024-05-09T00:19:53.615033+0000","last_clean":"2024-05-09T00:19:53.615033+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:19:53.615033+0000","last_undegraded":"2024-05-09T00:19:53.615033+0000","last_fullsized":"2024-05-09T00:19:53.615033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3782,"log_dups_size":0,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":56061,"num_write_kb":704361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"38'3120","reported_seq":3171,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.126162+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:20:00.126162+0000","last_peered":"2024-05-09T00:20:00.126162+0000","last_clean":"2024-05-09T00:20:00.126162+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:20:00.126162+0000","last_undegraded":"2024-05-09T00:20:00.126162+0000","last_fullsized":"2024-05-09T00:20:00.126162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3120,"log_dups_size":0,"ondisk_log_size":3120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88127468,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":46597,"num_write_kb":572561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"38'3200","reported_seq":3255,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644724+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:19:53.644724+0000","last_peered":"2024-05-09T00:19:53.644724+0000","last_clean":"2024-05-09T00:19:53.644724+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:19:53.644724+0000","last_undegraded":"2024-05-09T00:19:53.644724+0000","last_fullsized":"2024-05-09T00:19:53.644724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47638,"num_write_kb":598134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"38'2546","reported_seq":2606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.042585+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:20:04.042585+0000","last_peered":"2024-05-09T00:20:04.042585+0000","last_clean":"2024-05-09T00:20:04.042585+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:20:04.042585+0000","last_undegraded":"2024-05-09T00:20:04.042585+0000","last_fullsized":"2024-05-09T00:20:04.042585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":37361,"num_write_kb":466647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"38'3628","reported_seq":3685,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.341019+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:19:53.341019+0000","last_peered":"2024-05-09T00:19:53.341019+0000","last_clean":"2024-05-09T00:19:53.341019+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:19:53.341019+0000","last_undegraded":"2024-05-09T00:19:53.341019+0000","last_fullsized":"2024-05-09T00:19:53.341019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53577,"num_write_kb":665989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"38'3739","reported_seq":3795,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.166579+0000","last_change":"2024-05-09T00:09:31.551757+0000","last_active":"2024-05-09T00:20:00.166579+0000","last_peered":"2024-05-09T00:20:00.166579+0000","last_clean":"2024-05-09T00:20:00.166579+0000","last_became_active":"2024-05-09T00:09:31.551042+0000","last_became_peered":"2024-05-09T00:09:31.551042+0000","last_unstale":"2024-05-09T00:20:00.166579+0000","last_undegraded":"2024-05-09T00:20:00.166579+0000","last_fullsized":"2024-05-09T00:20:00.166579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:57.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121724226,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":55697,"num_write_kb":713868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"38'4117","reported_seq":4177,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.562024+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:19:53.562024+0000","last_peered":"2024-05-09T00:19:53.562024+0000","last_clean":"2024-05-09T00:19:53.562024+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:19:53.562024+0000","last_undegraded":"2024-05-09T00:19:53.562024+0000","last_fullsized":"2024-05-09T00:19:53.562024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":60808,"num_write_kb":797910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"38'2671","reported_seq":2723,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.037302+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:20:00.037302+0000","last_peered":"2024-05-09T00:20:00.037302+0000","last_clean":"2024-05-09T00:20:00.037302+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:20:00.037302+0000","last_undegraded":"2024-05-09T00:20:00.037302+0000","last_fullsized":"2024-05-09T00:20:00.037302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2671,"log_dups_size":0,"ondisk_log_size":2671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79741553,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":39829,"num_write_kb":524211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"38'4344","reported_seq":4407,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.471990+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:19:53.471990+0000","last_peered":"2024-05-09T00:19:53.471990+0000","last_clean":"2024-05-09T00:19:53.471990+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:19:53.471990+0000","last_undegraded":"2024-05-09T00:19:53.471990+0000","last_fullsized":"2024-05-09T00:19:53.471990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":64402,"num_write_kb":850383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"38'3007","reported_seq":3064,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.049229+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:20:00.049229+0000","last_peered":"2024-05-09T00:20:00.049229+0000","last_clean":"2024-05-09T00:20:00.049229+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:20:00.049229+0000","last_undegraded":"2024-05-09T00:20:00.049229+0000","last_fullsized":"2024-05-09T00:20:00.049229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96473039,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":44802,"num_write_kb":567733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"38'3034","reported_seq":3091,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.547327+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:19:53.547327+0000","last_peered":"2024-05-09T00:19:53.547327+0000","last_clean":"2024-05-09T00:19:53.547327+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:19:53.547327+0000","last_undegraded":"2024-05-09T00:19:53.547327+0000","last_fullsized":"2024-05-09T00:19:53.547327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":44931,"num_write_kb":564239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"38'2937","reported_seq":2993,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.666721+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:19:59.666721+0000","last_peered":"2024-05-09T00:19:59.666721+0000","last_clean":"2024-05-09T00:19:59.666721+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:19:59.666721+0000","last_undegraded":"2024-05-09T00:19:59.666721+0000","last_fullsized":"2024-05-09T00:19:59.666721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104934297,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":43707,"num_write_kb":568620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"38'3544","reported_seq":3601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.437269+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:19:53.437269+0000","last_peered":"2024-05-09T00:19:53.437269+0000","last_clean":"2024-05-09T00:19:53.437269+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:19:53.437269+0000","last_undegraded":"2024-05-09T00:19:53.437269+0000","last_fullsized":"2024-05-09T00:19:53.437269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":52851,"num_write_kb":659445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"38'2729","reported_seq":2787,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.576832+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:19:59.576832+0000","last_peered":"2024-05-09T00:19:59.576832+0000","last_clean":"2024-05-09T00:19:59.576832+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:19:59.576832+0000","last_undegraded":"2024-05-09T00:19:59.576832+0000","last_fullsized":"2024-05-09T00:19:59.576832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2729,"log_dups_size":0,"ondisk_log_size":2729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83983091,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":40847,"num_write_kb":526996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"38'3706","reported_seq":3769,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.543864+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:19:53.543864+0000","last_peered":"2024-05-09T00:19:53.543864+0000","last_clean":"2024-05-09T00:19:53.543864+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:19:53.543864+0000","last_undegraded":"2024-05-09T00:19:53.543864+0000","last_fullsized":"2024-05-09T00:19:53.543864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":54772,"num_write_kb":692736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"38'2545","reported_seq":2599,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.445767+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:20:01.445767+0000","last_peered":"2024-05-09T00:20:01.445767+0000","last_clean":"2024-05-09T00:20:01.445767+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:20:01.445767+0000","last_undegraded":"2024-05-09T00:20:01.445767+0000","last_fullsized":"2024-05-09T00:20:01.445767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2545,"log_dups_size":0,"ondisk_log_size":2545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33586309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":37701,"num_write_kb":481655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"38'3255","reported_seq":3315,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.621452+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:19:53.621452+0000","last_peered":"2024-05-09T00:19:53.621452+0000","last_clean":"2024-05-09T00:19:53.621452+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:19:53.621452+0000","last_undegraded":"2024-05-09T00:19:53.621452+0000","last_fullsized":"2024-05-09T00:19:53.621452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":48245,"num_write_kb":626583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"38'2907","reported_seq":2961,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.052055+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:20:02.052055+0000","last_peered":"2024-05-09T00:20:02.052055+0000","last_clean":"2024-05-09T00:20:02.052055+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:20:02.052055+0000","last_undegraded":"2024-05-09T00:20:02.052055+0000","last_fullsized":"2024-05-09T00:20:02.052055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":43217,"num_write_kb":536465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"38'3196","reported_seq":3248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.558142+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:19:53.558142+0000","last_peered":"2024-05-09T00:19:53.558142+0000","last_clean":"2024-05-09T00:19:53.558142+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:19:53.558142+0000","last_undegraded":"2024-05-09T00:19:53.558142+0000","last_fullsized":"2024-05-09T00:19:53.558142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":47414,"num_write_kb":607139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"38'3491","reported_seq":3545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.018459+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:20:02.018459+0000","last_peered":"2024-05-09T00:20:02.018459+0000","last_clean":"2024-05-09T00:20:02.018459+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:20:02.018459+0000","last_undegraded":"2024-05-09T00:20:02.018459+0000","last_fullsized":"2024-05-09T00:20:02.018459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37761741,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":51950,"num_write_kb":660810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"38'3882","reported_seq":3943,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.616124+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:19:53.616124+0000","last_peered":"2024-05-09T00:19:53.616124+0000","last_clean":"2024-05-09T00:19:53.616124+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:19:53.616124+0000","last_undegraded":"2024-05-09T00:19:53.616124+0000","last_fullsized":"2024-05-09T00:19:53.616124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3882,"log_dups_size":0,"ondisk_log_size":3882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":57695,"num_write_kb":692841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"38'3709","reported_seq":3759,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.181755+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:20:00.181755+0000","last_peered":"2024-05-09T00:20:00.181755+0000","last_clean":"2024-05-09T00:20:00.181755+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:20:00.181755+0000","last_undegraded":"2024-05-09T00:20:00.181755+0000","last_fullsized":"2024-05-09T00:20:00.181755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92278530,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":55049,"num_write_kb":708295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"38'4565","reported_seq":4628,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629043+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:19:53.629043+0000","last_peered":"2024-05-09T00:19:53.629043+0000","last_clean":"2024-05-09T00:19:53.629043+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:19:53.629043+0000","last_undegraded":"2024-05-09T00:19:53.629043+0000","last_fullsized":"2024-05-09T00:19:53.629043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":67870,"num_write_kb":862032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"38'3251","reported_seq":3305,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.094121+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:20:00.094121+0000","last_peered":"2024-05-09T00:20:00.094121+0000","last_clean":"2024-05-09T00:20:00.094121+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:20:00.094121+0000","last_undegraded":"2024-05-09T00:20:00.094121+0000","last_fullsized":"2024-05-09T00:20:00.094121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3251,"log_dups_size":0,"ondisk_log_size":3251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92279892,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":48572,"num_write_kb":613070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"38'3191","reported_seq":3248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628082+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:19:53.628082+0000","last_peered":"2024-05-09T00:19:53.628082+0000","last_clean":"2024-05-09T00:19:53.628082+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:19:53.628082+0000","last_undegraded":"2024-05-09T00:19:53.628082+0000","last_fullsized":"2024-05-09T00:19:53.628082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3191,"log_dups_size":0,"ondisk_log_size":3191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":47307,"num_write_kb":598779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"38'2883","reported_seq":2938,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.018082+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:20:02.018082+0000","last_peered":"2024-05-09T00:20:02.018082+0000","last_clean":"2024-05-09T00:20:02.018082+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:20:02.018082+0000","last_undegraded":"2024-05-09T00:20:02.018082+0000","last_fullsized":"2024-05-09T00:20:02.018082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":0,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33626195,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42968,"num_write_kb":536887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"38'3240","reported_seq":3297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.005810+0000","last_change":"2024-05-09T00:09:31.549449+0000","last_active":"2024-05-09T00:19:52.005810+0000","last_peered":"2024-05-09T00:19:52.005810+0000","last_clean":"2024-05-09T00:19:52.005810+0000","last_became_active":"2024-05-09T00:09:31.548548+0000","last_became_peered":"2024-05-09T00:09:31.548548+0000","last_unstale":"2024-05-09T00:19:52.005810+0000","last_undegraded":"2024-05-09T00:19:52.005810+0000","last_fullsized":"2024-05-09T00:19:52.005810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:51.033109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":48187,"num_write_kb":638325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3a","version":"38'2693","reported_seq":2744,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.182129+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:20:00.182129+0000","last_peered":"2024-05-09T00:20:00.182129+0000","last_clean":"2024-05-09T00:20:00.182129+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:20:00.182129+0000","last_undegraded":"2024-05-09T00:20:00.182129+0000","last_fullsized":"2024-05-09T00:20:00.182129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2693,"log_dups_size":0,"ondisk_log_size":2693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79692872,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40116,"num_write_kb":502625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"38'3769","reported_seq":3828,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.606261+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:19:53.606261+0000","last_peered":"2024-05-09T00:19:53.606261+0000","last_clean":"2024-05-09T00:19:53.606261+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:19:53.606261+0000","last_undegraded":"2024-05-09T00:19:53.606261+0000","last_fullsized":"2024-05-09T00:19:53.606261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7,"num_write":55645,"num_write_kb":699546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"38'3719","reported_seq":3778,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.184910+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:20:02.184910+0000","last_peered":"2024-05-09T00:20:02.184910+0000","last_clean":"2024-05-09T00:20:02.184910+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:20:02.184910+0000","last_undegraded":"2024-05-09T00:20:02.184910+0000","last_fullsized":"2024-05-09T00:20:02.184910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62924447,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":55235,"num_write_kb":668332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"38'3188","reported_seq":3243,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.430180+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:19:53.430180+0000","last_peered":"2024-05-09T00:19:53.430180+0000","last_clean":"2024-05-09T00:19:53.430180+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:19:53.430180+0000","last_undegraded":"2024-05-09T00:19:53.430180+0000","last_fullsized":"2024-05-09T00:19:53.430180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":47104,"num_write_kb":589873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"38'2874","reported_seq":2926,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.620350+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:20:00.620350+0000","last_peered":"2024-05-09T00:20:00.620350+0000","last_clean":"2024-05-09T00:20:00.620350+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:20:00.620350+0000","last_undegraded":"2024-05-09T00:20:00.620350+0000","last_fullsized":"2024-05-09T00:20:00.620350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":42933,"num_write_kb":549753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"38'4368","reported_seq":4426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645257+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:19:53.645257+0000","last_peered":"2024-05-09T00:19:53.645257+0000","last_clean":"2024-05-09T00:19:53.645257+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:19:53.645257+0000","last_undegraded":"2024-05-09T00:19:53.645257+0000","last_fullsized":"2024-05-09T00:19:53.645257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":64699,"num_write_kb":791644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"38'3218","reported_seq":3270,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.152430+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:20:00.152430+0000","last_peered":"2024-05-09T00:20:00.152430+0000","last_clean":"2024-05-09T00:20:00.152430+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:20:00.152430+0000","last_undegraded":"2024-05-09T00:20:00.152430+0000","last_fullsized":"2024-05-09T00:20:00.152430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79728345,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":47818,"num_write_kb":582702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"38'3908","reported_seq":3973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.343902+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:19:53.343902+0000","last_peered":"2024-05-09T00:19:53.343902+0000","last_clean":"2024-05-09T00:19:53.343902+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:19:53.343902+0000","last_undegraded":"2024-05-09T00:19:53.343902+0000","last_fullsized":"2024-05-09T00:19:53.343902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":58133,"num_write_kb":728914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"38'3787","reported_seq":3842,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.176946+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:20:00.176946+0000","last_peered":"2024-05-09T00:20:00.176946+0000","last_clean":"2024-05-09T00:20:00.176946+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:20:00.176946+0000","last_undegraded":"2024-05-09T00:20:00.176946+0000","last_fullsized":"2024-05-09T00:20:00.176946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109063306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56637,"num_write_kb":741300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"38'3575","reported_seq":3625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.650608+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:19:53.650608+0000","last_peered":"2024-05-09T00:19:53.650608+0000","last_clean":"2024-05-09T00:19:53.650608+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:19:53.650608+0000","last_undegraded":"2024-05-09T00:19:53.650608+0000","last_fullsized":"2024-05-09T00:19:53.650608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":52889,"num_write_kb":664811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"38'2737","reported_seq":2791,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.151387+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:20:02.151387+0000","last_peered":"2024-05-09T00:20:02.151387+0000","last_clean":"2024-05-09T00:20:02.151387+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:20:02.151387+0000","last_undegraded":"2024-05-09T00:20:02.151387+0000","last_fullsized":"2024-05-09T00:20:02.151387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50353873,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40593,"num_write_kb":513099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1156,"num_read_kb":11,"num_write":3472550,"num_write_kb":43957042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234380,"ondisk_log_size":234380,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":94511102,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":448,"num_read_kb":234535,"num_write":3110,"num_write_kb":94497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":189083648,"data_stored":189021605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2958,"ondisk_log_size":2958,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4691668055,"num_objects":1303,"num_object_clones":0,"num_object_copies":2606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1303,"num_whiteouts":0,"num_read":350,"num_read_kb":0,"num_write":2945821,"num_write_kb":37270707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8880726016,"data_stored":8879859093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197840,"ondisk_log_size":197840,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93222087,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":515,"num_read_kb":184607,"num_write":3523,"num_write_kb":93495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":186671104,"data_stored":186608646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3273,"ondisk_log_size":3273,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509579,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":448512,"kb_used_data":70456,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93923328,"statfs":{"total":96636764160,"available":96177487872,"internally_reserved":0,"allocated":72146944,"data_stored":71832288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":387119562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509576,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2248828,"kb_used_data":1770868,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":92123012,"statfs":{"total":96636764160,"available":94333964288,"internally_reserved":0,"allocated":1813368832,"data_stored":1813035309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":489421254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2213484,"kb_used_data":1718884,"kb_used_omap":1,"kb_used_meta":494590,"kb_avail":92158356,"statfs":{"total":96636764160,"available":94370156544,"internally_reserved":0,"allocated":1760137216,"data_stored":1759749786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":506460613},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2626032,"kb_used_data":2084840,"kb_used_omap":1,"kb_used_meta":504318,"kb_avail":91745808,"statfs":{"total":96636764160,"available":93947707392,"internally_reserved":0,"allocated":2134876160,"data_stored":2134513355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":516422087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509571,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2251800,"kb_used_data":1671056,"kb_used_omap":1,"kb_used_meta":580734,"kb_avail":92120040,"statfs":{"total":96636764160,"available":94330920960,"internally_reserved":0,"allocated":1711161344,"data_stored":1710802379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":594672069},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588776,"kb_used_data":1156512,"kb_used_omap":1,"kb_used_meta":432254,"kb_avail":92783064,"statfs":{"total":96636764160,"available":95009857536,"internally_reserved":0,"allocated":1184268288,"data_stored":1183933072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":442628549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1504080,"kb_used_data":951432,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":92867760,"statfs":{"total":96636764160,"available":95096586240,"internally_reserved":0,"allocated":974266368,"data_stored":973883996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542280,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700316,"kb_used_data":1159956,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":92671524,"statfs":{"total":96636764160,"available":94895640576,"internally_reserved":0,"allocated":1187794944,"data_stored":1187447656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37748792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12583584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37749318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30482432,"data_stored":30470621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13443072,"data_stored":13440761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12671116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831229952,"data_stored":831083962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1132916736,"data_stored":1132817364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1519751168,"data_stored":1519630096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1670828032,"data_stored":1670710660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":755335168,"data_stored":755238754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1636364288,"data_stored":1636219975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1334214656,"data_stored":1334114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31604736,"data_stored":31595106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35807232,"data_stored":35789553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25166406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:20:05.377 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T00:20:05.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:20:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.675+0000 7f8610a00640 1 Processor -- start 2024-05-09T00:20:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.676+0000 7f8610a00640 1 -- start start 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8610a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f860c15d300 0x7f860c06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8610a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c0c47b0 0x7f860c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8610a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860c06d1a0 con 0x7f860c06f150 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8610a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f860c070d30 con 0x7f860c15d300 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8610a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f860c0c4fa0 con 0x7f860c0c47b0 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f860c15d300 0x7f860c06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f860c15d300 0x7f860c06ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59166/0 (socket says 172.21.15.114:59166) 2024-05-09T00:20:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 -- 172.21.15.114:0/1977857730 learned_addr learned my addr 172.21.15.114:0/1977857730 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8603e00640 1 --2- 172.21.15.114:0/1977857730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c0c47b0 0x7f860c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 -- 172.21.15.114:0/1977857730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c0c47b0 msgr2=0x7f860c0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 --2- 172.21.15.114:0/1977857730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c0c47b0 0x7f860c0c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 -- 172.21.15.114:0/1977857730 >> v1:172.21.15.153:6789/0 conn(0x7f860c06f150 legacy=0x7f860c15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.678+0000 7f8609e00640 1 -- 172.21.15.114:0/1977857730 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c0c6170 con 0x7f860c15d300 2024-05-09T00:20:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.679+0000 7f8609e00640 1 --2- 172.21.15.114:0/1977857730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c15d300 0x7f860c06ec10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009870 tx=0x7f85fc02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cb0ab3c92d4624 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:05.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.680+0000 7f8609400640 1 -- 172.21.15.114:0/1977857730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc037070 con 0x7f860c15d300 2024-05-09T00:20:05.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.680+0000 7f8609400640 1 -- 172.21.15.114:0/1977857730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc02adf0 con 0x7f860c15d300 2024-05-09T00:20:05.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.680+0000 7f8609400640 1 -- 172.21.15.114:0/1977857730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc032660 con 0x7f860c15d300 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 -- 172.21.15.114:0/1977857730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c15d300 msgr2=0x7f860c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 --2- 172.21.15.114:0/1977857730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c15d300 0x7f860c06ec10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009870 tx=0x7f85fc02a0a0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 -- 172.21.15.114:0/1977857730 shutdown_connections 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 --2- 172.21.15.114:0/1977857730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c0c47b0 0x7f860c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 --2- 172.21.15.114:0/1977857730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c15d300 0x7f860c06ec10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 -- 172.21.15.114:0/1977857730 >> 172.21.15.114:0/1977857730 conn(0x7f860c0ac3b0 msgr2=0x7f860c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 -- 172.21.15.114:0/1977857730 shutdown_connections 2024-05-09T00:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.681+0000 7f8610a00640 1 -- 172.21.15.114:0/1977857730 wait complete. 2024-05-09T00:20:05.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.683+0000 7f8610a00640 1 Processor -- start 2024-05-09T00:20:05.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.683+0000 7f8610a00640 1 -- start start 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.684+0000 7f8610a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f860c06f150 0x7f860c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.684+0000 7f8610a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 0x7f860c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.684+0000 7f8610a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c15d300 0x7f860c15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.684+0000 7f8610a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f860c070ae0 con 0x7f860c0c47b0 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.684+0000 7f8610a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f860c070960 con 0x7f860c06f150 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.684+0000 7f8610a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f860c159e90 con 0x7f860c15d300 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 0x7f860c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 0x7f860c15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59180/0 (socket says 172.21.15.114:59180) 2024-05-09T00:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 -- 172.21.15.114:0/3738489036 learned_addr learned my addr 172.21.15.114:0/3738489036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:05.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8609e00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f860c06f150 0x7f860c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 -- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c15d300 msgr2=0x7f860c15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c15d300 0x7f860c15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 -- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f860c06f150 msgr2=0x7f860c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f860c06f150 0x7f860c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 -- 172.21.15.114:0/3738489036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c1f33d0 con 0x7f860c0c47b0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.685+0000 7f8603e00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 0x7f860c15a630 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c7f0 tx=0x7f85f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.686+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4015070 con 0x7f860c0c47b0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.686+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f4004220 con 0x7f860c0c47b0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.686+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4007620 con 0x7f860c0c47b0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.686+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860c0aaef0 con 0x7f860c0c47b0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.686+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860c15b790 con 0x7f860c0c47b0 2024-05-09T00:20:05.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.687+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860c077430 con 0x7f860c0c47b0 2024-05-09T00:20:05.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.688+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f85f40077c0 con 0x7f860c0c47b0 2024-05-09T00:20:05.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.689+0000 7f8602000640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f85e8076300 0x7f85e8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:05.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.689+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f85f4097bc0 con 0x7f860c0c47b0 2024-05-09T00:20:05.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.689+0000 7f8609e00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f85e8076300 0x7f85e8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:05.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.690+0000 7f8609e00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f85e8076300 0x7f85e8078810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85fc034000 tx=0x7f85fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:05.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.694+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85f4060d10 con 0x7f860c0c47b0 2024-05-09T00:20:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.896+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f860c15b1b0 con 0x7f85e8076300 2024-05-09T00:20:05.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.920+0000 7f8602000640 1 -- 172.21.15.114:0/3738489036 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495216 (secure 0 0 0) 0x7f85fc032750 con 0x7f85e8076300 2024-05-09T00:20:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:05.928 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:20:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.926+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f85e8076300 msgr2=0x7f85e8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.926+0000 7f8610a00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f85e8076300 0x7f85e8078810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85fc034000 tx=0x7f85fc02e000 comp rx=0 tx=0).stop 2024-05-09T00:20:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.926+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 msgr2=0x7f860c15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.926+0000 7f8610a00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 0x7f860c15a630 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c7f0 tx=0x7f85f400ccb0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 shutdown_connections 2024-05-09T00:20:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f85e8076300 0x7f85e8078810 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f860c15d300 0x7f860c15ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f860c0c47b0 0x7f860c15a630 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 --2- 172.21.15.114:0/3738489036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f860c06f150 0x7f860c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 >> 172.21.15.114:0/3738489036 conn(0x7f860c0ac3b0 msgr2=0x7f860c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 shutdown_connections 2024-05-09T00:20:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:05.927+0000 7f8610a00640 1 -- 172.21.15.114:0/3738489036 wait complete. 2024-05-09T00:20:05.952 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-05-09T00:20:04.633342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4879991612,"num_objects":1404,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1404,"num_whiteouts":0,"num_read":2535,"num_read_kb":419208,"num_write":6425105,"num_write_kb":81417369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438523,"ondisk_log_size":438523,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":14581828,"kb_used_data":10584004,"kb_used_omap":12,"kb_used_meta":3948595,"kb_avail":740392892,"statfs":{"total":773094113280,"available":758162321408,"internally_reserved":0,"allocated":10838020096,"data_stored":10835197841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":4043361840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,0,5,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11795246492,"num_objects":-3017,"num_object_clones":0,"num_object_copies":-6034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3017,"num_whiteouts":0,"num_read":8,"num_read_kb":51,"num_write":3132,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005960"},"pg_stats":[{"pgid":"5.18","version":"38'3510","reported_seq":3569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.649196+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:19:53.649196+0000","last_peered":"2024-05-09T00:19:53.649196+0000","last_clean":"2024-05-09T00:19:53.649196+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:19:53.649196+0000","last_undegraded":"2024-05-09T00:19:53.649196+0000","last_fullsized":"2024-05-09T00:19:53.649196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.553965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":51796,"num_write_kb":675575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"32'26","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:53.009330+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:18:53.009330+0000","last_peered":"2024-05-09T00:18:53.009330+0000","last_clean":"2024-05-09T00:18:53.009330+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:18:53.009330+0000","last_undegraded":"2024-05-09T00:18:53.009330+0000","last_fullsized":"2024-05-09T00:18:53.009330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:45.889303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":12312,"num_write":21,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"38'3237","reported_seq":3287,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.067412+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:20:00.067412+0000","last_peered":"2024-05-09T00:20:00.067412+0000","last_clean":"2024-05-09T00:20:00.067412+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:20:00.067412+0000","last_undegraded":"2024-05-09T00:20:00.067412+0000","last_fullsized":"2024-05-09T00:20:00.067412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":48370,"num_write_kb":608968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:54.772350+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:18:54.772350+0000","last_peered":"2024-05-09T00:18:54.772350+0000","last_clean":"2024-05-09T00:18:54.772350+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:18:54.772350+0000","last_undegraded":"2024-05-09T00:18:54.772350+0000","last_fullsized":"2024-05-09T00:18:54.772350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"38'4249","reported_seq":4310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.643116+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:19:53.643116+0000","last_peered":"2024-05-09T00:19:53.643116+0000","last_clean":"2024-05-09T00:19:53.643116+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:19:53.643116+0000","last_undegraded":"2024-05-09T00:19:53.643116+0000","last_fullsized":"2024-05-09T00:19:53.643116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4249,"log_dups_size":0,"ondisk_log_size":4249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:15.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":63068,"num_write_kb":790226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'6","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.172629+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:18:41.172629+0000","last_peered":"2024-05-09T00:18:41.172629+0000","last_clean":"2024-05-09T00:18:41.172629+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:18:41.172629+0000","last_undegraded":"2024-05-09T00:18:41.172629+0000","last_fullsized":"2024-05-09T00:18:41.172629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"38'3775","reported_seq":3834,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.123795+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:20:00.123795+0000","last_peered":"2024-05-09T00:20:00.123795+0000","last_clean":"2024-05-09T00:20:00.123795+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:20:00.123795+0000","last_undegraded":"2024-05-09T00:20:00.123795+0000","last_fullsized":"2024-05-09T00:20:00.123795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83947003,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":56252,"num_write_kb":712681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"38'34","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.497193+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:19:53.497193+0000","last_peered":"2024-05-09T00:19:53.497193+0000","last_clean":"2024-05-09T00:19:53.497193+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:19:53.497193+0000","last_undegraded":"2024-05-09T00:19:53.497193+0000","last_fullsized":"2024-05-09T00:19:53.497193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:06.966841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":31,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"38'3172","reported_seq":3223,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587249+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:19:53.587249+0000","last_peered":"2024-05-09T00:19:53.587249+0000","last_clean":"2024-05-09T00:19:53.587249+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:19:53.587249+0000","last_undegraded":"2024-05-09T00:19:53.587249+0000","last_fullsized":"2024-05-09T00:19:53.587249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.351331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46816,"num_write_kb":580338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"38'66","reported_seq":134,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:58.071965+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:18:58.071965+0000","last_peered":"2024-05-09T00:18:58.071965+0000","last_clean":"2024-05-09T00:18:58.071965+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:18:58.071965+0000","last_undegraded":"2024-05-09T00:18:58.071965+0000","last_fullsized":"2024-05-09T00:18:58.071965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:34.204309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":24612,"num_write":55,"num_write_kb":12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2281","reported_seq":2331,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.090946+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:20:00.090946+0000","last_peered":"2024-05-09T00:20:00.090946+0000","last_clean":"2024-05-09T00:20:00.090946+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:20:00.090946+0000","last_undegraded":"2024-05-09T00:20:00.090946+0000","last_fullsized":"2024-05-09T00:20:00.090946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:47.903977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54527679,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":33908,"num_write_kb":416723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"38'1159","reported_seq":1205,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:51.399059+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:18:51.399059+0000","last_peered":"2024-05-09T00:18:51.399059+0000","last_clean":"2024-05-09T00:18:51.399059+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:18:51.399059+0000","last_undegraded":"2024-05-09T00:18:51.399059+0000","last_fullsized":"2024-05-09T00:18:51.399059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:33.188345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1156,"num_write_kb":5131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"38'2810","reported_seq":2865,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.553020+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:19:53.553020+0000","last_peered":"2024-05-09T00:19:53.553020+0000","last_clean":"2024-05-09T00:19:53.553020+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:19:53.553020+0000","last_undegraded":"2024-05-09T00:19:53.553020+0000","last_fullsized":"2024-05-09T00:19:53.553020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:23.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":41711,"num_write_kb":539991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"38'19","reported_seq":83,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:55.401540+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:18:55.401540+0000","last_peered":"2024-05-09T00:18:55.401540+0000","last_clean":"2024-05-09T00:18:55.401540+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:18:55.401540+0000","last_undegraded":"2024-05-09T00:18:55.401540+0000","last_fullsized":"2024-05-09T00:18:55.401540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:13.856109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"38'3787","reported_seq":3841,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.861949+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:19:59.861949+0000","last_peered":"2024-05-09T00:19:59.861949+0000","last_clean":"2024-05-09T00:19:59.861949+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:19:59.861949+0000","last_undegraded":"2024-05-09T00:19:59.861949+0000","last_fullsized":"2024-05-09T00:19:59.861949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121707303,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56666,"num_write_kb":717087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"38'128","reported_seq":175,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.581503+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:19:53.581503+0000","last_peered":"2024-05-09T00:19:53.581503+0000","last_clean":"2024-05-09T00:19:53.581503+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:19:53.581503+0000","last_undegraded":"2024-05-09T00:19:53.581503+0000","last_fullsized":"2024-05-09T00:19:53.581503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.393564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12967,"num_write":119,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"38'3858","reported_seq":3920,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.611332+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:19:53.611332+0000","last_peered":"2024-05-09T00:19:53.611332+0000","last_clean":"2024-05-09T00:19:53.611332+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:19:53.611332+0000","last_undegraded":"2024-05-09T00:19:53.611332+0000","last_fullsized":"2024-05-09T00:19:53.611332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":57322,"num_write_kb":713128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"38'2889","reported_seq":2942,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.178850+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:20:00.178850+0000","last_peered":"2024-05-09T00:20:00.178850+0000","last_clean":"2024-05-09T00:20:00.178850+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:20:00.178850+0000","last_undegraded":"2024-05-09T00:20:00.178850+0000","last_fullsized":"2024-05-09T00:20:00.178850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62915277,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":43134,"num_write_kb":535156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"38'439","reported_seq":504,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.238469+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:19:55.238469+0000","last_peered":"2024-05-09T00:19:55.238469+0000","last_clean":"2024-05-09T00:19:55.238469+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:19:55.238469+0000","last_undegraded":"2024-05-09T00:19:55.238469+0000","last_fullsized":"2024-05-09T00:19:55.238469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":13833,"num_write":428,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"38'28","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:49.858859+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:18:49.858859+0000","last_peered":"2024-05-09T00:18:49.858859+0000","last_clean":"2024-05-09T00:18:49.858859+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:18:49.858859+0000","last_undegraded":"2024-05-09T00:18:49.858859+0000","last_fullsized":"2024-05-09T00:18:49.858859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":25,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"38'3696","reported_seq":3753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644711+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:19:53.644711+0000","last_peered":"2024-05-09T00:19:53.644711+0000","last_clean":"2024-05-09T00:19:53.644711+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:19:53.644711+0000","last_undegraded":"2024-05-09T00:19:53.644711+0000","last_fullsized":"2024-05-09T00:19:53.644711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54745,"num_write_kb":690364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"38'2633","reported_seq":2687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.741999+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:20:03.741999+0000","last_peered":"2024-05-09T00:20:03.741999+0000","last_clean":"2024-05-09T00:20:03.741999+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:20:03.741999+0000","last_undegraded":"2024-05-09T00:20:03.741999+0000","last_fullsized":"2024-05-09T00:20:03.741999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2633,"log_dups_size":0,"ondisk_log_size":2633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9666,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":39018,"num_write_kb":478044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"38'68","reported_seq":119,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.906828+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:19:59.906828+0000","last_peered":"2024-05-09T00:19:59.906828+0000","last_clean":"2024-05-09T00:19:59.906828+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:19:59.906828+0000","last_undegraded":"2024-05-09T00:19:59.906828+0000","last_fullsized":"2024-05-09T00:19:59.906828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":857849,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563999+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:19:53.563999+0000","last_peered":"2024-05-09T00:19:53.563999+0000","last_clean":"2024-05-09T00:19:53.563999+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:19:53.563999+0000","last_undegraded":"2024-05-09T00:19:53.563999+0000","last_fullsized":"2024-05-09T00:19:53.563999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.398986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"38'3606","reported_seq":3668,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542603+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:19:53.542603+0000","last_peered":"2024-05-09T00:19:53.542603+0000","last_clean":"2024-05-09T00:19:53.542603+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:19:53.542603+0000","last_undegraded":"2024-05-09T00:19:53.542603+0000","last_fullsized":"2024-05-09T00:19:53.542603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":53395,"num_write_kb":656713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"38'3269","reported_seq":3321,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.602843+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:20:01.602843+0000","last_peered":"2024-05-09T00:20:01.602843+0000","last_clean":"2024-05-09T00:20:01.602843+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:20:01.602843+0000","last_undegraded":"2024-05-09T00:20:01.602843+0000","last_fullsized":"2024-05-09T00:20:01.602843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3269,"log_dups_size":0,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:45.402772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71316849,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48667,"num_write_kb":618917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.111833+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:18:35.111833+0000","last_peered":"2024-05-09T00:18:35.111833+0000","last_clean":"2024-05-09T00:18:35.111833+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:18:35.111833+0000","last_undegraded":"2024-05-09T00:18:35.111833+0000","last_fullsized":"2024-05-09T00:18:35.111833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:54.926512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"38'114","reported_seq":163,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.599875+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:19:53.599875+0000","last_peered":"2024-05-09T00:19:53.599875+0000","last_clean":"2024-05-09T00:19:53.599875+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:19:53.599875+0000","last_undegraded":"2024-05-09T00:19:53.599875+0000","last_fullsized":"2024-05-09T00:19:53.599875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4101,"num_write":111,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"38'4190","reported_seq":4250,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.571284+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:19:53.571284+0000","last_peered":"2024-05-09T00:19:53.571284+0000","last_clean":"2024-05-09T00:19:53.571284+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:19:53.571284+0000","last_undegraded":"2024-05-09T00:19:53.571284+0000","last_fullsized":"2024-05-09T00:19:53.571284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:36.368952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":62004,"num_write_kb":783810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"38'2898","reported_seq":2952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.678829+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:19:59.678829+0000","last_peered":"2024-05-09T00:19:59.678829+0000","last_clean":"2024-05-09T00:19:59.678829+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:19:59.678829+0000","last_undegraded":"2024-05-09T00:19:59.678829+0000","last_fullsized":"2024-05-09T00:19:59.678829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92286709,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43352,"num_write_kb":534691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'13","reported_seq":65,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:43.263621+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:18:43.263621+0000","last_peered":"2024-05-09T00:18:43.263621+0000","last_clean":"2024-05-09T00:18:43.263621+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:18:43.263621+0000","last_undegraded":"2024-05-09T00:18:43.263621+0000","last_fullsized":"2024-05-09T00:18:43.263621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:02.476823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":10,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"38'17","reported_seq":71,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.603566+0000","last_change":"2024-05-09T00:08:54.220278+0000","last_active":"2024-05-09T00:19:53.603566+0000","last_peered":"2024-05-09T00:19:53.603566+0000","last_clean":"2024-05-09T00:19:53.603566+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:19:53.603566+0000","last_undegraded":"2024-05-09T00:19:53.603566+0000","last_fullsized":"2024-05-09T00:19:53.603566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:25.489793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":8222,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"38'3415","reported_seq":3470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613984+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:19:53.613984+0000","last_peered":"2024-05-09T00:19:53.613984+0000","last_clean":"2024-05-09T00:19:53.613984+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:19:53.613984+0000","last_undegraded":"2024-05-09T00:19:53.613984+0000","last_fullsized":"2024-05-09T00:19:53.613984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:57.611544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":50480,"num_write_kb":654641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"38'2723","reported_seq":2776,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.592620+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:20:01.592620+0000","last_peered":"2024-05-09T00:20:01.592620+0000","last_clean":"2024-05-09T00:20:01.592620+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:20:01.592620+0000","last_undegraded":"2024-05-09T00:20:01.592620+0000","last_fullsized":"2024-05-09T00:20:01.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:33.341384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46144338,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":40204,"num_write_kb":499329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"38'3","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:30.153303+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:19:30.153303+0000","last_peered":"2024-05-09T00:19:30.153303+0000","last_clean":"2024-05-09T00:19:30.153303+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:19:30.153303+0000","last_undegraded":"2024-05-09T00:19:30.153303+0000","last_fullsized":"2024-05-09T00:19:30.153303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'28","reported_seq":100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.191915+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:19:56.191915+0000","last_peered":"2024-05-09T00:19:56.191915+0000","last_clean":"2024-05-09T00:19:56.191915+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:19:56.191915+0000","last_undegraded":"2024-05-09T00:19:56.191915+0000","last_fullsized":"2024-05-09T00:19:56.191915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:40.973025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":103,"num_write":25,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"38'3402","reported_seq":3461,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.564961+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:19:53.564961+0000","last_peered":"2024-05-09T00:19:53.564961+0000","last_clean":"2024-05-09T00:19:53.564961+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:19:53.564961+0000","last_undegraded":"2024-05-09T00:19:53.564961+0000","last_fullsized":"2024-05-09T00:19:53.564961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":50468,"num_write_kb":661545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"38'3238","reported_seq":3290,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.741136+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:20:01.741136+0000","last_peered":"2024-05-09T00:20:01.741136+0000","last_clean":"2024-05-09T00:20:01.741136+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:20:01.741136+0000","last_undegraded":"2024-05-09T00:20:01.741136+0000","last_fullsized":"2024-05-09T00:20:01.741136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3238,"log_dups_size":0,"ondisk_log_size":3238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:31.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62915014,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48101,"num_write_kb":593457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"38'279","reported_seq":336,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.115388+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:20:00.115388+0000","last_peered":"2024-05-09T00:20:00.115388+0000","last_clean":"2024-05-09T00:20:00.115388+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:20:00.115388+0000","last_undegraded":"2024-05-09T00:20:00.115388+0000","last_fullsized":"2024-05-09T00:20:00.115388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:24.164853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":56,"num_write":599,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"38'125","reported_seq":173,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.594126+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:19:53.594126+0000","last_peered":"2024-05-09T00:19:53.594126+0000","last_clean":"2024-05-09T00:19:53.594126+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:19:53.594126+0000","last_undegraded":"2024-05-09T00:19:53.594126+0000","last_fullsized":"2024-05-09T00:19:53.594126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:04.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":117,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"38'3842","reported_seq":3900,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.481885+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:19:53.481885+0000","last_peered":"2024-05-09T00:19:53.481885+0000","last_clean":"2024-05-09T00:19:53.481885+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:19:53.481885+0000","last_undegraded":"2024-05-09T00:19:53.481885+0000","last_fullsized":"2024-05-09T00:19:53.481885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":57074,"num_write_kb":711138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"38'3167","reported_seq":3221,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.716024+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:19:59.716024+0000","last_peered":"2024-05-09T00:19:59.716024+0000","last_clean":"2024-05-09T00:19:59.716024+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:19:59.716024+0000","last_undegraded":"2024-05-09T00:19:59.716024+0000","last_fullsized":"2024-05-09T00:19:59.716024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104904879,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":47390,"num_write_kb":602470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.094765+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:18:35.094765+0000","last_peered":"2024-05-09T00:18:35.094765+0000","last_clean":"2024-05-09T00:18:35.094765+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:18:35.094765+0000","last_undegraded":"2024-05-09T00:18:35.094765+0000","last_fullsized":"2024-05-09T00:18:35.094765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'1","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063462+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:18:35.063462+0000","last_peered":"2024-05-09T00:18:35.063462+0000","last_clean":"2024-05-09T00:18:35.063462+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:18:35.063462+0000","last_undegraded":"2024-05-09T00:18:35.063462+0000","last_fullsized":"2024-05-09T00:18:35.063462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"38'3423","reported_seq":3485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563559+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:19:53.563559+0000","last_peered":"2024-05-09T00:19:53.563559+0000","last_clean":"2024-05-09T00:19:53.563559+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:19:53.563559+0000","last_undegraded":"2024-05-09T00:19:53.563559+0000","last_fullsized":"2024-05-09T00:19:53.563559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:48.167616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":50760,"num_write_kb":664501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"38'2699","reported_seq":2753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.188951+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:20:00.188951+0000","last_peered":"2024-05-09T00:20:00.188951+0000","last_clean":"2024-05-09T00:20:00.188951+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:20:00.188951+0000","last_undegraded":"2024-05-09T00:20:00.188951+0000","last_fullsized":"2024-05-09T00:20:00.188951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2699,"log_dups_size":0,"ondisk_log_size":2699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.321259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83895086,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40249,"num_write_kb":520250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.132892+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:18:35.132892+0000","last_peered":"2024-05-09T00:18:35.132892+0000","last_clean":"2024-05-09T00:18:35.132892+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:18:35.132892+0000","last_undegraded":"2024-05-09T00:18:35.132892+0000","last_fullsized":"2024-05-09T00:18:35.132892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'61","reported_seq":110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.601835+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:19:53.601835+0000","last_peered":"2024-05-09T00:19:53.601835+0000","last_clean":"2024-05-09T00:19:53.601835+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:19:53.601835+0000","last_undegraded":"2024-05-09T00:19:53.601835+0000","last_fullsized":"2024-05-09T00:19:53.601835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18843,"num_write":53,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"38'3161","reported_seq":3218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.561070+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:19:53.561070+0000","last_peered":"2024-05-09T00:19:53.561070+0000","last_clean":"2024-05-09T00:19:53.561070+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:19:53.561070+0000","last_undegraded":"2024-05-09T00:19:53.561070+0000","last_fullsized":"2024-05-09T00:19:53.561070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3161,"log_dups_size":0,"ondisk_log_size":3161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":46450,"num_write_kb":620498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"38'2908","reported_seq":2962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.970047+0000","last_change":"2024-05-09T00:08:45.111308+0000","last_active":"2024-05-09T00:20:01.970047+0000","last_peered":"2024-05-09T00:20:01.970047+0000","last_clean":"2024-05-09T00:20:01.970047+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:20:01.970047+0000","last_undegraded":"2024-05-09T00:20:01.970047+0000","last_fullsized":"2024-05-09T00:20:01.970047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:55.415411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25172849,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43295,"num_write_kb":562205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'30","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:44.055699+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:18:44.055699+0000","last_peered":"2024-05-09T00:18:44.055699+0000","last_clean":"2024-05-09T00:18:44.055699+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:18:44.055699+0000","last_undegraded":"2024-05-09T00:18:44.055699+0000","last_fullsized":"2024-05-09T00:18:44.055699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":25,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"38'5","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569752+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:19:53.569752+0000","last_peered":"2024-05-09T00:19:53.569752+0000","last_clean":"2024-05-09T00:19:53.569752+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:19:53.569752+0000","last_undegraded":"2024-05-09T00:19:53.569752+0000","last_fullsized":"2024-05-09T00:19:53.569752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"38'3104","reported_seq":3159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.529663+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:19:53.529663+0000","last_peered":"2024-05-09T00:19:53.529663+0000","last_clean":"2024-05-09T00:19:53.529663+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:19:53.529663+0000","last_undegraded":"2024-05-09T00:19:53.529663+0000","last_fullsized":"2024-05-09T00:19:53.529663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45747,"num_write_kb":566089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"38'2887","reported_seq":2944,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.168057+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:20:00.168057+0000","last_peered":"2024-05-09T00:20:00.168057+0000","last_clean":"2024-05-09T00:20:00.168057+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:20:00.168057+0000","last_undegraded":"2024-05-09T00:20:00.168057+0000","last_fullsized":"2024-05-09T00:20:00.168057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2887,"log_dups_size":0,"ondisk_log_size":2887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67121752,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42893,"num_write_kb":561201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"38'34","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.303256+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:20:03.303256+0000","last_peered":"2024-05-09T00:20:03.303256+0000","last_clean":"2024-05-09T00:20:03.303256+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:20:03.303256+0000","last_undegraded":"2024-05-09T00:20:03.303256+0000","last_fullsized":"2024-05-09T00:20:03.303256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":106,"num_write":32,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"38'5","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587860+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:19:53.587860+0000","last_peered":"2024-05-09T00:19:53.587860+0000","last_clean":"2024-05-09T00:19:53.587860+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:19:53.587860+0000","last_undegraded":"2024-05-09T00:19:53.587860+0000","last_fullsized":"2024-05-09T00:19:53.587860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"38'3544","reported_seq":3606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580100+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:19:53.580100+0000","last_peered":"2024-05-09T00:19:53.580100+0000","last_clean":"2024-05-09T00:19:53.580100+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:19:53.580100+0000","last_undegraded":"2024-05-09T00:19:53.580100+0000","last_fullsized":"2024-05-09T00:19:53.580100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":1,"num_write":52513,"num_write_kb":669201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"38'2987","reported_seq":3041,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.785255+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:19:59.785255+0000","last_peered":"2024-05-09T00:19:59.785255+0000","last_clean":"2024-05-09T00:19:59.785255+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:19:59.785255+0000","last_undegraded":"2024-05-09T00:19:59.785255+0000","last_fullsized":"2024-05-09T00:19:59.785255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79703100,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44733,"num_write_kb":572857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"35'440","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:42.443246+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:18:42.443246+0000","last_peered":"2024-05-09T00:18:42.443246+0000","last_clean":"2024-05-09T00:18:42.443246+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:18:42.443246+0000","last_undegraded":"2024-05-09T00:18:42.443246+0000","last_fullsized":"2024-05-09T00:18:42.443246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14538,"num_write":435,"num_write_kb":8538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"38'272","reported_seq":320,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.598361+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:19:53.598361+0000","last_peered":"2024-05-09T00:19:53.598361+0000","last_clean":"2024-05-09T00:19:53.598361+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:19:53.598361+0000","last_undegraded":"2024-05-09T00:19:53.598361+0000","last_fullsized":"2024-05-09T00:19:53.598361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":46,"num_write":564,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"38'3750","reported_seq":3813,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.599370+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:19:53.599370+0000","last_peered":"2024-05-09T00:19:53.599370+0000","last_clean":"2024-05-09T00:19:53.599370+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:19:53.599370+0000","last_undegraded":"2024-05-09T00:19:53.599370+0000","last_fullsized":"2024-05-09T00:19:53.599370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":0,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:30.004144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":55664,"num_write_kb":710441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"38'3156","reported_seq":3209,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.600243+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:20:01.600243+0000","last_peered":"2024-05-09T00:20:01.600243+0000","last_clean":"2024-05-09T00:20:01.600243+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:20:01.600243+0000","last_undegraded":"2024-05-09T00:20:01.600243+0000","last_fullsized":"2024-05-09T00:20:01.600243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3156,"log_dups_size":0,"ondisk_log_size":3156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:41.370671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92282908,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":46914,"num_write_kb":587038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.075720+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:18:35.075720+0000","last_peered":"2024-05-09T00:18:35.075720+0000","last_clean":"2024-05-09T00:18:35.075720+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:18:35.075720+0000","last_undegraded":"2024-05-09T00:18:35.075720+0000","last_fullsized":"2024-05-09T00:18:35.075720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.161123+0000","last_change":"2024-05-09T00:08:40.007198+0000","last_active":"2024-05-09T00:18:35.161123+0000","last_peered":"2024-05-09T00:18:35.161123+0000","last_clean":"2024-05-09T00:18:35.161123+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:18:35.161123+0000","last_undegraded":"2024-05-09T00:18:35.161123+0000","last_fullsized":"2024-05-09T00:18:35.161123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:38.977688+0000","last_clean_scrub_stamp":"2024-05-09T00:08:38.977688+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'4","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580602+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:19:53.580602+0000","last_peered":"2024-05-09T00:19:53.580602+0000","last_clean":"2024-05-09T00:19:53.580602+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:19:53.580602+0000","last_undegraded":"2024-05-09T00:19:53.580602+0000","last_fullsized":"2024-05-09T00:19:53.580602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"38'3132","reported_seq":3183,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.597376+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:19:53.597376+0000","last_peered":"2024-05-09T00:19:53.597376+0000","last_clean":"2024-05-09T00:19:53.597376+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:19:53.597376+0000","last_undegraded":"2024-05-09T00:19:53.597376+0000","last_fullsized":"2024-05-09T00:19:53.597376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3132,"log_dups_size":0,"ondisk_log_size":3132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46383,"num_write_kb":562908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'2961","reported_seq":3018,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.553083+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:20:00.553083+0000","last_peered":"2024-05-09T00:20:00.553083+0000","last_clean":"2024-05-09T00:20:00.553083+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:20:00.553083+0000","last_undegraded":"2024-05-09T00:20:00.553083+0000","last_fullsized":"2024-05-09T00:20:00.553083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":0,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54623816,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":44152,"num_write_kb":571148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063786+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:18:35.063786+0000","last_peered":"2024-05-09T00:18:35.063786+0000","last_clean":"2024-05-09T00:18:35.063786+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:18:35.063786+0000","last_undegraded":"2024-05-09T00:18:35.063786+0000","last_fullsized":"2024-05-09T00:18:35.063786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"38'173","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.960698+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:19:55.960698+0000","last_peered":"2024-05-09T00:19:55.960698+0000","last_clean":"2024-05-09T00:19:55.960698+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:19:55.960698+0000","last_undegraded":"2024-05-09T00:19:55.960698+0000","last_fullsized":"2024-05-09T00:19:55.960698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:11.336752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146864,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":38,"num_write":167,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"38'3176","reported_seq":3240,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.578160+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:19:53.578160+0000","last_peered":"2024-05-09T00:19:53.578160+0000","last_clean":"2024-05-09T00:19:53.578160+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:19:53.578160+0000","last_undegraded":"2024-05-09T00:19:53.578160+0000","last_fullsized":"2024-05-09T00:19:53.578160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3176,"log_dups_size":0,"ondisk_log_size":3176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":47105,"num_write_kb":619272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"38'3203","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.790954+0000","last_change":"2024-05-09T00:08:45.110924+0000","last_active":"2024-05-09T00:20:01.790954+0000","last_peered":"2024-05-09T00:20:01.790954+0000","last_clean":"2024-05-09T00:20:01.790954+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:20:01.790954+0000","last_undegraded":"2024-05-09T00:20:01.790954+0000","last_fullsized":"2024-05-09T00:20:01.790954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:31.541027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37761822,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":47550,"num_write_kb":594884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"36'17","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:43.556005+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:18:43.556005+0000","last_peered":"2024-05-09T00:18:43.556005+0000","last_clean":"2024-05-09T00:18:43.556005+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:18:43.556005+0000","last_undegraded":"2024-05-09T00:18:43.556005+0000","last_fullsized":"2024-05-09T00:18:43.556005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"38'246","reported_seq":299,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.619084+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:19:53.619084+0000","last_peered":"2024-05-09T00:19:53.619084+0000","last_clean":"2024-05-09T00:19:53.619084+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:19:53.619084+0000","last_undegraded":"2024-05-09T00:19:53.619084+0000","last_fullsized":"2024-05-09T00:19:53.619084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":16394,"num_write":232,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"38'3503","reported_seq":3561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.618310+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:19:53.618310+0000","last_peered":"2024-05-09T00:19:53.618310+0000","last_clean":"2024-05-09T00:19:53.618310+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:19:53.618310+0000","last_undegraded":"2024-05-09T00:19:53.618310+0000","last_fullsized":"2024-05-09T00:19:53.618310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:36.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":51910,"num_write_kb":640187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"38'3567","reported_seq":3620,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.794099+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:20:01.794099+0000","last_peered":"2024-05-09T00:20:01.794099+0000","last_clean":"2024-05-09T00:20:01.794099+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:20:01.794099+0000","last_undegraded":"2024-05-09T00:20:01.794099+0000","last_fullsized":"2024-05-09T00:20:01.794099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:27.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46145331,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":53051,"num_write_kb":670486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"36'17","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:55.704465+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:18:55.704465+0000","last_peered":"2024-05-09T00:18:55.704465+0000","last_clean":"2024-05-09T00:18:55.704465+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:18:55.704465+0000","last_undegraded":"2024-05-09T00:18:55.704465+0000","last_fullsized":"2024-05-09T00:18:55.704465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:12.193057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":16,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"38'22","reported_seq":67,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.567706+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:19:53.567706+0000","last_peered":"2024-05-09T00:19:53.567706+0000","last_clean":"2024-05-09T00:19:53.567706+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:19:53.567706+0000","last_undegraded":"2024-05-09T00:19:53.567706+0000","last_fullsized":"2024-05-09T00:19:53.567706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":17,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"38'3625","reported_seq":3683,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.482782+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:19:53.482782+0000","last_peered":"2024-05-09T00:19:53.482782+0000","last_clean":"2024-05-09T00:19:53.482782+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:19:53.482782+0000","last_undegraded":"2024-05-09T00:19:53.482782+0000","last_fullsized":"2024-05-09T00:19:53.482782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53630,"num_write_kb":693205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"38'2877","reported_seq":2932,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.187835+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:20:00.187835+0000","last_peered":"2024-05-09T00:20:00.187835+0000","last_clean":"2024-05-09T00:20:00.187835+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:20:00.187835+0000","last_undegraded":"2024-05-09T00:20:00.187835+0000","last_fullsized":"2024-05-09T00:20:00.187835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:20.255515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88276698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42970,"num_write_kb":541677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"38'135","reported_seq":192,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.424244+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:19:55.424244+0000","last_peered":"2024-05-09T00:19:55.424244+0000","last_clean":"2024-05-09T00:19:55.424244+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:19:55.424244+0000","last_undegraded":"2024-05-09T00:19:55.424244+0000","last_fullsized":"2024-05-09T00:19:55.424244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:42.103481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":134,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"38'3","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587165+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:19:53.587165+0000","last_peered":"2024-05-09T00:19:53.587165+0000","last_clean":"2024-05-09T00:19:53.587165+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:19:53.587165+0000","last_undegraded":"2024-05-09T00:19:53.587165+0000","last_fullsized":"2024-05-09T00:19:53.587165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:27.122162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"38'3203","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.625765+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:19:53.625765+0000","last_peered":"2024-05-09T00:19:53.625765+0000","last_clean":"2024-05-09T00:19:53.625765+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:19:53.625765+0000","last_undegraded":"2024-05-09T00:19:53.625765+0000","last_fullsized":"2024-05-09T00:19:53.625765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:32.255597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47433,"num_write_kb":581618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"38'2964","reported_seq":3019,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.789567+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:19:59.789567+0000","last_peered":"2024-05-09T00:19:59.789567+0000","last_clean":"2024-05-09T00:19:59.789567+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:19:59.789567+0000","last_undegraded":"2024-05-09T00:19:59.789567+0000","last_fullsized":"2024-05-09T00:19:59.789567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2964,"log_dups_size":0,"ondisk_log_size":2964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88106690,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":44134,"num_write_kb":579264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:57.989319+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:18:57.989319+0000","last_peered":"2024-05-09T00:18:57.989319+0000","last_clean":"2024-05-09T00:18:57.989319+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:18:57.989319+0000","last_undegraded":"2024-05-09T00:18:57.989319+0000","last_fullsized":"2024-05-09T00:18:57.989319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:13.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"38'4","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588611+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:19:53.588611+0000","last_peered":"2024-05-09T00:19:53.588611+0000","last_clean":"2024-05-09T00:19:53.588611+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:19:53.588611+0000","last_undegraded":"2024-05-09T00:19:53.588611+0000","last_fullsized":"2024-05-09T00:19:53.588611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"38'3658","reported_seq":3715,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.575409+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:19:53.575409+0000","last_peered":"2024-05-09T00:19:53.575409+0000","last_clean":"2024-05-09T00:19:53.575409+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:19:53.575409+0000","last_undegraded":"2024-05-09T00:19:53.575409+0000","last_fullsized":"2024-05-09T00:19:53.575409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54120,"num_write_kb":669829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"38'3290","reported_seq":3346,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.164126+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:20:00.164126+0000","last_peered":"2024-05-09T00:20:00.164126+0000","last_clean":"2024-05-09T00:20:00.164126+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:20:00.164126+0000","last_undegraded":"2024-05-09T00:20:00.164126+0000","last_fullsized":"2024-05-09T00:20:00.164126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:05:26.991451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104876303,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":48939,"num_write_kb":615876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'2","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.098051+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:18:35.098051+0000","last_peered":"2024-05-09T00:18:35.098051+0000","last_clean":"2024-05-09T00:18:35.098051+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:18:35.098051+0000","last_undegraded":"2024-05-09T00:18:35.098051+0000","last_fullsized":"2024-05-09T00:18:35.098051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.783045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:45.156335+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:19:45.156335+0000","last_peered":"2024-05-09T00:19:45.156335+0000","last_clean":"2024-05-09T00:19:45.156335+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:19:45.156335+0000","last_undegraded":"2024-05-09T00:19:45.156335+0000","last_fullsized":"2024-05-09T00:19:45.156335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"38'3403","reported_seq":3462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.514767+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:19:52.514767+0000","last_peered":"2024-05-09T00:19:52.514767+0000","last_clean":"2024-05-09T00:19:52.514767+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:19:52.514767+0000","last_undegraded":"2024-05-09T00:19:52.514767+0000","last_fullsized":"2024-05-09T00:19:52.514767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":50653,"num_write_kb":630818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'3516","reported_seq":3571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.115705+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:20:00.115705+0000","last_peered":"2024-05-09T00:20:00.115705+0000","last_clean":"2024-05-09T00:20:00.115705+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:20:00.115705+0000","last_undegraded":"2024-05-09T00:20:00.115705+0000","last_fullsized":"2024-05-09T00:20:00.115705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3516,"log_dups_size":0,"ondisk_log_size":3516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96479486,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":52591,"num_write_kb":653340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'1","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.069523+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:18:35.069523+0000","last_peered":"2024-05-09T00:18:35.069523+0000","last_clean":"2024-05-09T00:18:35.069523+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:18:35.069523+0000","last_undegraded":"2024-05-09T00:18:35.069523+0000","last_fullsized":"2024-05-09T00:18:35.069523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"38'235","reported_seq":303,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586376+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:19:53.586376+0000","last_peered":"2024-05-09T00:19:53.586376+0000","last_clean":"2024-05-09T00:19:53.586376+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:19:53.586376+0000","last_undegraded":"2024-05-09T00:19:53.586376+0000","last_fullsized":"2024-05-09T00:19:53.586376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":16430,"num_write":226,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"38'4717","reported_seq":4780,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542790+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:19:53.542790+0000","last_peered":"2024-05-09T00:19:53.542790+0000","last_clean":"2024-05-09T00:19:53.542790+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:19:53.542790+0000","last_undegraded":"2024-05-09T00:19:53.542790+0000","last_fullsized":"2024-05-09T00:19:53.542790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:47.362561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":69946,"num_write_kb":894340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"38'2876","reported_seq":2932,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.703135+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:19:59.703135+0000","last_peered":"2024-05-09T00:19:59.703135+0000","last_clean":"2024-05-09T00:19:59.703135+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:19:59.703135+0000","last_undegraded":"2024-05-09T00:19:59.703135+0000","last_fullsized":"2024-05-09T00:19:59.703135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2876,"log_dups_size":0,"ondisk_log_size":2876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100669385,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42818,"num_write_kb":549063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"35'194","reported_seq":260,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:42.698385+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:18:42.698385+0000","last_peered":"2024-05-09T00:18:42.698385+0000","last_clean":"2024-05-09T00:18:42.698385+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:18:42.698385+0000","last_undegraded":"2024-05-09T00:18:42.698385+0000","last_fullsized":"2024-05-09T00:18:42.698385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":12336,"num_write":190,"num_write_kb":8288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"38'20","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:54.377021+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:19:54.377021+0000","last_peered":"2024-05-09T00:19:54.377021+0000","last_clean":"2024-05-09T00:19:54.377021+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:19:54.377021+0000","last_undegraded":"2024-05-09T00:19:54.377021+0000","last_fullsized":"2024-05-09T00:19:54.377021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"38'4177","reported_seq":4234,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627752+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:19:53.627752+0000","last_peered":"2024-05-09T00:19:53.627752+0000","last_clean":"2024-05-09T00:19:53.627752+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:19:53.627752+0000","last_undegraded":"2024-05-09T00:19:53.627752+0000","last_fullsized":"2024-05-09T00:19:53.627752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.442956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":61984,"num_write_kb":766120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"38'2845","reported_seq":2897,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.155802+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:20:02.155802+0000","last_peered":"2024-05-09T00:20:02.155802+0000","last_clean":"2024-05-09T00:20:02.155802+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:20:02.155802+0000","last_undegraded":"2024-05-09T00:20:02.155802+0000","last_fullsized":"2024-05-09T00:20:02.155802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:41.930477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":42226,"num_write_kb":541614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"38'236","reported_seq":317,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:51.536810+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:19:51.536810+0000","last_peered":"2024-05-09T00:19:51.536810+0000","last_clean":"2024-05-09T00:19:51.536810+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:19:51.536810+0000","last_undegraded":"2024-05-09T00:19:51.536810+0000","last_fullsized":"2024-05-09T00:19:51.536810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:53.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":55,"num_read_kb":20534,"num_write":231,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628479+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:19:53.628479+0000","last_peered":"2024-05-09T00:19:53.628479+0000","last_clean":"2024-05-09T00:19:53.628479+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:19:53.628479+0000","last_undegraded":"2024-05-09T00:19:53.628479+0000","last_fullsized":"2024-05-09T00:19:53.628479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:04.513886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"38'3435","reported_seq":3490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.349109+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:19:53.349109+0000","last_peered":"2024-05-09T00:19:53.349109+0000","last_clean":"2024-05-09T00:19:53.349109+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:19:53.349109+0000","last_undegraded":"2024-05-09T00:19:53.349109+0000","last_fullsized":"2024-05-09T00:19:53.349109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":50796,"num_write_kb":644347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"38'4114","reported_seq":4168,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.541172+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:20:00.541172+0000","last_peered":"2024-05-09T00:20:00.541172+0000","last_clean":"2024-05-09T00:20:00.541172+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:20:00.541172+0000","last_undegraded":"2024-05-09T00:20:00.541172+0000","last_fullsized":"2024-05-09T00:20:00.541172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100863558,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":61418,"num_write_kb":763576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"38'19","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.242855+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:19:55.242855+0000","last_peered":"2024-05-09T00:19:55.242855+0000","last_clean":"2024-05-09T00:19:55.242855+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:19:55.242855+0000","last_undegraded":"2024-05-09T00:19:55.242855+0000","last_fullsized":"2024-05-09T00:19:55.242855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"38'47","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.605921+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:19:53.605921+0000","last_peered":"2024-05-09T00:19:53.605921+0000","last_clean":"2024-05-09T00:19:53.605921+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:19:53.605921+0000","last_undegraded":"2024-05-09T00:19:53.605921+0000","last_fullsized":"2024-05-09T00:19:53.605921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:17.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20520,"num_write":39,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"38'3630","reported_seq":3687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.617924+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:19:53.617924+0000","last_peered":"2024-05-09T00:19:53.617924+0000","last_clean":"2024-05-09T00:19:53.617924+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:19:53.617924+0000","last_undegraded":"2024-05-09T00:19:53.617924+0000","last_fullsized":"2024-05-09T00:19:53.617924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53585,"num_write_kb":685544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"38'2733","reported_seq":2790,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.050786+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:20:00.050786+0000","last_peered":"2024-05-09T00:20:00.050786+0000","last_clean":"2024-05-09T00:20:00.050786+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:20:00.050786+0000","last_undegraded":"2024-05-09T00:20:00.050786+0000","last_fullsized":"2024-05-09T00:20:00.050786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62970340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":40562,"num_write_kb":508970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"38'1","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.097987+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:18:35.097987+0000","last_peered":"2024-05-09T00:18:35.097987+0000","last_clean":"2024-05-09T00:18:35.097987+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:18:35.097987+0000","last_undegraded":"2024-05-09T00:18:35.097987+0000","last_fullsized":"2024-05-09T00:18:35.097987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.509485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"38'11","reported_seq":81,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569722+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:19:53.569722+0000","last_peered":"2024-05-09T00:19:53.569722+0000","last_clean":"2024-05-09T00:19:53.569722+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:19:53.569722+0000","last_undegraded":"2024-05-09T00:19:53.569722+0000","last_fullsized":"2024-05-09T00:19:53.569722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"38'3942","reported_seq":4002,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615803+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:19:53.615803+0000","last_peered":"2024-05-09T00:19:53.615803+0000","last_clean":"2024-05-09T00:19:53.615803+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:19:53.615803+0000","last_undegraded":"2024-05-09T00:19:53.615803+0000","last_fullsized":"2024-05-09T00:19:53.615803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.168967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":58547,"num_write_kb":727316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"38'3053","reported_seq":3110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.661243+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:20:00.661243+0000","last_peered":"2024-05-09T00:20:00.661243+0000","last_clean":"2024-05-09T00:20:00.661243+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:20:00.661243+0000","last_undegraded":"2024-05-09T00:20:00.661243+0000","last_fullsized":"2024-05-09T00:20:00.661243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3053,"log_dups_size":0,"ondisk_log_size":3053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:03.995393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58960980,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":45237,"num_write_kb":566177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"38'2","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.208150+0000","last_change":"2024-05-09T00:08:44.100093+0000","last_active":"2024-05-09T00:18:35.208150+0000","last_peered":"2024-05-09T00:18:35.208150+0000","last_clean":"2024-05-09T00:18:35.208150+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:18:35.208150+0000","last_undegraded":"2024-05-09T00:18:35.208150+0000","last_fullsized":"2024-05-09T00:18:35.208150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:46.349980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"38'6","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.595949+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:19:53.595949+0000","last_peered":"2024-05-09T00:19:53.595949+0000","last_clean":"2024-05-09T00:19:53.595949+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:19:53.595949+0000","last_undegraded":"2024-05-09T00:19:53.595949+0000","last_fullsized":"2024-05-09T00:19:53.595949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:53.081937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4386","reported_seq":4443,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.608899+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:19:53.608899+0000","last_peered":"2024-05-09T00:19:53.608899+0000","last_clean":"2024-05-09T00:19:53.608899+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:19:53.608899+0000","last_undegraded":"2024-05-09T00:19:53.608899+0000","last_fullsized":"2024-05-09T00:19:53.608899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4386,"log_dups_size":0,"ondisk_log_size":4386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:49.757137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":64971,"num_write_kb":841081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"38'49","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586220+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:19:53.586220+0000","last_peered":"2024-05-09T00:19:53.586220+0000","last_clean":"2024-05-09T00:19:53.586220+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:19:53.586220+0000","last_undegraded":"2024-05-09T00:19:53.586220+0000","last_fullsized":"2024-05-09T00:19:53.586220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:14.522717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":42,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"38'3542","reported_seq":3598,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.506333+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:20:01.506333+0000","last_peered":"2024-05-09T00:20:01.506333+0000","last_clean":"2024-05-09T00:20:01.506333+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:20:01.506333+0000","last_undegraded":"2024-05-09T00:20:01.506333+0000","last_fullsized":"2024-05-09T00:20:01.506333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:01.311721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79738804,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":52831,"num_write_kb":662790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"36'39","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:45.381505+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:18:45.381505+0000","last_peered":"2024-05-09T00:18:45.381505+0000","last_clean":"2024-05-09T00:18:45.381505+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:18:45.381505+0000","last_undegraded":"2024-05-09T00:18:45.381505+0000","last_fullsized":"2024-05-09T00:18:45.381505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":36,"num_write_kb":8217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3892","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.486914+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:19:53.486914+0000","last_peered":"2024-05-09T00:19:53.486914+0000","last_clean":"2024-05-09T00:19:53.486914+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:19:53.486914+0000","last_undegraded":"2024-05-09T00:19:53.486914+0000","last_fullsized":"2024-05-09T00:19:53.486914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":57751,"num_write_kb":734560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"30'34","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:02.237009+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:19:02.237009+0000","last_peered":"2024-05-09T00:19:02.237009+0000","last_clean":"2024-05-09T00:19:02.237009+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:19:02.237009+0000","last_undegraded":"2024-05-09T00:19:02.237009+0000","last_fullsized":"2024-05-09T00:19:02.237009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":16404,"num_write":31,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2961","reported_seq":3016,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.611974+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:20:00.611974+0000","last_peered":"2024-05-09T00:20:00.611974+0000","last_clean":"2024-05-09T00:20:00.611974+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:20:00.611974+0000","last_undegraded":"2024-05-09T00:20:00.611974+0000","last_fullsized":"2024-05-09T00:20:00.611974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":0,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67129429,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":43943,"num_write_kb":568639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"38'3","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.056421+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:18:35.056421+0000","last_peered":"2024-05-09T00:18:35.056421+0000","last_clean":"2024-05-09T00:18:35.056421+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:18:35.056421+0000","last_undegraded":"2024-05-09T00:18:35.056421+0000","last_fullsized":"2024-05-09T00:18:35.056421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"38'4410","reported_seq":4472,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.562323+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:19:53.562323+0000","last_peered":"2024-05-09T00:19:53.562323+0000","last_clean":"2024-05-09T00:19:53.562323+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:19:53.562323+0000","last_undegraded":"2024-05-09T00:19:53.562323+0000","last_fullsized":"2024-05-09T00:19:53.562323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.447480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":65571,"num_write_kb":822347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"38'27","reported_seq":80,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.376578+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:18:41.376578+0000","last_peered":"2024-05-09T00:18:41.376578+0000","last_clean":"2024-05-09T00:18:41.376578+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:18:41.376578+0000","last_undegraded":"2024-05-09T00:18:41.376578+0000","last_fullsized":"2024-05-09T00:18:41.376578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2394","reported_seq":2444,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.352199+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:20:01.352199+0000","last_peered":"2024-05-09T00:20:01.352199+0000","last_clean":"2024-05-09T00:20:01.352199+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:20:01.352199+0000","last_undegraded":"2024-05-09T00:20:01.352199+0000","last_fullsized":"2024-05-09T00:20:01.352199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2394,"log_dups_size":0,"ondisk_log_size":2394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:04.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62920999,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":35567,"num_write_kb":447799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"38'20","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:05.503439+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:19:05.503439+0000","last_peered":"2024-05-09T00:19:05.503439+0000","last_clean":"2024-05-09T00:19:05.503439+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:19:05.503439+0000","last_undegraded":"2024-05-09T00:19:05.503439+0000","last_fullsized":"2024-05-09T00:19:05.503439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:11.727497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2608","reported_seq":2664,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.505925+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:19:53.505925+0000","last_peered":"2024-05-09T00:19:53.505925+0000","last_clean":"2024-05-09T00:19:53.505925+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:19:53.505925+0000","last_undegraded":"2024-05-09T00:19:53.505925+0000","last_fullsized":"2024-05-09T00:19:53.505925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2608,"log_dups_size":0,"ondisk_log_size":2608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:29.684356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":38767,"num_write_kb":481995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1146","reported_seq":1201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:41.185803+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:18:41.185803+0000","last_peered":"2024-05-09T00:18:41.185803+0000","last_clean":"2024-05-09T00:18:41.185803+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:18:41.185803+0000","last_undegraded":"2024-05-09T00:18:41.185803+0000","last_fullsized":"2024-05-09T00:18:41.185803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1144,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2573","reported_seq":2624,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.881787+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:19:59.881787+0000","last_peered":"2024-05-09T00:19:59.881787+0000","last_clean":"2024-05-09T00:19:59.881787+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:19:59.881787+0000","last_undegraded":"2024-05-09T00:19:59.881787+0000","last_fullsized":"2024-05-09T00:19:59.881787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2573,"log_dups_size":0,"ondisk_log_size":2573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:41.733084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88103258,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":38306,"num_write_kb":482954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"38'91","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.576346+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:19:53.576346+0000","last_peered":"2024-05-09T00:19:53.576346+0000","last_clean":"2024-05-09T00:19:53.576346+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:19:53.576346+0000","last_undegraded":"2024-05-09T00:19:53.576346+0000","last_fullsized":"2024-05-09T00:19:53.576346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":30171,"num_write":78,"num_write_kb":12339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"38'3350","reported_seq":3396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588764+0000","last_change":"2024-05-09T00:09:31.619347+0000","last_active":"2024-05-09T00:19:53.588764+0000","last_peered":"2024-05-09T00:19:53.588764+0000","last_clean":"2024-05-09T00:19:53.588764+0000","last_became_active":"2024-05-09T00:09:31.617773+0000","last_became_peered":"2024-05-09T00:09:31.617773+0000","last_unstale":"2024-05-09T00:19:53.588764+0000","last_undegraded":"2024-05-09T00:19:53.588764+0000","last_fullsized":"2024-05-09T00:19:53.588764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:19.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":49731,"num_write_kb":622162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"38'3780","reported_seq":3833,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.564087+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:20:00.564087+0000","last_peered":"2024-05-09T00:20:00.564087+0000","last_clean":"2024-05-09T00:20:00.564087+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:20:00.564087+0000","last_undegraded":"2024-05-09T00:20:00.564087+0000","last_fullsized":"2024-05-09T00:20:00.564087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:53.486288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104860365,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56510,"num_write_kb":719929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"38'4248","reported_seq":4304,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629876+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:19:53.629876+0000","last_peered":"2024-05-09T00:19:53.629876+0000","last_clean":"2024-05-09T00:19:53.629876+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:19:53.629876+0000","last_undegraded":"2024-05-09T00:19:53.629876+0000","last_fullsized":"2024-05-09T00:19:53.629876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:44.965898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":62726,"num_write_kb":786275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"38'3362","reported_seq":3413,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.748866+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:20:03.748866+0000","last_peered":"2024-05-09T00:20:03.748866+0000","last_clean":"2024-05-09T00:20:03.748866+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:20:03.748866+0000","last_undegraded":"2024-05-09T00:20:03.748866+0000","last_fullsized":"2024-05-09T00:20:03.748866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":49795,"num_write_kb":622024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"38'3281","reported_seq":3337,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.563941+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:19:53.563941+0000","last_peered":"2024-05-09T00:19:53.563941+0000","last_clean":"2024-05-09T00:19:53.563941+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:19:53.563941+0000","last_undegraded":"2024-05-09T00:19:53.563941+0000","last_fullsized":"2024-05-09T00:19:53.563941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:31.471398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":48739,"num_write_kb":615858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"38'3779","reported_seq":3832,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.990627+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:19:59.990627+0000","last_peered":"2024-05-09T00:19:59.990627+0000","last_clean":"2024-05-09T00:19:59.990627+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:19:59.990627+0000","last_undegraded":"2024-05-09T00:19:59.990627+0000","last_fullsized":"2024-05-09T00:19:59.990627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3779,"log_dups_size":0,"ondisk_log_size":3779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121645455,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":56354,"num_write_kb":712291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"38'3855","reported_seq":3921,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.454978+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:19:53.454978+0000","last_peered":"2024-05-09T00:19:53.454978+0000","last_clean":"2024-05-09T00:19:53.454978+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:19:53.454978+0000","last_undegraded":"2024-05-09T00:19:53.454978+0000","last_fullsized":"2024-05-09T00:19:53.454978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":57187,"num_write_kb":738779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"38'2575","reported_seq":2630,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.619381+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:20:00.619381+0000","last_peered":"2024-05-09T00:20:00.619381+0000","last_clean":"2024-05-09T00:20:00.619381+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:20:00.619381+0000","last_undegraded":"2024-05-09T00:20:00.619381+0000","last_fullsized":"2024-05-09T00:20:00.619381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79693826,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":38405,"num_write_kb":503771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"38'4370","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.526382+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:19:53.526382+0000","last_peered":"2024-05-09T00:19:53.526382+0000","last_clean":"2024-05-09T00:19:53.526382+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:19:53.526382+0000","last_undegraded":"2024-05-09T00:19:53.526382+0000","last_fullsized":"2024-05-09T00:19:53.526382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:02.921116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":64728,"num_write_kb":825535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"38'2737","reported_seq":2789,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.609580+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:19:59.609580+0000","last_peered":"2024-05-09T00:19:59.609580+0000","last_clean":"2024-05-09T00:19:59.609580+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:19:59.609580+0000","last_undegraded":"2024-05-09T00:19:59.609580+0000","last_fullsized":"2024-05-09T00:19:59.609580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88110052,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40705,"num_write_kb":512798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"38'3218","reported_seq":3281,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.602708+0000","last_change":"2024-05-09T00:09:31.551214+0000","last_active":"2024-05-09T00:19:53.602708+0000","last_peered":"2024-05-09T00:19:53.602708+0000","last_clean":"2024-05-09T00:19:53.602708+0000","last_became_active":"2024-05-09T00:09:31.550552+0000","last_became_peered":"2024-05-09T00:09:31.550552+0000","last_unstale":"2024-05-09T00:19:53.602708+0000","last_undegraded":"2024-05-09T00:19:53.602708+0000","last_fullsized":"2024-05-09T00:19:53.602708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:09.658798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":47610,"num_write_kb":596071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"38'3259","reported_seq":3310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.638677+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:19:59.638677+0000","last_peered":"2024-05-09T00:19:59.638677+0000","last_clean":"2024-05-09T00:19:59.638677+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:19:59.638677+0000","last_undegraded":"2024-05-09T00:19:59.638677+0000","last_fullsized":"2024-05-09T00:19:59.638677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3259,"log_dups_size":0,"ondisk_log_size":3259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88081110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":48606,"num_write_kb":610539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"38'4466","reported_seq":4526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613481+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:19:53.613481+0000","last_peered":"2024-05-09T00:19:53.613481+0000","last_clean":"2024-05-09T00:19:53.613481+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:19:53.613481+0000","last_undegraded":"2024-05-09T00:19:53.613481+0000","last_fullsized":"2024-05-09T00:19:53.613481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":66102,"num_write_kb":855861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"38'2887","reported_seq":2939,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.569147+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:20:00.569147+0000","last_peered":"2024-05-09T00:20:00.569147+0000","last_clean":"2024-05-09T00:20:00.569147+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:20:00.569147+0000","last_undegraded":"2024-05-09T00:20:00.569147+0000","last_fullsized":"2024-05-09T00:20:00.569147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2887,"log_dups_size":0,"ondisk_log_size":2887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:00.401890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105284448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":43055,"num_write_kb":548362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"38'3894","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.348618+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:19:53.348618+0000","last_peered":"2024-05-09T00:19:53.348618+0000","last_clean":"2024-05-09T00:19:53.348618+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:19:53.348618+0000","last_undegraded":"2024-05-09T00:19:53.348618+0000","last_fullsized":"2024-05-09T00:19:53.348618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:02.107333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":57917,"num_write_kb":734296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"38'3579","reported_seq":3635,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.903073+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:19:59.903073+0000","last_peered":"2024-05-09T00:19:59.903073+0000","last_clean":"2024-05-09T00:19:59.903073+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:19:59.903073+0000","last_undegraded":"2024-05-09T00:19:59.903073+0000","last_fullsized":"2024-05-09T00:19:59.903073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3579,"log_dups_size":0,"ondisk_log_size":3579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121685034,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":53538,"num_write_kb":689167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"38'3075","reported_seq":3129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627461+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:19:53.627461+0000","last_peered":"2024-05-09T00:19:53.627461+0000","last_clean":"2024-05-09T00:19:53.627461+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:19:53.627461+0000","last_undegraded":"2024-05-09T00:19:53.627461+0000","last_fullsized":"2024-05-09T00:19:53.627461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45134,"num_write_kb":543879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"38'2766","reported_seq":2818,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.116179+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:20:00.116179+0000","last_peered":"2024-05-09T00:20:00.116179+0000","last_clean":"2024-05-09T00:20:00.116179+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:20:00.116179+0000","last_undegraded":"2024-05-09T00:20:00.116179+0000","last_fullsized":"2024-05-09T00:20:00.116179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67113963,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":41135,"num_write_kb":511430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"38'4375","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.541127+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:19:53.541127+0000","last_peered":"2024-05-09T00:19:53.541127+0000","last_clean":"2024-05-09T00:19:53.541127+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:19:53.541127+0000","last_undegraded":"2024-05-09T00:19:53.541127+0000","last_fullsized":"2024-05-09T00:19:53.541127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":64891,"num_write_kb":820909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"38'2997","reported_seq":3051,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.598575+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:20:00.598575+0000","last_peered":"2024-05-09T00:20:00.598575+0000","last_clean":"2024-05-09T00:20:00.598575+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:20:00.598575+0000","last_undegraded":"2024-05-09T00:20:00.598575+0000","last_fullsized":"2024-05-09T00:20:00.598575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2997,"log_dups_size":0,"ondisk_log_size":2997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67176152,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44637,"num_write_kb":570209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"38'3563","reported_seq":3621,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.600582+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:19:53.600582+0000","last_peered":"2024-05-09T00:19:53.600582+0000","last_clean":"2024-05-09T00:19:53.600582+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:19:53.600582+0000","last_undegraded":"2024-05-09T00:19:53.600582+0000","last_fullsized":"2024-05-09T00:19:53.600582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":52470,"num_write_kb":678263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"38'3348","reported_seq":3401,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.640957+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:20:00.640957+0000","last_peered":"2024-05-09T00:20:00.640957+0000","last_clean":"2024-05-09T00:20:00.640957+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:20:00.640957+0000","last_undegraded":"2024-05-09T00:20:00.640957+0000","last_fullsized":"2024-05-09T00:20:00.640957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3348,"log_dups_size":0,"ondisk_log_size":3348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:19.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79697922,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":49832,"num_write_kb":630819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"38'3672","reported_seq":3731,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627538+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:19:53.627538+0000","last_peered":"2024-05-09T00:19:53.627538+0000","last_clean":"2024-05-09T00:19:53.627538+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:19:53.627538+0000","last_undegraded":"2024-05-09T00:19:53.627538+0000","last_fullsized":"2024-05-09T00:19:53.627538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":54179,"num_write_kb":674825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"38'3206","reported_seq":3264,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.686178+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:20:01.686178+0000","last_peered":"2024-05-09T00:20:01.686178+0000","last_clean":"2024-05-09T00:20:01.686178+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:20:01.686178+0000","last_undegraded":"2024-05-09T00:20:01.686178+0000","last_fullsized":"2024-05-09T00:20:01.686178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3206,"log_dups_size":0,"ondisk_log_size":3206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:25.315140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41955725,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":47595,"num_write_kb":602581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"38'3892","reported_seq":3952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.586501+0000","last_change":"2024-05-09T00:09:31.545900+0000","last_active":"2024-05-09T00:19:53.586501+0000","last_peered":"2024-05-09T00:19:53.586501+0000","last_clean":"2024-05-09T00:19:53.586501+0000","last_became_active":"2024-05-09T00:09:31.545211+0000","last_became_peered":"2024-05-09T00:09:31.545211+0000","last_unstale":"2024-05-09T00:19:53.586501+0000","last_undegraded":"2024-05-09T00:19:53.586501+0000","last_fullsized":"2024-05-09T00:19:53.586501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:58.479930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":57743,"num_write_kb":746959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"38'2999","reported_seq":3050,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.935933+0000","last_change":"2024-05-09T00:08:45.111339+0000","last_active":"2024-05-09T00:20:01.935933+0000","last_peered":"2024-05-09T00:20:01.935933+0000","last_clean":"2024-05-09T00:20:01.935933+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:20:01.935933+0000","last_undegraded":"2024-05-09T00:20:01.935933+0000","last_fullsized":"2024-05-09T00:20:01.935933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2999,"log_dups_size":0,"ondisk_log_size":2999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:19.885664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20976898,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":44584,"num_write_kb":561827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"38'3782","reported_seq":3841,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615033+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:19:53.615033+0000","last_peered":"2024-05-09T00:19:53.615033+0000","last_clean":"2024-05-09T00:19:53.615033+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:19:53.615033+0000","last_undegraded":"2024-05-09T00:19:53.615033+0000","last_fullsized":"2024-05-09T00:19:53.615033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3782,"log_dups_size":0,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:12.500591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":56061,"num_write_kb":704361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"38'3120","reported_seq":3171,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.126162+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:20:00.126162+0000","last_peered":"2024-05-09T00:20:00.126162+0000","last_clean":"2024-05-09T00:20:00.126162+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:20:00.126162+0000","last_undegraded":"2024-05-09T00:20:00.126162+0000","last_fullsized":"2024-05-09T00:20:00.126162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3120,"log_dups_size":0,"ondisk_log_size":3120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88127468,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":46597,"num_write_kb":572561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"38'3200","reported_seq":3255,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644724+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:19:53.644724+0000","last_peered":"2024-05-09T00:19:53.644724+0000","last_clean":"2024-05-09T00:19:53.644724+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:19:53.644724+0000","last_undegraded":"2024-05-09T00:19:53.644724+0000","last_fullsized":"2024-05-09T00:19:53.644724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:44.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47638,"num_write_kb":598134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"38'2546","reported_seq":2606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.042585+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:20:04.042585+0000","last_peered":"2024-05-09T00:20:04.042585+0000","last_clean":"2024-05-09T00:20:04.042585+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:20:04.042585+0000","last_undegraded":"2024-05-09T00:20:04.042585+0000","last_fullsized":"2024-05-09T00:20:04.042585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":37361,"num_write_kb":466647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"38'3628","reported_seq":3685,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.341019+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:19:53.341019+0000","last_peered":"2024-05-09T00:19:53.341019+0000","last_clean":"2024-05-09T00:19:53.341019+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:19:53.341019+0000","last_undegraded":"2024-05-09T00:19:53.341019+0000","last_fullsized":"2024-05-09T00:19:53.341019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53577,"num_write_kb":665989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"38'3739","reported_seq":3795,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.166579+0000","last_change":"2024-05-09T00:09:31.551757+0000","last_active":"2024-05-09T00:20:00.166579+0000","last_peered":"2024-05-09T00:20:00.166579+0000","last_clean":"2024-05-09T00:20:00.166579+0000","last_became_active":"2024-05-09T00:09:31.551042+0000","last_became_peered":"2024-05-09T00:09:31.551042+0000","last_unstale":"2024-05-09T00:20:00.166579+0000","last_undegraded":"2024-05-09T00:20:00.166579+0000","last_fullsized":"2024-05-09T00:20:00.166579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:57.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121724226,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":55697,"num_write_kb":713868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"38'4117","reported_seq":4177,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.562024+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:19:53.562024+0000","last_peered":"2024-05-09T00:19:53.562024+0000","last_clean":"2024-05-09T00:19:53.562024+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:19:53.562024+0000","last_undegraded":"2024-05-09T00:19:53.562024+0000","last_fullsized":"2024-05-09T00:19:53.562024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:00.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":60808,"num_write_kb":797910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"38'2671","reported_seq":2723,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.037302+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:20:00.037302+0000","last_peered":"2024-05-09T00:20:00.037302+0000","last_clean":"2024-05-09T00:20:00.037302+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:20:00.037302+0000","last_undegraded":"2024-05-09T00:20:00.037302+0000","last_fullsized":"2024-05-09T00:20:00.037302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2671,"log_dups_size":0,"ondisk_log_size":2671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79741553,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":39829,"num_write_kb":524211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"38'4344","reported_seq":4407,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.471990+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:19:53.471990+0000","last_peered":"2024-05-09T00:19:53.471990+0000","last_clean":"2024-05-09T00:19:53.471990+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:19:53.471990+0000","last_undegraded":"2024-05-09T00:19:53.471990+0000","last_fullsized":"2024-05-09T00:19:53.471990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:16.437578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":64402,"num_write_kb":850383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"38'3007","reported_seq":3064,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.049229+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:20:00.049229+0000","last_peered":"2024-05-09T00:20:00.049229+0000","last_clean":"2024-05-09T00:20:00.049229+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:20:00.049229+0000","last_undegraded":"2024-05-09T00:20:00.049229+0000","last_fullsized":"2024-05-09T00:20:00.049229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96473039,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":44802,"num_write_kb":567733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"38'3034","reported_seq":3091,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.547327+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:19:53.547327+0000","last_peered":"2024-05-09T00:19:53.547327+0000","last_clean":"2024-05-09T00:19:53.547327+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:19:53.547327+0000","last_undegraded":"2024-05-09T00:19:53.547327+0000","last_fullsized":"2024-05-09T00:19:53.547327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:16.730287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":44931,"num_write_kb":564239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"38'2937","reported_seq":2993,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.666721+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:19:59.666721+0000","last_peered":"2024-05-09T00:19:59.666721+0000","last_clean":"2024-05-09T00:19:59.666721+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:19:59.666721+0000","last_undegraded":"2024-05-09T00:19:59.666721+0000","last_fullsized":"2024-05-09T00:19:59.666721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104934297,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":43707,"num_write_kb":568620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"38'3544","reported_seq":3601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.437269+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:19:53.437269+0000","last_peered":"2024-05-09T00:19:53.437269+0000","last_clean":"2024-05-09T00:19:53.437269+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:19:53.437269+0000","last_undegraded":"2024-05-09T00:19:53.437269+0000","last_fullsized":"2024-05-09T00:19:53.437269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":52851,"num_write_kb":659445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"38'2729","reported_seq":2787,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:59.576832+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:19:59.576832+0000","last_peered":"2024-05-09T00:19:59.576832+0000","last_clean":"2024-05-09T00:19:59.576832+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:19:59.576832+0000","last_undegraded":"2024-05-09T00:19:59.576832+0000","last_fullsized":"2024-05-09T00:19:59.576832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2729,"log_dups_size":0,"ondisk_log_size":2729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83983091,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":40847,"num_write_kb":526996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"38'3706","reported_seq":3769,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.543864+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:19:53.543864+0000","last_peered":"2024-05-09T00:19:53.543864+0000","last_clean":"2024-05-09T00:19:53.543864+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:19:53.543864+0000","last_undegraded":"2024-05-09T00:19:53.543864+0000","last_fullsized":"2024-05-09T00:19:53.543864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:27.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":54772,"num_write_kb":692736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"38'2545","reported_seq":2599,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:01.445767+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:20:01.445767+0000","last_peered":"2024-05-09T00:20:01.445767+0000","last_clean":"2024-05-09T00:20:01.445767+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:20:01.445767+0000","last_undegraded":"2024-05-09T00:20:01.445767+0000","last_fullsized":"2024-05-09T00:20:01.445767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2545,"log_dups_size":0,"ondisk_log_size":2545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.686808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33586309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":37701,"num_write_kb":481655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"38'3255","reported_seq":3315,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.621452+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:19:53.621452+0000","last_peered":"2024-05-09T00:19:53.621452+0000","last_clean":"2024-05-09T00:19:53.621452+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:19:53.621452+0000","last_undegraded":"2024-05-09T00:19:53.621452+0000","last_fullsized":"2024-05-09T00:19:53.621452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":48245,"num_write_kb":626583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"38'2907","reported_seq":2961,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.052055+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:20:02.052055+0000","last_peered":"2024-05-09T00:20:02.052055+0000","last_clean":"2024-05-09T00:20:02.052055+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:20:02.052055+0000","last_undegraded":"2024-05-09T00:20:02.052055+0000","last_fullsized":"2024-05-09T00:20:02.052055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:01.121111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":43217,"num_write_kb":536465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"38'3196","reported_seq":3248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.558142+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:19:53.558142+0000","last_peered":"2024-05-09T00:19:53.558142+0000","last_clean":"2024-05-09T00:19:53.558142+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:19:53.558142+0000","last_undegraded":"2024-05-09T00:19:53.558142+0000","last_fullsized":"2024-05-09T00:19:53.558142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":47414,"num_write_kb":607139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"38'3491","reported_seq":3545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.018459+0000","last_change":"2024-05-09T00:08:45.117326+0000","last_active":"2024-05-09T00:20:02.018459+0000","last_peered":"2024-05-09T00:20:02.018459+0000","last_clean":"2024-05-09T00:20:02.018459+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:20:02.018459+0000","last_undegraded":"2024-05-09T00:20:02.018459+0000","last_fullsized":"2024-05-09T00:20:02.018459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:15.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37761741,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":51950,"num_write_kb":660810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"38'3882","reported_seq":3943,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.616124+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:19:53.616124+0000","last_peered":"2024-05-09T00:19:53.616124+0000","last_clean":"2024-05-09T00:19:53.616124+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:19:53.616124+0000","last_undegraded":"2024-05-09T00:19:53.616124+0000","last_fullsized":"2024-05-09T00:19:53.616124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3882,"log_dups_size":0,"ondisk_log_size":3882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:03:01.990920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":57695,"num_write_kb":692841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"38'3709","reported_seq":3759,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.181755+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:20:00.181755+0000","last_peered":"2024-05-09T00:20:00.181755+0000","last_clean":"2024-05-09T00:20:00.181755+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:20:00.181755+0000","last_undegraded":"2024-05-09T00:20:00.181755+0000","last_fullsized":"2024-05-09T00:20:00.181755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:19.547280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92278530,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":55049,"num_write_kb":708295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"38'4565","reported_seq":4628,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629043+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:19:53.629043+0000","last_peered":"2024-05-09T00:19:53.629043+0000","last_clean":"2024-05-09T00:19:53.629043+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:19:53.629043+0000","last_undegraded":"2024-05-09T00:19:53.629043+0000","last_fullsized":"2024-05-09T00:19:53.629043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":67870,"num_write_kb":862032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"38'3251","reported_seq":3305,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.094121+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:20:00.094121+0000","last_peered":"2024-05-09T00:20:00.094121+0000","last_clean":"2024-05-09T00:20:00.094121+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:20:00.094121+0000","last_undegraded":"2024-05-09T00:20:00.094121+0000","last_fullsized":"2024-05-09T00:20:00.094121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3251,"log_dups_size":0,"ondisk_log_size":3251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92279892,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":48572,"num_write_kb":613070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"38'3191","reported_seq":3248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628082+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:19:53.628082+0000","last_peered":"2024-05-09T00:19:53.628082+0000","last_clean":"2024-05-09T00:19:53.628082+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:19:53.628082+0000","last_undegraded":"2024-05-09T00:19:53.628082+0000","last_fullsized":"2024-05-09T00:19:53.628082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3191,"log_dups_size":0,"ondisk_log_size":3191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:53.882870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":47307,"num_write_kb":598779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"38'2883","reported_seq":2938,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.018082+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:20:02.018082+0000","last_peered":"2024-05-09T00:20:02.018082+0000","last_clean":"2024-05-09T00:20:02.018082+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:20:02.018082+0000","last_undegraded":"2024-05-09T00:20:02.018082+0000","last_fullsized":"2024-05-09T00:20:02.018082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":0,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:16.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33626195,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42968,"num_write_kb":536887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"38'3240","reported_seq":3297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.005810+0000","last_change":"2024-05-09T00:09:31.549449+0000","last_active":"2024-05-09T00:19:52.005810+0000","last_peered":"2024-05-09T00:19:52.005810+0000","last_clean":"2024-05-09T00:19:52.005810+0000","last_became_active":"2024-05-09T00:09:31.548548+0000","last_became_peered":"2024-05-09T00:09:31.548548+0000","last_unstale":"2024-05-09T00:19:52.005810+0000","last_undegraded":"2024-05-09T00:19:52.005810+0000","last_fullsized":"2024-05-09T00:19:52.005810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:51.033109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":48187,"num_write_kb":638325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3a","version":"38'2693","reported_seq":2744,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.182129+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:20:00.182129+0000","last_peered":"2024-05-09T00:20:00.182129+0000","last_clean":"2024-05-09T00:20:00.182129+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:20:00.182129+0000","last_undegraded":"2024-05-09T00:20:00.182129+0000","last_fullsized":"2024-05-09T00:20:00.182129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2693,"log_dups_size":0,"ondisk_log_size":2693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:52.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79692872,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40116,"num_write_kb":502625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"38'3769","reported_seq":3828,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.606261+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:19:53.606261+0000","last_peered":"2024-05-09T00:19:53.606261+0000","last_clean":"2024-05-09T00:19:53.606261+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:19:53.606261+0000","last_undegraded":"2024-05-09T00:19:53.606261+0000","last_fullsized":"2024-05-09T00:19:53.606261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:49.429717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7,"num_write":55645,"num_write_kb":699546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"38'3719","reported_seq":3778,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.184910+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:20:02.184910+0000","last_peered":"2024-05-09T00:20:02.184910+0000","last_clean":"2024-05-09T00:20:02.184910+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:20:02.184910+0000","last_undegraded":"2024-05-09T00:20:02.184910+0000","last_fullsized":"2024-05-09T00:20:02.184910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:06.457215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62924447,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":55235,"num_write_kb":668332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"38'3188","reported_seq":3243,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.430180+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:19:53.430180+0000","last_peered":"2024-05-09T00:19:53.430180+0000","last_clean":"2024-05-09T00:19:53.430180+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:19:53.430180+0000","last_undegraded":"2024-05-09T00:19:53.430180+0000","last_fullsized":"2024-05-09T00:19:53.430180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":47104,"num_write_kb":589873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"38'2874","reported_seq":2926,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.620350+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:20:00.620350+0000","last_peered":"2024-05-09T00:20:00.620350+0000","last_clean":"2024-05-09T00:20:00.620350+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:20:00.620350+0000","last_undegraded":"2024-05-09T00:20:00.620350+0000","last_fullsized":"2024-05-09T00:20:00.620350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:33.732899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":42933,"num_write_kb":549753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"38'4368","reported_seq":4426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645257+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:19:53.645257+0000","last_peered":"2024-05-09T00:19:53.645257+0000","last_clean":"2024-05-09T00:19:53.645257+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:19:53.645257+0000","last_undegraded":"2024-05-09T00:19:53.645257+0000","last_fullsized":"2024-05-09T00:19:53.645257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":64699,"num_write_kb":791644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"38'3218","reported_seq":3270,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.152430+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:20:00.152430+0000","last_peered":"2024-05-09T00:20:00.152430+0000","last_clean":"2024-05-09T00:20:00.152430+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:20:00.152430+0000","last_undegraded":"2024-05-09T00:20:00.152430+0000","last_fullsized":"2024-05-09T00:20:00.152430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79728345,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":47818,"num_write_kb":582702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"38'3908","reported_seq":3973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.343902+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:19:53.343902+0000","last_peered":"2024-05-09T00:19:53.343902+0000","last_clean":"2024-05-09T00:19:53.343902+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:19:53.343902+0000","last_undegraded":"2024-05-09T00:19:53.343902+0000","last_fullsized":"2024-05-09T00:19:53.343902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:16.391835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":58133,"num_write_kb":728914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"38'3787","reported_seq":3842,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:00.176946+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:20:00.176946+0000","last_peered":"2024-05-09T00:20:00.176946+0000","last_clean":"2024-05-09T00:20:00.176946+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:20:00.176946+0000","last_undegraded":"2024-05-09T00:20:00.176946+0000","last_fullsized":"2024-05-09T00:20:00.176946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109063306,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56637,"num_write_kb":741300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"38'3575","reported_seq":3625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.650608+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:19:53.650608+0000","last_peered":"2024-05-09T00:19:53.650608+0000","last_clean":"2024-05-09T00:19:53.650608+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:19:53.650608+0000","last_undegraded":"2024-05-09T00:19:53.650608+0000","last_fullsized":"2024-05-09T00:19:53.650608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:25.090278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":52889,"num_write_kb":664811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"38'2737","reported_seq":2791,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:02.151387+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:20:02.151387+0000","last_peered":"2024-05-09T00:20:02.151387+0000","last_clean":"2024-05-09T00:20:02.151387+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:20:02.151387+0000","last_undegraded":"2024-05-09T00:20:02.151387+0000","last_fullsized":"2024-05-09T00:20:02.151387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:53.734269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50353873,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40593,"num_write_kb":513099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1156,"num_read_kb":11,"num_write":3472550,"num_write_kb":43957042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234380,"ondisk_log_size":234380,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":94511102,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":448,"num_read_kb":234535,"num_write":3110,"num_write_kb":94497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":189083648,"data_stored":189021605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2958,"ondisk_log_size":2958,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4691668055,"num_objects":1303,"num_object_clones":0,"num_object_copies":2606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1303,"num_whiteouts":0,"num_read":350,"num_read_kb":0,"num_write":2945821,"num_write_kb":37270707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8880726016,"data_stored":8879859093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197840,"ondisk_log_size":197840,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93222087,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":515,"num_read_kb":184607,"num_write":3523,"num_write_kb":93495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":186671104,"data_stored":186608646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3273,"ondisk_log_size":3273,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509579,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":448512,"kb_used_data":70456,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93923328,"statfs":{"total":96636764160,"available":96177487872,"internally_reserved":0,"allocated":72146944,"data_stored":71832288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":387119562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509576,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2248828,"kb_used_data":1770868,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":92123012,"statfs":{"total":96636764160,"available":94333964288,"internally_reserved":0,"allocated":1813368832,"data_stored":1813035309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":489421254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2213484,"kb_used_data":1718884,"kb_used_omap":1,"kb_used_meta":494590,"kb_avail":92158356,"statfs":{"total":96636764160,"available":94370156544,"internally_reserved":0,"allocated":1760137216,"data_stored":1759749786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":506460613},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2626032,"kb_used_data":2084840,"kb_used_omap":1,"kb_used_meta":504318,"kb_avail":91745808,"statfs":{"total":96636764160,"available":93947707392,"internally_reserved":0,"allocated":2134876160,"data_stored":2134513355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":516422087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509571,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2251800,"kb_used_data":1671056,"kb_used_omap":1,"kb_used_meta":580734,"kb_avail":92120040,"statfs":{"total":96636764160,"available":94330920960,"internally_reserved":0,"allocated":1711161344,"data_stored":1710802379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":594672069},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588776,"kb_used_data":1156512,"kb_used_omap":1,"kb_used_meta":432254,"kb_avail":92783064,"statfs":{"total":96636764160,"available":95009857536,"internally_reserved":0,"allocated":1184268288,"data_stored":1183933072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":442628549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1504080,"kb_used_data":951432,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":92867760,"statfs":{"total":96636764160,"available":95096586240,"internally_reserved":0,"allocated":974266368,"data_stored":973883996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542280,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700316,"kb_used_data":1159956,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":92671524,"statfs":{"total":96636764160,"available":94895640576,"internally_reserved":0,"allocated":1187794944,"data_stored":1187447656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37748792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12583584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37749318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30482432,"data_stored":30470621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13443072,"data_stored":13440761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12671116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831229952,"data_stored":831083962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1132916736,"data_stored":1132817364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1519751168,"data_stored":1519630096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1670828032,"data_stored":1670710660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":755335168,"data_stored":755238754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1636364288,"data_stored":1636219975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1334214656,"data_stored":1334114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31604736,"data_stored":31595106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35807232,"data_stored":35789553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25166406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:20:05.959 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:20:06.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.248+0000 7f9535200640 1 Processor -- start 2024-05-09T00:20:06.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.248+0000 7f9535200640 1 -- start start 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f9535200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95300c43c0 0x7f9530153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f9535200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9530156bb0 con 0x7f95300ae940 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f9535200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9530156e90 con 0x7f9530159830 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f9535200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f95300ac710 con 0x7f95300c43c0 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f952e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f95300ae940 0x7f95300aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52150/0 (socket says 172.21.15.114:52150) 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f952e800640 1 -- 172.21.15.114:0/979256692 learned_addr learned my addr 172.21.15.114:0/979256692 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.250+0000 7f952de00640 1 --2- 172.21.15.114:0/979256692 >> v2:172.21.15.114:3300/0 conn(0x7f95300c43c0 0x7f9530153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.251+0000 7f952de00640 1 -- 172.21.15.114:0/979256692 >> v1:172.21.15.153:6789/0 conn(0x7f9530159830 legacy=0x7f9530159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.251+0000 7f952de00640 1 -- 172.21.15.114:0/979256692 >> v1:172.21.15.114:6789/0 conn(0x7f95300ae940 legacy=0x7f95300aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.251+0000 7f952de00640 1 -- 172.21.15.114:0/979256692 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95300ac960 con 0x7f95300c43c0 2024-05-09T00:20:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.251+0000 7f952d400640 1 -- 172.21.15.114:0/979256692 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956600557 0 0) 0x7f9530156bb0 con 0x7f95300ae940 2024-05-09T00:20:06.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.252+0000 7f952de00640 1 --2- 172.21.15.114:0/979256692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300c43c0 0x7f9530153760 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f95300ac890 tx=0x7f952002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee12088b0b995f84 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:06.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.252+0000 7f952d400640 1 -- 172.21.15.114:0/979256692 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520007740 con 0x7f95300c43c0 2024-05-09T00:20:06.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.252+0000 7f952d400640 1 -- 172.21.15.114:0/979256692 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95200078e0 con 0x7f95300c43c0 2024-05-09T00:20:06.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.252+0000 7f952d400640 1 -- 172.21.15.114:0/979256692 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520007cb0 con 0x7f95300c43c0 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 -- 172.21.15.114:0/979256692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300c43c0 msgr2=0x7f9530153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 --2- 172.21.15.114:0/979256692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300c43c0 0x7f9530153760 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f95300ac890 tx=0x7f952002a5b0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 -- 172.21.15.114:0/979256692 shutdown_connections 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 --2- 172.21.15.114:0/979256692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300c43c0 0x7f9530153760 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 -- 172.21.15.114:0/979256692 >> 172.21.15.114:0/979256692 conn(0x7f953006c680 msgr2=0x7f953006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 -- 172.21.15.114:0/979256692 shutdown_connections 2024-05-09T00:20:06.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.253+0000 7f9535200640 1 -- 172.21.15.114:0/979256692 wait complete. 2024-05-09T00:20:06.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.255+0000 7f9535200640 1 Processor -- start 2024-05-09T00:20:06.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.255+0000 7f9535200640 1 -- start start 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f9535200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 0x7f9530158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f9535200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95300c43c0 0x7f95301ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f9535200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9530159830 0x7f95301ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f9535200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f953015a350 con 0x7f95300ae940 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f9535200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95300ad3c0 con 0x7f95300c43c0 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f9535200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f953015a4d0 con 0x7f9530159830 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f952de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 0x7f9530158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f952de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 0x7f9530158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59186/0 (socket says 172.21.15.114:59186) 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f952de00640 1 -- 172.21.15.114:0/1826184208 learned_addr learned my addr 172.21.15.114:0/1826184208 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f952de00640 1 -- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9530159830 msgr2=0x7f95301ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.257+0000 7f952de00640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9530159830 0x7f95301ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f9525400640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95300c43c0 0x7f95301ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:06.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f952de00640 1 -- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95300c43c0 msgr2=0x7f95301ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:06.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f952de00640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95300c43c0 0x7f95301ee460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f952de00640 1 -- 172.21.15.114:0/1826184208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953013d7b0 con 0x7f95300ae940 2024-05-09T00:20:06.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f952de00640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 0x7f9530158390 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9520009e80 tx=0x7f9520004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:06.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520040070 con 0x7f95300ae940 2024-05-09T00:20:06.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520031c40 con 0x7f95300ae940 2024-05-09T00:20:06.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520003990 con 0x7f95300ae940 2024-05-09T00:20:06.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95301f2630 con 0x7f95300ae940 2024-05-09T00:20:06.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.258+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953014fa80 con 0x7f95300ae940 2024-05-09T00:20:06.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.259+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95301eef40 con 0x7f95300ae940 2024-05-09T00:20:06.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.261+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9520039040 con 0x7f95300ae940 2024-05-09T00:20:06.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.262+0000 7f9526a00640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f950c0762d0 0x7f950c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:06.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.262+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f95200b8d20 con 0x7f95300ae940 2024-05-09T00:20:06.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.262+0000 7f9525400640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f950c0762d0 0x7f950c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:06.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.263+0000 7f9525400640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f950c0762d0 0x7f950c0787e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9518006fd0 tx=0x7f9518008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:06.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.267+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9520081f00 con 0x7f95300ae940 2024-05-09T00:20:06.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.479+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9530077430 con 0x7f95300ae940 2024-05-09T00:20:06.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.483+0000 7f9526a00640 1 -- 172.21.15.114:0/1826184208 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+22077 (secure 0 0 0) 0x7f9520081800 con 0x7f95300ae940 2024-05-09T00:20:06.484 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:06.484 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:18:35.026013+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6836/2312453128":"2024-05-10T00:18:35.025950+0000","172.21.15.114:6834/2312453128":"2024-05-10T00:18:35.025950+0000","172.21.15.114:6835/372512194":"2024-05-10T00:17:25.004758+0000","172.21.15.114:6834/281438172":"2024-05-10T00:16:34.973324+0000","172.21.15.153:6835/4100525107":"2024-05-10T00:15:44.956406+0000","172.21.15.153:6835/1232162808":"2024-05-10T00:18:25.023032+0000","172.21.15.153:6834/3829412957":"2024-05-10T00:11:14.866186+0000","172.21.15.114:6836/1891949153":"2024-05-10T00:15:04.943103+0000","172.21.15.114:6836/281438172":"2024-05-10T00:16:34.973324+0000","172.21.15.153:6835/3829412957":"2024-05-10T00:11:14.866186+0000","172.21.15.114:6836/1498992114":"2024-05-10T00:11:24.870997+0000","172.21.15.114:6835/2960717153":"2024-05-10T00:14:19.928294+0000","172.21.15.114:6834/1498992114":"2024-05-10T00:11:24.870997+0000","172.21.15.153:6834/1585617173":"2024-05-10T00:13:34.914248+0000","172.21.15.153:6834/1232162808":"2024-05-10T00:18:25.023032+0000","172.21.15.153:6835/1585617173":"2024-05-10T00:13:34.914248+0000","172.21.15.153:6833/690310809":"2024-05-10T00:13:34.914171+0000","172.21.15.114:6834/1891949153":"2024-05-10T00:15:04.943103+0000","172.21.15.153:6832/690310809":"2024-05-10T00:13:34.914171+0000","172.21.15.114:6837/2960717153":"2024-05-10T00:14:19.928294+0000","172.21.15.114:6837/372512194":"2024-05-10T00:17:25.004758+0000","172.21.15.153:6834/4100525107":"2024-05-10T00:15:44.956406+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:20:06.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f950c0762d0 msgr2=0x7f950c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:06.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f950c0762d0 0x7f950c0787e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9518006fd0 tx=0x7f9518008040 comp rx=0 tx=0).stop 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 msgr2=0x7f9530158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 0x7f9530158390 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9520009e80 tx=0x7f9520004a40 comp rx=0 tx=0).stop 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 shutdown_connections 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f950c0762d0 0x7f950c0787e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9530159830 0x7f95301ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95300c43c0 0x7f95301ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 --2- 172.21.15.114:0/1826184208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95300ae940 0x7f9530158390 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 >> 172.21.15.114:0/1826184208 conn(0x7f953006c680 msgr2=0x7f953006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.486+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 shutdown_connections 2024-05-09T00:20:06.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:06.487+0000 7f9535200640 1 -- 172.21.15.114:0/1826184208 wait complete. 2024-05-09T00:20:07.512 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T00:20:07.512 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.797+0000 7f0558a00640 1 Processor -- start 2024-05-09T00:20:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.797+0000 7f0558a00640 1 -- start start 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0558a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05540af130 0x7f05540c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0558a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 0x7f0554155080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0558a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05540746e0 con 0x7f05540c5000 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0558a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0554158b70 con 0x7f05540af130 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0558a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05541555c0 con 0x7f05541585b0 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0551400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f05540c5000 0x7f0554154970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35394/0 (socket says 172.21.15.114:35394) 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.799+0000 7f0551400640 1 -- 172.21.15.114:0/2166150730 learned_addr learned my addr 172.21.15.114:0/2166150730 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0551e00640 1 --2- 172.21.15.114:0/2166150730 >> v2:172.21.15.153:3300/0 conn(0x7f05540af130 0x7f05540c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0552800640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 0x7f0554155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741985848 0 0) 0x7f05540746e0 con 0x7f05540c5000 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0538003520 con 0x7f05540c5000 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2726303212 0 0) 0x7f0538003520 con 0x7f05540c5000 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 msgr2=0x7f0554155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 0x7f0554155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 >> v2:172.21.15.153:3300/0 conn(0x7f05540af130 msgr2=0x7f05540c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 --2- 172.21.15.114:0/2166150730 >> v2:172.21.15.153:3300/0 conn(0x7f05540af130 0x7f05540c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0554073e80 con 0x7f05540c5000 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f0540001710 con 0x7f05540c5000 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0551e00640 1 --2- 172.21.15.114:0/2166150730 >> v2:172.21.15.153:3300/0 conn(0x7f05540af130 0x7f05540c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:20:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 >> v1:172.21.15.114:6789/0 conn(0x7f05540c5000 legacy=0x7f0554154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0538003a00 0x7f0538003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538004800 0x7f0538004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 0x7f053800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.800+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0554158b70 con 0x7f0538003a00 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05541555c0 con 0x7f0538004800 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0538005570 con 0x7f05541585b0 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551e00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0538003a00 0x7f0538003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0552800640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 0x7f053800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551e00640 1 -- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 msgr2=0x7f053800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551e00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541585b0 0x7f053800dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551e00640 1 -- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538004800 msgr2=0x7f0538004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551400640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538004800 0x7f0538004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551e00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538004800 0x7f0538004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.801+0000 7f0551e00640 1 -- 172.21.15.114:0/2166150730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0538003520 con 0x7f0538003a00 2024-05-09T00:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.802+0000 7f0551e00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0538003a00 0x7f0538003e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0554070070 tx=0x7f0538005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8e2868ffc7d57b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.802+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544037070 con 0x7f0538003a00 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.802+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054402ad00 con 0x7f0538003a00 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.802+0000 7f0550a00640 1 -- 172.21.15.114:0/2166150730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054400f040 con 0x7f0538003a00 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0558a00640 1 -- 172.21.15.114:0/2166150730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0538003a00 msgr2=0x7f0538003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0558a00640 1 --2- 172.21.15.114:0/2166150730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0538003a00 0x7f0538003e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0554070070 tx=0x7f0538005830 comp rx=0 tx=0).stop 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0552800640 1 -- 172.21.15.114:0/2166150730 reap_dead start 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0558a00640 1 -- 172.21.15.114:0/2166150730 shutdown_connections 2024-05-09T00:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0558a00640 1 -- 172.21.15.114:0/2166150730 >> 172.21.15.114:0/2166150730 conn(0x7f055406ca70 msgr2=0x7f055406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0558a00640 1 -- 172.21.15.114:0/2166150730 shutdown_connections 2024-05-09T00:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.803+0000 7f0558a00640 1 -- 172.21.15.114:0/2166150730 wait complete. 2024-05-09T00:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.806+0000 7f0558a00640 1 Processor -- start 2024-05-09T00:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.806+0000 7f0558a00640 1 -- start start 2024-05-09T00:20:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0558a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538003a00 0x7f05541559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0558a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05541497a0 0x7f055414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0558a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541f18b0 0x7f05541535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0558a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05540aec80 con 0x7f05541497a0 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0558a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0554074400 con 0x7f0538003a00 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0558a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05540ac710 con 0x7f05541f18b0 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0551400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05541497a0 0x7f055414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0551400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05541497a0 0x7f055414b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48420/0 (socket says 172.21.15.114:48420) 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.807+0000 7f0551400640 1 -- 172.21.15.114:0/4242180380 learned_addr learned my addr 172.21.15.114:0/4242180380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0552800640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541f18b0 0x7f05541535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551e00640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538003a00 0x7f05541559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551400640 1 -- 172.21.15.114:0/4242180380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541f18b0 msgr2=0x7f05541535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551400640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05541f18b0 0x7f05541535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551400640 1 -- 172.21.15.114:0/4242180380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538003a00 msgr2=0x7f05541559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551400640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0538003a00 0x7f05541559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551400640 1 -- 172.21.15.114:0/4242180380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055414bd10 con 0x7f05541497a0 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0551400640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05541497a0 0x7f055414b7d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f054000d810 tx=0x7f054000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540019070 con 0x7f05541497a0 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05400074e0 con 0x7f05541497a0 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05541ef020 con 0x7f05541497a0 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.808+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540004a00 con 0x7f05541497a0 2024-05-09T00:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.809+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0554157960 con 0x7f05541497a0 2024-05-09T00:20:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.809+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f055414c0a0 con 0x7f05541497a0 2024-05-09T00:20:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.811+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f054001c070 con 0x7f05541497a0 2024-05-09T00:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.812+0000 7f054a000640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f05340762d0 0x7f05340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.812+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f0540098330 con 0x7f05541497a0 2024-05-09T00:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.813+0000 7f0551e00640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f05340762d0 0x7f05340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.813+0000 7f054a000640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f0534081550 0x7f0534083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.813+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 --> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0540005e50 con 0x7f0534081550 2024-05-09T00:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.813+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f05400986e0 con 0x7f05541497a0 2024-05-09T00:20:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.813+0000 7f0552800640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f0534081550 0x7f0534083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.813+0000 7f0551e00640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f05340762d0 0x7f05340787e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0544034000 tx=0x7f054402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.814+0000 7f0552800640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f0534081550 0x7f0534083a40 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.815+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== osd.0 v2:172.21.15.114:6816/694320788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0540005e50 con 0x7f0534081550 2024-05-09T00:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.829+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 --> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f05541eedd0 con 0x7f0534081550 2024-05-09T00:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.829+0000 7f054a000640 1 -- 172.21.15.114:0/4242180380 <== osd.0 v2:172.21.15.114:6816/694320788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f05541eedd0 con 0x7f0534081550 2024-05-09T00:20:07.829 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:07.829 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f0534081550 msgr2=0x7f0534083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6816/694320788,v1:172.21.15.114:6817/694320788] conn(0x7f0534081550 0x7f0534083a40 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f05340762d0 msgr2=0x7f05340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f05340762d0 0x7f05340787e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0544034000 tx=0x7f054402e000 comp rx=0 tx=0).stop 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05541497a0 msgr2=0x7f055414b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 --2- 172.21.15.114:0/4242180380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05541497a0 0x7f055414b7d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f054000d810 tx=0x7f054000dcd0 comp rx=0 tx=0).stop 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0552800640 1 -- 172.21.15.114:0/4242180380 reap_dead start 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 shutdown_connections 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 >> 172.21.15.114:0/4242180380 conn(0x7f055406ca70 msgr2=0x7f055406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 shutdown_connections 2024-05-09T00:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:07.830+0000 7f0558a00640 1 -- 172.21.15.114:0/4242180380 wait complete. 2024-05-09T00:20:07.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T00:20:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.131+0000 7fb973e00640 1 Processor -- start 2024-05-09T00:20:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.131+0000 7fb973e00640 1 -- start start 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb973e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb97413f360 0x7fb97406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb973e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9741567d0 0x7fb9740c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb973e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97406f490 con 0x7fb9740af270 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb973e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb97406f920 con 0x7fb97413f360 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb973e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb97406fc00 con 0x7fb9741567d0 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb972a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb97413f360 0x7fb97406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb972a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb97413f360 0x7fb97406e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48424/0 (socket says 172.21.15.114:48424) 2024-05-09T00:20:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.133+0000 7fb972a00640 1 -- 172.21.15.114:0/2265407096 learned_addr learned my addr 172.21.15.114:0/2265407096 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.134+0000 7fb973400640 1 --2- 172.21.15.114:0/2265407096 >> v2:172.21.15.153:3300/0 conn(0x7fb9741567d0 0x7fb9740c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.134+0000 7fb972a00640 1 -- 172.21.15.114:0/2265407096 >> v2:172.21.15.153:3300/0 conn(0x7fb9741567d0 msgr2=0x7fb9740c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.134+0000 7fb972a00640 1 --2- 172.21.15.114:0/2265407096 >> v2:172.21.15.153:3300/0 conn(0x7fb9741567d0 0x7fb9740c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.134+0000 7fb972a00640 1 -- 172.21.15.114:0/2265407096 >> v1:172.21.15.153:6789/0 conn(0x7fb9740af270 legacy=0x7fb9740acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.134+0000 7fb972a00640 1 -- 172.21.15.114:0/2265407096 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb974155fd0 con 0x7fb97413f360 2024-05-09T00:20:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.136+0000 7fb972a00640 1 --2- 172.21.15.114:0/2265407096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb97413f360 0x7fb97406e220 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb97406dcc0 tx=0x7fb96402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d00bdb5c34c5e9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.136+0000 7fb972000640 1 -- 172.21.15.114:0/2265407096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964037070 con 0x7fb97413f360 2024-05-09T00:20:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.136+0000 7fb972000640 1 -- 172.21.15.114:0/2265407096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb964032440 con 0x7fb97413f360 2024-05-09T00:20:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.136+0000 7fb972000640 1 -- 172.21.15.114:0/2265407096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964032810 con 0x7fb97413f360 2024-05-09T00:20:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 -- 172.21.15.114:0/2265407096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb97413f360 msgr2=0x7fb97406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 --2- 172.21.15.114:0/2265407096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb97413f360 0x7fb97406e220 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb97406dcc0 tx=0x7fb96402a140 comp rx=0 tx=0).stop 2024-05-09T00:20:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 -- 172.21.15.114:0/2265407096 shutdown_connections 2024-05-09T00:20:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 --2- 172.21.15.114:0/2265407096 >> v2:172.21.15.153:3300/0 conn(0x7fb9741567d0 0x7fb9740c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 --2- 172.21.15.114:0/2265407096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb97413f360 0x7fb97406e220 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 -- 172.21.15.114:0/2265407096 >> 172.21.15.114:0/2265407096 conn(0x7fb9740c5ea0 msgr2=0x7fb9740c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 -- 172.21.15.114:0/2265407096 shutdown_connections 2024-05-09T00:20:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.137+0000 7fb973e00640 1 -- 172.21.15.114:0/2265407096 wait complete. 2024-05-09T00:20:08.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.139+0000 7fb973e00640 1 Processor -- start 2024-05-09T00:20:08.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.139+0000 7fb973e00640 1 -- start start 2024-05-09T00:20:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9740af270 0x7fb974157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb97413f360 0x7fb9741570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 0x7fb974157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb974156d60 con 0x7fb9741567d0 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb974156be0 con 0x7fb9740af270 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb9740c52f0 con 0x7fb97413f360 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 0x7fb974157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 0x7fb974157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48430/0 (socket says 172.21.15.114:48430) 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb973400640 1 -- 172.21.15.114:0/305721441 learned_addr learned my addr 172.21.15.114:0/305721441 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb972a00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9740af270 0x7fb974157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.141+0000 7fb96a000640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb97413f360 0x7fb9741570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973400640 1 -- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb97413f360 msgr2=0x7fb9741570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973400640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb97413f360 0x7fb9741570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973400640 1 -- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9740af270 msgr2=0x7fb974157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973400640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9740af270 0x7fb974157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973400640 1 -- 172.21.15.114:0/305721441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb974137e20 con 0x7fb9741567d0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973400640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 0x7fb974157620 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb96c007d80 tx=0x7fb96c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c014420 con 0x7fb9741567d0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96c019070 con 0x7fb9741567d0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c014800 con 0x7fb9741567d0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.142+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb974136600 con 0x7fb9741567d0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.143+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9741592f0 con 0x7fb9741567d0 2024-05-09T00:20:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.144+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb974153c50 con 0x7fb9741567d0 2024-05-09T00:20:08.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.145+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb96c0149a0 con 0x7fb9741567d0 2024-05-09T00:20:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.146+0000 7fb96b400640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9500762d0 0x7fb9500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.146+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fb96c0985a0 con 0x7fb9741567d0 2024-05-09T00:20:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.146+0000 7fb972a00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9500762d0 0x7fb9500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.147+0000 7fb972a00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9500762d0 0x7fb9500787e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb964034000 tx=0x7fb96402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.150+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb974153c50 con 0x7fb9741567d0 2024-05-09T00:20:08.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.356+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb974158e50 con 0x7fb9500762d0 2024-05-09T00:20:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.357+0000 7fb96b400640 1 -- 172.21.15.114:0/305721441 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb964032750 con 0x7fb9500762d0 2024-05-09T00:20:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9500762d0 msgr2=0x7fb9500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9500762d0 0x7fb9500787e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb964034000 tx=0x7fb96402e000 comp rx=0 tx=0).stop 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 msgr2=0x7fb974157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 0x7fb974157620 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb96c007d80 tx=0x7fb96c00e4b0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 shutdown_connections 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb9500762d0 0x7fb9500787e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9741567d0 0x7fb974157620 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb97413f360 0x7fb9741570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 --2- 172.21.15.114:0/305721441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9740af270 0x7fb974157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 >> 172.21.15.114:0/305721441 conn(0x7fb9740c5ea0 msgr2=0x7fb974154110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.360+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 shutdown_connections 2024-05-09T00:20:08.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.361+0000 7fb973e00640 1 -- 172.21.15.114:0/305721441 wait complete. 2024-05-09T00:20:08.387 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T00:20:08.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:08.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.655+0000 7f8a83400640 1 Processor -- start 2024-05-09T00:20:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.655+0000 7f8a83400640 1 -- start start 2024-05-09T00:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.657+0000 7f8a83400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 0x7f8a7c0ac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.657+0000 7f8a83400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a7c156910 0x7f8a7c153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.657+0000 7f8a83400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c06ff90 con 0x7f8a7c0ae8f0 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.657+0000 7f8a83400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c153980 con 0x7f8a7c156910 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.657+0000 7f8a83400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c06ecf0 con 0x7f8a7c06f770 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.658+0000 7f8a81400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8a7c0ae8f0 0x7f8a7c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35408/0 (socket says 172.21.15.114:35408) 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.658+0000 7f8a81400640 1 -- 172.21.15.114:0/1022753438 learned_addr learned my addr 172.21.15.114:0/1022753438 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.658+0000 7f8a7be00640 1 --2- 172.21.15.114:0/1022753438 >> v2:172.21.15.153:3300/0 conn(0x7f8a7c156910 0x7f8a7c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.658+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 0x7f8a7c0ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.658+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884756850 0 0) 0x7f8a7c06ff90 con 0x7f8a7c0ae8f0 2024-05-09T00:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.658+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a64003520 con 0x7f8a7c0ae8f0 2024-05-09T00:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 790575263 0 0) 0x7f8a64003520 con 0x7f8a7c0ae8f0 2024-05-09T00:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 msgr2=0x7f8a7c0ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 0x7f8a7c0ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 >> v2:172.21.15.153:3300/0 conn(0x7f8a7c156910 msgr2=0x7f8a7c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 --2- 172.21.15.114:0/1022753438 >> v2:172.21.15.153:3300/0 conn(0x7f8a7c156910 0x7f8a7c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0af430 con 0x7f8a7c0ae8f0 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f8a74001a70 con 0x7f8a7c0ae8f0 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 >> v1:172.21.15.114:6789/0 conn(0x7f8a7c0ae8f0 legacy=0x7f8a7c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a64003a00 0x7f8a64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 0x7f8a64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64004d40 0x7f8a64005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c06ecf0 con 0x7f8a64003a00 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6400ba70 con 0x7f8a64004d40 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6400bbf0 con 0x7f8a7c06f770 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.659+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a64003a00 0x7f8a64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a7be00640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 0x7f8a64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a81400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64004d40 0x7f8a64005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a80a00640 1 -- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 msgr2=0x7f8a64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c06f770 0x7f8a64004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a80a00640 1 -- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64004d40 msgr2=0x7f8a64005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64004d40 0x7f8a64005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a80a00640 1 -- 172.21.15.114:0/1022753438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a64003520 con 0x7f8a64003a00 2024-05-09T00:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.660+0000 7f8a81400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64004d40 0x7f8a64005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.661+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a64003a00 0x7f8a64003e70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009ac0 tx=0x7f8a64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8bed044ebd27f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70036070 con 0x7f8a64003a00 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70031400 con 0x7f8a64003a00 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a7b400640 1 -- 172.21.15.114:0/1022753438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70009690 con 0x7f8a64003a00 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a83400640 1 -- 172.21.15.114:0/1022753438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a64003a00 msgr2=0x7f8a64003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a83400640 1 --2- 172.21.15.114:0/1022753438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a64003a00 0x7f8a64003e70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009ac0 tx=0x7f8a64005830 comp rx=0 tx=0).stop 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a81400640 1 -- 172.21.15.114:0/1022753438 reap_dead start 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a83400640 1 -- 172.21.15.114:0/1022753438 shutdown_connections 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.662+0000 7f8a83400640 1 -- 172.21.15.114:0/1022753438 >> 172.21.15.114:0/1022753438 conn(0x7f8a7c06ca70 msgr2=0x7f8a7c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.663+0000 7f8a83400640 1 -- 172.21.15.114:0/1022753438 shutdown_connections 2024-05-09T00:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.663+0000 7f8a83400640 1 -- 172.21.15.114:0/1022753438 wait complete. 2024-05-09T00:20:08.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.665+0000 7f8a83400640 1 Processor -- start 2024-05-09T00:20:08.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.665+0000 7f8a83400640 1 -- start start 2024-05-09T00:20:08.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.666+0000 7f8a83400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64003a00 0x7f8a7c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.666+0000 7f8a83400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a7c1577b0 0x7f8a7c157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a83400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c1f1550 0x7f8a7c1f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a83400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c06ef40 con 0x7f8a7c1577b0 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a83400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c070270 con 0x7f8a64003a00 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a83400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c0706e0 con 0x7f8a7c1f1550 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a7c1577b0 0x7f8a7c157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a7c1577b0 0x7f8a7c157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48454/0 (socket says 172.21.15.114:48454) 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 -- 172.21.15.114:0/1528982822 learned_addr learned my addr 172.21.15.114:0/1528982822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64003a00 0x7f8a7c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a81400640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c1f1550 0x7f8a7c1f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 -- 172.21.15.114:0/1528982822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c1f1550 msgr2=0x7f8a7c1f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a7c1f1550 0x7f8a7c1f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 -- 172.21.15.114:0/1528982822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64003a00 msgr2=0x7f8a7c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a64003a00 0x7f8a7c159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.667+0000 7f8a7be00640 1 -- 172.21.15.114:0/1528982822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c1eef30 con 0x7f8a7c1577b0 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.668+0000 7f8a7be00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a7c1577b0 0x7f8a7c157bc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8a680108c0 tx=0x7f8a68010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.668+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800f040 con 0x7f8a7c1577b0 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.668+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6800eb60 con 0x7f8a7c1577b0 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.668+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6801c400 con 0x7f8a7c1577b0 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.668+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c1eebe0 con 0x7f8a7c1577b0 2024-05-09T00:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.668+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c150930 con 0x7f8a7c1577b0 2024-05-09T00:20:08.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.669+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a7c152c50 con 0x7f8a7c1577b0 2024-05-09T00:20:08.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.671+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a6801c5a0 con 0x7f8a7c1577b0 2024-05-09T00:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a78c00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a5c0762d0 0x7f8a5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f8a68098510 con 0x7f8a7c1577b0 2024-05-09T00:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a5c0762d0 0x7f8a5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a78c00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7f8a5c081560 0x7f8a5c083a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 --> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a68020e50 con 0x7f8a5c081560 2024-05-09T00:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8a680988c0 con 0x7f8a7c1577b0 2024-05-09T00:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.672+0000 7f8a81400640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7f8a5c081560 0x7f8a5c083a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.673+0000 7f8a80a00640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a5c0762d0 0x7f8a5c0787e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009ac0 tx=0x7f8a70008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.673+0000 7f8a81400640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7f8a5c081560 0x7f8a5c083a50 crc :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.674+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== osd.1 v2:172.21.15.114:6822/3701738775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a68020e50 con 0x7f8a5c081560 2024-05-09T00:20:08.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.688+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 --> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8a7c151f20 con 0x7f8a5c081560 2024-05-09T00:20:08.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a78c00640 1 -- 172.21.15.114:0/1528982822 <== osd.1 v2:172.21.15.114:6822/3701738775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8a74004b60 con 0x7f8a5c081560 2024-05-09T00:20:08.688 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:08.688 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:08.688 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:08.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7f8a5c081560 msgr2=0x7f8a5c083a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a83400640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6822/3701738775,v1:172.21.15.114:6824/3701738775] conn(0x7f8a5c081560 0x7f8a5c083a50 crc :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a5c0762d0 msgr2=0x7f8a5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a83400640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f8a5c0762d0 0x7f8a5c0787e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009ac0 tx=0x7f8a70008030 comp rx=0 tx=0).stop 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a7c1577b0 msgr2=0x7f8a7c157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a83400640 1 --2- 172.21.15.114:0/1528982822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a7c1577b0 0x7f8a7c157bc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8a680108c0 tx=0x7f8a68010d80 comp rx=0 tx=0).stop 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.689+0000 7f8a81400640 1 -- 172.21.15.114:0/1528982822 reap_dead start 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.690+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 shutdown_connections 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.690+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 >> 172.21.15.114:0/1528982822 conn(0x7f8a7c06ca70 msgr2=0x7f8a7c1e45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.690+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 shutdown_connections 2024-05-09T00:20:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.690+0000 7f8a83400640 1 -- 172.21.15.114:0/1528982822 wait complete. 2024-05-09T00:20:08.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T00:20:08.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.976+0000 7f33c0e00640 1 Processor -- start 2024-05-09T00:20:08.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.976+0000 7f33c0e00640 1 -- start start 2024-05-09T00:20:08.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33c0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33bc0c8760 0x7f33bc155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33c0e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33bc158b10 0x7f33bc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33c0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0af570 0x7f33bc0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33c0e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f33bc15c5b0 con 0x7f33bc158b10 2024-05-09T00:20:08.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33c0e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f33bc15b7f0 con 0x7f33bc0c8760 2024-05-09T00:20:08.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33c0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc15bad0 con 0x7f33bc0af570 2024-05-09T00:20:08.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33b3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33bc158b10 0x7f33bc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33b3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33bc158b10 0x7f33bc0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48470/0 (socket says 172.21.15.114:48470) 2024-05-09T00:20:08.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.978+0000 7f33b3e00640 1 -- 172.21.15.114:0/1471432377 learned_addr learned my addr 172.21.15.114:0/1471432377 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:08.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33bbe00640 1 --2- 172.21.15.114:0/1471432377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0af570 0x7f33bc0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33bb400640 1 --2- 172.21.15.114:0/1471432377 >> v2:172.21.15.153:3300/0 conn(0x7f33bc0c8760 0x7f33bc155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33b3e00640 1 -- 172.21.15.114:0/1471432377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0af570 msgr2=0x7f33bc0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33b3e00640 1 --2- 172.21.15.114:0/1471432377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0af570 0x7f33bc0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33b3e00640 1 -- 172.21.15.114:0/1471432377 >> v2:172.21.15.153:3300/0 conn(0x7f33bc0c8760 msgr2=0x7f33bc155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33b3e00640 1 --2- 172.21.15.114:0/1471432377 >> v2:172.21.15.153:3300/0 conn(0x7f33bc0c8760 0x7f33bc155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.979+0000 7f33b3e00640 1 -- 172.21.15.114:0/1471432377 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc15bdb0 con 0x7f33bc158b10 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.980+0000 7f33b3e00640 1 --2- 172.21.15.114:0/1471432377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc158b10 0x7f33bc0af030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0cce90 tx=0x7f33a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170865be747e3dd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.980+0000 7f33baa00640 1 -- 172.21.15.114:0/1471432377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4037070 con 0x7f33bc158b10 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.980+0000 7f33baa00640 1 -- 172.21.15.114:0/1471432377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4032440 con 0x7f33bc158b10 2024-05-09T00:20:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.980+0000 7f33baa00640 1 -- 172.21.15.114:0/1471432377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4032810 con 0x7f33bc158b10 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 -- 172.21.15.114:0/1471432377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc158b10 msgr2=0x7f33bc0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 --2- 172.21.15.114:0/1471432377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc158b10 0x7f33bc0af030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0cce90 tx=0x7f33a402a1e0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 -- 172.21.15.114:0/1471432377 shutdown_connections 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 --2- 172.21.15.114:0/1471432377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0af570 0x7f33bc0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 --2- 172.21.15.114:0/1471432377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc158b10 0x7f33bc0af030 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 --2- 172.21.15.114:0/1471432377 >> v2:172.21.15.153:3300/0 conn(0x7f33bc0c8760 0x7f33bc155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.981+0000 7f33c0e00640 1 -- 172.21.15.114:0/1471432377 >> 172.21.15.114:0/1471432377 conn(0x7f33bc068ef0 msgr2=0x7f33bc0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:08.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.982+0000 7f33c0e00640 1 -- 172.21.15.114:0/1471432377 shutdown_connections 2024-05-09T00:20:08.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.982+0000 7f33c0e00640 1 -- 172.21.15.114:0/1471432377 wait complete. 2024-05-09T00:20:08.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.984+0000 7f33c0e00640 1 Processor -- start 2024-05-09T00:20:08.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.984+0000 7f33c0e00640 1 -- start start 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.985+0000 7f33c0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 0x7f33bc0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.985+0000 7f33c0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0c8760 0x7f33bc154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.985+0000 7f33c0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33bc158b10 0x7f33bc1f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.985+0000 7f33c0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc0cd070 con 0x7f33bc0af570 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.985+0000 7f33c0e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc155c80 con 0x7f33bc158b10 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.985+0000 7f33c0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc0cd1f0 con 0x7f33bc0c8760 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 0x7f33bc0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 0x7f33bc0c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48484/0 (socket says 172.21.15.114:48484) 2024-05-09T00:20:08.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 -- 172.21.15.114:0/3769339284 learned_addr learned my addr 172.21.15.114:0/3769339284 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:08.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33b3e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0c8760 0x7f33bc154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bbe00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33bc158b10 0x7f33bc1f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 -- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0c8760 msgr2=0x7f33bc154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0c8760 0x7f33bc154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 -- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33bc158b10 msgr2=0x7f33bc1f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33bc158b10 0x7f33bc1f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 -- 172.21.15.114:0/3769339284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc0c7380 con 0x7f33bc0af570 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.986+0000 7f33bb400640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 0x7f33bc0c6e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00d5f0 tx=0x7f33ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.987+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0125f0 con 0x7f33bc0af570 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.987+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac019070 con 0x7f33bc0af570 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.987+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc0b25c0 con 0x7f33bc0af570 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.987+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0129d0 con 0x7f33bc0af570 2024-05-09T00:20:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.987+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc0c7590 con 0x7f33bc0af570 2024-05-09T00:20:08.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.988+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33bc078430 con 0x7f33bc0af570 2024-05-09T00:20:08.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.990+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f33ac012b70 con 0x7f33bc0af570 2024-05-09T00:20:08.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.991+0000 7f33b3400640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33980762d0 0x7f33980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:08.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.991+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f33ac098140 con 0x7f33bc0af570 2024-05-09T00:20:08.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.991+0000 7f33b3e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33980762d0 0x7f33980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:08.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.992+0000 7f33b3e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33980762d0 0x7f33980787e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33a4034000 tx=0x7f33a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:08.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:08.996+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f33ac061320 con 0x7f33bc0af570 2024-05-09T00:20:09.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.204+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f33bc1f2170 con 0x7f33980762d0 2024-05-09T00:20:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.205+0000 7f33b3400640 1 -- 172.21.15.114:0/3769339284 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f33bc1f2170 con 0x7f33980762d0 2024-05-09T00:20:09.205 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T00:20:09.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33980762d0 msgr2=0x7f33980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33980762d0 0x7f33980787e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33a4034000 tx=0x7f33a402e000 comp rx=0 tx=0).stop 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 msgr2=0x7f33bc0c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 0x7f33bc0c6e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00d5f0 tx=0x7f33ac00dab0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 shutdown_connections 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f33980762d0 0x7f33980787e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33bc158b10 0x7f33bc1f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33bc0c8760 0x7f33bc154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 --2- 172.21.15.114:0/3769339284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33bc0af570 0x7f33bc0c6e40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 >> 172.21.15.114:0/3769339284 conn(0x7f33bc068ef0 msgr2=0x7f33bc0cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.208+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 shutdown_connections 2024-05-09T00:20:09.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.209+0000 7f33c0e00640 1 -- 172.21.15.114:0/3769339284 wait complete. 2024-05-09T00:20:09.238 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T00:20:09.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.508+0000 7fb04de00640 1 Processor -- start 2024-05-09T00:20:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.508+0000 7fb04de00640 1 -- start start 2024-05-09T00:20:09.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.510+0000 7fb04de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 0x7fb04806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.510+0000 7fb04de00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04815c930 con 0x7fb04815fd50 2024-05-09T00:20:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.510+0000 7fb04de00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0480c8de0 con 0x7fb0480cd050 2024-05-09T00:20:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.510+0000 7fb04de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb04806ce60 con 0x7fb0480c9a60 2024-05-09T00:20:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.510+0000 7fb047400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb04815fd50 0x7fb048162170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35412/0 (socket says 172.21.15.114:35412) 2024-05-09T00:20:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.510+0000 7fb047400640 1 -- 172.21.15.114:0/3351636886 learned_addr learned my addr 172.21.15.114:0/3351636886 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046a00640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 0x7fb04806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324993233 0 0) 0x7fb04815c930 con 0x7fb04815fd50 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb02c003520 con 0x7fb04815fd50 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 557896209 0 0) 0x7fb02c003520 con 0x7fb04815fd50 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 msgr2=0x7fb04806d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 0x7fb04806d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 >> v1:172.21.15.153:6789/0 conn(0x7fb0480cd050 legacy=0x7fb04806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04815c650 con 0x7fb04815fd50 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fb040001a70 con 0x7fb04815fd50 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.511+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 >> v1:172.21.15.114:6789/0 conn(0x7fb04815fd50 legacy=0x7fb048162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c003a30 0x7fb02c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c004800 0x7fb02c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 0x7fb02c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb04806ce60 con 0x7fb02c004800 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c0055e0 con 0x7fb02c003a30 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb02c00bf00 con 0x7fb0480c9a60 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb03e000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c004800 0x7fb02c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb046a00640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c003a30 0x7fb02c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb047400640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 0x7fb02c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb03e000640 1 -- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 msgr2=0x7fb02c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb03e000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480c9a60 0x7fb02c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb03e000640 1 -- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c003a30 msgr2=0x7fb02c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb03e000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c003a30 0x7fb02c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.512+0000 7fb03e000640 1 -- 172.21.15.114:0/3351636886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c003520 con 0x7fb02c004800 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.513+0000 7fb03e000640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c004800 0x7fb02c004c10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb04808ef60 tx=0x7fb02c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d248b0db7b86da23 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.514+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300013b0 con 0x7fb02c004800 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.514+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0300052d0 con 0x7fb02c004800 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.514+0000 7fb046000640 1 -- 172.21.15.114:0/3351636886 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03002aa50 con 0x7fb02c004800 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.514+0000 7fb04de00640 1 -- 172.21.15.114:0/3351636886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c004800 msgr2=0x7fb02c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.514+0000 7fb04de00640 1 --2- 172.21.15.114:0/3351636886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c004800 0x7fb02c004c10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb04808ef60 tx=0x7fb02c005830 comp rx=0 tx=0).stop 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.514+0000 7fb047400640 1 -- 172.21.15.114:0/3351636886 reap_dead start 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.515+0000 7fb04de00640 1 -- 172.21.15.114:0/3351636886 shutdown_connections 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.515+0000 7fb04de00640 1 -- 172.21.15.114:0/3351636886 >> 172.21.15.114:0/3351636886 conn(0x7fb0480cda70 msgr2=0x7fb0480cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.515+0000 7fb04de00640 1 -- 172.21.15.114:0/3351636886 shutdown_connections 2024-05-09T00:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.515+0000 7fb04de00640 1 -- 172.21.15.114:0/3351636886 wait complete. 2024-05-09T00:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.517+0000 7fb04de00640 1 Processor -- start 2024-05-09T00:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.517+0000 7fb04de00640 1 -- start start 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.518+0000 7fb04de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 0x7fb048152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.518+0000 7fb04de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480b2a60 0x7fb0480b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.518+0000 7fb04de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb048157d00 0x7fb048158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.518+0000 7fb04de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb04806df40 con 0x7fb048157d00 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.518+0000 7fb04de00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb04815c3f0 con 0x7fb02c004800 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.518+0000 7fb04de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb04806d2f0 con 0x7fb0480b2a60 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb048157d00 0x7fb048158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb048157d00 0x7fb048158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48496/0 (socket says 172.21.15.114:48496) 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 -- 172.21.15.114:0/1702327507 learned_addr learned my addr 172.21.15.114:0/1702327507 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:09.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 -- 172.21.15.114:0/1702327507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480b2a60 msgr2=0x7fb0480b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0480b2a60 0x7fb0480b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 -- 172.21.15.114:0/1702327507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 msgr2=0x7fb048152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb046a00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 0x7fb048152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 0x7fb048152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 -- 172.21.15.114:0/1702327507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb048153080 con 0x7fb048157d00 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.519+0000 7fb047400640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb048157d00 0x7fb048158110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb04806cdd0 tx=0x7fb04000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.520+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040004d60 con 0x7fb048157d00 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.520+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04000bb20 con 0x7fb048157d00 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.520+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0481f21a0 con 0x7fb048157d00 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.520+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040007070 con 0x7fb048157d00 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.520+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0481f2480 con 0x7fb048157d00 2024-05-09T00:20:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.521+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0481f1fd0 con 0x7fb048157d00 2024-05-09T00:20:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.522+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb04001b020 con 0x7fb048157d00 2024-05-09T00:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.523+0000 7fb03fe00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0240762d0 0x7fb0240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.523+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fb040098650 con 0x7fb048157d00 2024-05-09T00:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.523+0000 7fb046a00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0240762d0 0x7fb0240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.524+0000 7fb03fe00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7fb024081550 0x7fb024083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.524+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 --> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb04001ee50 con 0x7fb024081550 2024-05-09T00:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.524+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb040098a00 con 0x7fb048157d00 2024-05-09T00:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.524+0000 7fb03e000640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7fb024081550 0x7fb024083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.524+0000 7fb046a00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0240762d0 0x7fb0240787e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0480c9fb0 tx=0x7fb038008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.525+0000 7fb03e000640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7fb024081550 0x7fb024083a40 crc :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.525+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== osd.2 v2:172.21.15.114:6800/1426654840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb04001ee50 con 0x7fb024081550 2024-05-09T00:20:09.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.540+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 --> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb04815d440 con 0x7fb024081550 2024-05-09T00:20:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.541+0000 7fb03fe00640 1 -- 172.21.15.114:0/1702327507 <== osd.2 v2:172.21.15.114:6800/1426654840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb04815d440 con 0x7fb024081550 2024-05-09T00:20:09.541 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:09.541 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.541+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7fb024081550 msgr2=0x7fb024083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.541+0000 7fb04de00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6800/1426654840,v1:172.21.15.114:6801/1426654840] conn(0x7fb024081550 0x7fb024083a40 crc :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0240762d0 msgr2=0x7fb0240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb0240762d0 0x7fb0240787e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0480c9fb0 tx=0x7fb038008040 comp rx=0 tx=0).stop 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb048157d00 msgr2=0x7fb048158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 --2- 172.21.15.114:0/1702327507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb048157d00 0x7fb048158110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb04806cdd0 tx=0x7fb04000b4a0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb047400640 1 -- 172.21.15.114:0/1702327507 reap_dead start 2024-05-09T00:20:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 shutdown_connections 2024-05-09T00:20:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 >> 172.21.15.114:0/1702327507 conn(0x7fb0480cda70 msgr2=0x7fb04815cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 shutdown_connections 2024-05-09T00:20:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.542+0000 7fb04de00640 1 -- 172.21.15.114:0/1702327507 wait complete. 2024-05-09T00:20:09.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T00:20:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.833+0000 7f7797e00640 1 Processor -- start 2024-05-09T00:20:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.833+0000 7f7797e00640 1 -- start start 2024-05-09T00:20:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.835+0000 7f7797e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7798155500 0x7f77980c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.835+0000 7f7797e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77980c3a20 con 0x7f7798158a90 2024-05-09T00:20:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.835+0000 7f7797e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77980c3d00 con 0x7f7798073f50 2024-05-09T00:20:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.835+0000 7f7797e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f779806f9a0 con 0x7f7798155500 2024-05-09T00:20:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.836+0000 7f778e000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7798158a90 0x7f779806f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35414/0 (socket says 172.21.15.114:35414) 2024-05-09T00:20:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.836+0000 7f778e000640 1 -- 172.21.15.114:0/3761432576 learned_addr learned my addr 172.21.15.114:0/3761432576 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.836+0000 7f7797400640 1 --2- 172.21.15.114:0/3761432576 >> v2:172.21.15.114:3300/0 conn(0x7f7798155500 0x7f77980c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.836+0000 7f7797400640 1 -- 172.21.15.114:0/3761432576 >> v1:172.21.15.153:6789/0 conn(0x7f7798073f50 legacy=0x7f77980c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.836+0000 7f7797400640 1 -- 172.21.15.114:0/3761432576 >> v1:172.21.15.114:6789/0 conn(0x7f7798158a90 legacy=0x7f779806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.836+0000 7f7797400640 1 -- 172.21.15.114:0/3761432576 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7798158290 con 0x7f7798155500 2024-05-09T00:20:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.837+0000 7f7797400640 1 --2- 172.21.15.114:0/3761432576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f77980c6290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f77900097a0 tx=0x7f779002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617cc3f38657eb21 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7796000640 1 -- 172.21.15.114:0/3761432576 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790037070 con 0x7f7798155500 2024-05-09T00:20:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7796000640 1 -- 172.21.15.114:0/3761432576 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779002adb0 con 0x7f7798155500 2024-05-09T00:20:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7796000640 1 -- 172.21.15.114:0/3761432576 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790032660 con 0x7f7798155500 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7797e00640 1 -- 172.21.15.114:0/3761432576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 msgr2=0x7f77980c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7797e00640 1 --2- 172.21.15.114:0/3761432576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f77980c6290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f77900097a0 tx=0x7f779002a060 comp rx=0 tx=0).stop 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7797e00640 1 -- 172.21.15.114:0/3761432576 shutdown_connections 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7797e00640 1 --2- 172.21.15.114:0/3761432576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f77980c6290 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.838+0000 7f7797e00640 1 -- 172.21.15.114:0/3761432576 >> 172.21.15.114:0/3761432576 conn(0x7f77980c99e0 msgr2=0x7f77980c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.839+0000 7f7797e00640 1 -- 172.21.15.114:0/3761432576 shutdown_connections 2024-05-09T00:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.839+0000 7f7797e00640 1 -- 172.21.15.114:0/3761432576 wait complete. 2024-05-09T00:20:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.841+0000 7f7797e00640 1 Processor -- start 2024-05-09T00:20:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.841+0000 7f7797e00640 1 -- start start 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f7797e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7798073f50 0x7f779815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f7797e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f779815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f7797e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7798158a90 0x7f7798145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f7797e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7798155910 con 0x7f7798155500 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f7797e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7798158600 con 0x7f7798158a90 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f7797e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7798157f40 con 0x7f7798073f50 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f778e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f779815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f778e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f779815a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48514/0 (socket says 172.21.15.114:48514) 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.842+0000 7f778e000640 1 -- 172.21.15.114:0/508004102 learned_addr learned my addr 172.21.15.114:0/508004102 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f7797400640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7798158a90 0x7f7798145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f7796a00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7798073f50 0x7f779815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778e000640 1 -- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7798073f50 msgr2=0x7f779815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778e000640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7798073f50 0x7f779815b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778e000640 1 -- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7798158a90 msgr2=0x7f7798145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778e000640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7798158a90 0x7f7798145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778e000640 1 -- 172.21.15.114:0/508004102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7798159580 con 0x7f7798155500 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778e000640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f779815a620 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7780001eb0 tx=0x7f778000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780017070 con 0x7f7798155500 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7780005d00 con 0x7f7798155500 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7798159860 con 0x7f7798155500 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.843+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780007310 con 0x7f7798155500 2024-05-09T00:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.844+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7798159e20 con 0x7f7798155500 2024-05-09T00:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.845+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77980c5440 con 0x7f7798155500 2024-05-09T00:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.846+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f778001a070 con 0x7f7798155500 2024-05-09T00:20:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.847+0000 7f778fe00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7774076300 0x7f7774078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.847+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f7780097160 con 0x7f7798155500 2024-05-09T00:20:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.847+0000 7f7796a00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7774076300 0x7f7774078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.848+0000 7f7796a00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7774076300 0x7f7774078810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7798070850 tx=0x7f7788007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:09.852+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f77980c5440 con 0x7f7798155500 2024-05-09T00:20:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.048+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f77980c5e80 con 0x7f7774076300 2024-05-09T00:20:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T00:20:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.049+0000 7f778fe00640 1 -- 172.21.15.114:0/508004102 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77980c5e80 con 0x7f7774076300 2024-05-09T00:20:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7774076300 msgr2=0x7f7774078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7774076300 0x7f7774078810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7798070850 tx=0x7f7788007240 comp rx=0 tx=0).stop 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 msgr2=0x7f779815a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f779815a620 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7780001eb0 tx=0x7f778000c890 comp rx=0 tx=0).stop 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 shutdown_connections 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7774076300 0x7f7774078810 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7798158a90 0x7f7798145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7798155500 0x7f779815a620 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 --2- 172.21.15.114:0/508004102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7798073f50 0x7f779815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 >> 172.21.15.114:0/508004102 conn(0x7f77980c99e0 msgr2=0x7f779814f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 shutdown_connections 2024-05-09T00:20:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.052+0000 7f7797e00640 1 -- 172.21.15.114:0/508004102 wait complete. 2024-05-09T00:20:10.081 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T00:20:10.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.340+0000 7fe5e2000640 1 Processor -- start 2024-05-09T00:20:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.340+0000 7fe5e2000640 1 -- start start 2024-05-09T00:20:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.342+0000 7fe5e2000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5dc15c290 0x7fe5dc0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.342+0000 7fe5e2000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5dc0c86b0 0x7fe5dc162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e2000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc0cb420 con 0x7fe5dc0ca400 2024-05-09T00:20:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e2000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc158e00 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e2000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc15b7b0 con 0x7fe5dc15c290 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5dc0c86b0 0x7fe5dc162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5dc0c86b0 0x7fe5dc162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48524/0 (socket says 172.21.15.114:48524) 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e1600640 1 -- 172.21.15.114:0/3000346171 learned_addr learned my addr 172.21.15.114:0/3000346171 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e0c00640 1 --2- 172.21.15.114:0/3000346171 >> v2:172.21.15.153:3300/0 conn(0x7fe5dc15c290 0x7fe5dc0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e1600640 1 -- 172.21.15.114:0/3000346171 >> v2:172.21.15.153:3300/0 conn(0x7fe5dc15c290 msgr2=0x7fe5dc0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.343+0000 7fe5e1600640 1 --2- 172.21.15.114:0/3000346171 >> v2:172.21.15.153:3300/0 conn(0x7fe5dc15c290 0x7fe5dc0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.344+0000 7fe5e1600640 1 -- 172.21.15.114:0/3000346171 >> v1:172.21.15.153:6789/0 conn(0x7fe5dc0ca400 legacy=0x7fe5dc0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.344+0000 7fe5e1600640 1 -- 172.21.15.114:0/3000346171 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc15ba90 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.345+0000 7fe5e1600640 1 --2- 172.21.15.114:0/3000346171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc162910 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc08f1d0 tx=0x7fe5d402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6153333fb88af3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.345+0000 7fe5dbe00640 1 -- 172.21.15.114:0/3000346171 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4036070 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.345+0000 7fe5dbe00640 1 -- 172.21.15.114:0/3000346171 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d4031600 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.345+0000 7fe5dbe00640 1 -- 172.21.15.114:0/3000346171 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40319d0 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 -- 172.21.15.114:0/3000346171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 msgr2=0x7fe5dc162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 --2- 172.21.15.114:0/3000346171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc162910 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc08f1d0 tx=0x7fe5d402a610 comp rx=0 tx=0).stop 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 -- 172.21.15.114:0/3000346171 shutdown_connections 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 --2- 172.21.15.114:0/3000346171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc162910 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 --2- 172.21.15.114:0/3000346171 >> v2:172.21.15.153:3300/0 conn(0x7fe5dc15c290 0x7fe5dc0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 -- 172.21.15.114:0/3000346171 >> 172.21.15.114:0/3000346171 conn(0x7fe5dc0af220 msgr2=0x7fe5dc0af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 -- 172.21.15.114:0/3000346171 shutdown_connections 2024-05-09T00:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.346+0000 7fe5e2000640 1 -- 172.21.15.114:0/3000346171 wait complete. 2024-05-09T00:20:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.349+0000 7fe5e2000640 1 Processor -- start 2024-05-09T00:20:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.349+0000 7fe5e2000640 1 -- start start 2024-05-09T00:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc0c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5dc0ca400 0x7fe5dc1e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5dc15c290 0x7fe5dc1e2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e2000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0c41e0 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e2000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc158ab0 con 0x7fe5dc15c290 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e2000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc0c4360 con 0x7fe5dc0ca400 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc0c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc0c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48534/0 (socket says 172.21.15.114:48534) 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.351+0000 7fe5e0c00640 1 -- 172.21.15.114:0/4130536017 learned_addr learned my addr 172.21.15.114:0/4130536017 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5d3e00640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5dc0ca400 0x7fe5dc1e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e1600640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5dc15c290 0x7fe5dc1e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e0c00640 1 -- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5dc0ca400 msgr2=0x7fe5dc1e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e0c00640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5dc0ca400 0x7fe5dc1e3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e0c00640 1 -- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5dc15c290 msgr2=0x7fe5dc1e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e0c00640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5dc15c290 0x7fe5dc1e2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e0c00640 1 -- 172.21.15.114:0/4130536017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc1e1790 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e1600640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5dc15c290 0x7fe5dc1e2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5e0c00640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc0c3a50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d5f0 tx=0x7fe5cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0125f0 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.352+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc019070 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.353+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc1e1a70 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.353+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0129d0 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.353+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc1e2030 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.354+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5dc1f2860 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.355+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe5cc012b70 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.356+0000 7fe5d9600640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5b80762d0 0x7fe5b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.356+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fe5cc098af0 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.357+0000 7fe5d3e00640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5b80762d0 0x7fe5b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.357+0000 7fe5d9600640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7fe5b8081550 0x7fe5b8083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.357+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 --> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5cc004470 con 0x7fe5b8081550 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.357+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe5cc098f80 con 0x7fe5dc0c86b0 2024-05-09T00:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.357+0000 7fe5e1600640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7fe5b8081550 0x7fe5b8083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.358+0000 7fe5d3e00640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5b80762d0 0x7fe5b80787e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4006fd0 tx=0x7fe5c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.358+0000 7fe5e1600640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7fe5b8081550 0x7fe5b8083a40 crc :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.359+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== osd.3 v2:172.21.15.114:6808/3419026789 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5cc004470 con 0x7fe5b8081550 2024-05-09T00:20:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.374+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 --> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5dc0784d0 con 0x7fe5b8081550 2024-05-09T00:20:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.374+0000 7fe5d9600640 1 -- 172.21.15.114:0/4130536017 <== osd.3 v2:172.21.15.114:6808/3419026789 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe5dc0784d0 con 0x7fe5b8081550 2024-05-09T00:20:10.375 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:10.375 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:10.375 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7fe5b8081550 msgr2=0x7fe5b8083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6808/3419026789,v1:172.21.15.114:6809/3419026789] conn(0x7fe5b8081550 0x7fe5b8083a40 crc :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5b80762d0 msgr2=0x7fe5b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe5b80762d0 0x7fe5b80787e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4006fd0 tx=0x7fe5c4008040 comp rx=0 tx=0).stop 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 msgr2=0x7fe5dc0c3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 --2- 172.21.15.114:0/4130536017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5dc0c86b0 0x7fe5dc0c3a50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d5f0 tx=0x7fe5cc00dab0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e1600640 1 -- 172.21.15.114:0/4130536017 reap_dead start 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 shutdown_connections 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 >> 172.21.15.114:0/4130536017 conn(0x7fe5dc0af220 msgr2=0x7fe5dc156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 shutdown_connections 2024-05-09T00:20:10.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.375+0000 7fe5e2000640 1 -- 172.21.15.114:0/4130536017 wait complete. 2024-05-09T00:20:10.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T00:20:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.652+0000 7f2f41c00640 1 Processor -- start 2024-05-09T00:20:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.652+0000 7f2f41c00640 1 -- start start 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.654+0000 7f2f41c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f3c0c43c0 0x7f2f3c153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.654+0000 7f2f41c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f3c0ae940 0x7f2f3c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.654+0000 7f2f41c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f3c156bb0 con 0x7f2f3c159830 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.654+0000 7f2f41c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2f3c0ac710 con 0x7f2f3c0ae940 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.654+0000 7f2f41c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2f3c156e90 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3a000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f3c159830 0x7f2f3c159c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35430/0 (socket says 172.21.15.114:35430) 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3a000640 1 -- 172.21.15.114:0/3058179380 learned_addr learned my addr 172.21.15.114:0/3058179380 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:10.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3b400640 1 --2- 172.21.15.114:0/3058179380 >> v2:172.21.15.114:3300/0 conn(0x7f2f3c0ae940 0x7f2f3c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3aa00640 1 --2- 172.21.15.114:0/3058179380 >> v2:172.21.15.153:3300/0 conn(0x7f2f3c0c43c0 0x7f2f3c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f39600640 1 -- 172.21.15.114:0/3058179380 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987706435 0 0) 0x7f2f3c156bb0 con 0x7f2f3c159830 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3b400640 1 -- 172.21.15.114:0/3058179380 >> v2:172.21.15.153:3300/0 conn(0x7f2f3c0c43c0 msgr2=0x7f2f3c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3b400640 1 --2- 172.21.15.114:0/3058179380 >> v2:172.21.15.153:3300/0 conn(0x7f2f3c0c43c0 0x7f2f3c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3b400640 1 -- 172.21.15.114:0/3058179380 >> v1:172.21.15.114:6789/0 conn(0x7f2f3c159830 legacy=0x7f2f3c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.655+0000 7f2f3b400640 1 -- 172.21.15.114:0/3058179380 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3c0ac960 con 0x7f2f3c0ae940 2024-05-09T00:20:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.656+0000 7f2f3b400640 1 --2- 172.21.15.114:0/3058179380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0ae940 0x7f2f3c0aed50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c071b30 tx=0x7f2f3402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59952650b7b9e8e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.656+0000 7f2f39600640 1 -- 172.21.15.114:0/3058179380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34007740 con 0x7f2f3c0ae940 2024-05-09T00:20:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.657+0000 7f2f39600640 1 -- 172.21.15.114:0/3058179380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f340078e0 con 0x7f2f3c0ae940 2024-05-09T00:20:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.657+0000 7f2f39600640 1 -- 172.21.15.114:0/3058179380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34007cb0 con 0x7f2f3c0ae940 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.657+0000 7f2f41c00640 1 -- 172.21.15.114:0/3058179380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0ae940 msgr2=0x7f2f3c0aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.657+0000 7f2f41c00640 1 --2- 172.21.15.114:0/3058179380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0ae940 0x7f2f3c0aed50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c071b30 tx=0x7f2f3402a5f0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.658+0000 7f2f41c00640 1 -- 172.21.15.114:0/3058179380 shutdown_connections 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.658+0000 7f2f41c00640 1 --2- 172.21.15.114:0/3058179380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0ae940 0x7f2f3c0aed50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.658+0000 7f2f41c00640 1 --2- 172.21.15.114:0/3058179380 >> v2:172.21.15.153:3300/0 conn(0x7f2f3c0c43c0 0x7f2f3c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.658+0000 7f2f41c00640 1 -- 172.21.15.114:0/3058179380 >> 172.21.15.114:0/3058179380 conn(0x7f2f3c06c680 msgr2=0x7f2f3c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.658+0000 7f2f41c00640 1 -- 172.21.15.114:0/3058179380 shutdown_connections 2024-05-09T00:20:10.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.658+0000 7f2f41c00640 1 -- 172.21.15.114:0/3058179380 wait complete. 2024-05-09T00:20:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.660+0000 7f2f41c00640 1 Processor -- start 2024-05-09T00:20:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.661+0000 7f2f41c00640 1 -- start start 2024-05-09T00:20:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f41c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f3c0ae940 0x7f2f3c0c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f41c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 0x7f2f3c1f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f41c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f3c159830 0x7f2f3c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f41c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3c15a350 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f41c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3c0ad3c0 con 0x7f2f3c159830 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f41c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f3c15a4d0 con 0x7f2f3c0ae940 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f3a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 0x7f2f3c1f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f3a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 0x7f2f3c1f1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48550/0 (socket says 172.21.15.114:48550) 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.662+0000 7f2f3a000640 1 -- 172.21.15.114:0/379315290 learned_addr learned my addr 172.21.15.114:0/379315290 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3b400640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f3c159830 0x7f2f3c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3aa00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f3c0ae940 0x7f2f3c0c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3a000640 1 -- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f3c0ae940 msgr2=0x7f2f3c0c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3a000640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f3c0ae940 0x7f2f3c0c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3a000640 1 -- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f3c159830 msgr2=0x7f2f3c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3a000640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f3c159830 0x7f2f3c140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3a000640 1 -- 172.21.15.114:0/379315290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3c154250 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3b400640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f3c159830 0x7f2f3c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:10.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f3a000640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 0x7f2f3c1f1a60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c3e0 tx=0x7f2f2800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.663+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280074e0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.664+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f280047e0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.664+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3c1559a0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.664+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28004bd0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.664+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f3c155f60 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.665+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3c06cfc0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.666+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f28011070 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.667+0000 7f2f32a00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2f1c076300 0x7f2f1c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:10.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.667+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f2f280978f0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.668+0000 7f2f3aa00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2f1c076300 0x7f2f1c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:10.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.669+0000 7f2f3aa00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2f1c076300 0x7f2f1c078810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c006fd0 tx=0x7f2f2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:10.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.673+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2f3c06cfc0 con 0x7f2f3c0c43c0 2024-05-09T00:20:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.880+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2f3c156760 con 0x7f2f1c076300 2024-05-09T00:20:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.881+0000 7f2f32a00640 1 -- 172.21.15.114:0/379315290 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2f3c156760 con 0x7f2f1c076300 2024-05-09T00:20:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T00:20:10.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2f1c076300 msgr2=0x7f2f1c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2f1c076300 0x7f2f1c078810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c006fd0 tx=0x7f2f2c008040 comp rx=0 tx=0).stop 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 msgr2=0x7f2f3c1f1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 0x7f2f3c1f1a60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c3e0 tx=0x7f2f2800c8a0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 shutdown_connections 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f2f1c076300 0x7f2f1c078810 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f3c159830 0x7f2f3c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f3c0c43c0 0x7f2f3c1f1a60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 --2- 172.21.15.114:0/379315290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f3c0ae940 0x7f2f3c0c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 >> 172.21.15.114:0/379315290 conn(0x7f2f3c06c680 msgr2=0x7f2f3c152400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 shutdown_connections 2024-05-09T00:20:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:10.885+0000 7f2f41c00640 1 -- 172.21.15.114:0/379315290 wait complete. 2024-05-09T00:20:10.913 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T00:20:10.913 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:11.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.188+0000 7efe53e00640 1 Processor -- start 2024-05-09T00:20:11.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.188+0000 7efe53e00640 1 -- start start 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.190+0000 7efe53e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe4c074510 0x7efe4c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.190+0000 7efe53e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efe4c0722f0 0x7efe4c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.190+0000 7efe53e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4c070540 con 0x7efe4c072700 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.190+0000 7efe53e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efe4c074920 con 0x7efe4c0722f0 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.190+0000 7efe53e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efe4c070260 con 0x7efe4c074510 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.190+0000 7efe50a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efe4c0722f0 0x7efe4c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe50a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efe4c0722f0 0x7efe4c1584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48564/0 (socket says 172.21.15.114:48564) 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe50a00640 1 -- 172.21.15.114:0/3187142650 learned_addr learned my addr 172.21.15.114:0/3187142650 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe51400640 1 --2- 172.21.15.114:0/3187142650 >> v2:172.21.15.153:3300/0 conn(0x7efe4c074510 0x7efe4c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe50a00640 1 -- 172.21.15.114:0/3187142650 >> v2:172.21.15.153:3300/0 conn(0x7efe4c074510 msgr2=0x7efe4c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe50a00640 1 --2- 172.21.15.114:0/3187142650 >> v2:172.21.15.153:3300/0 conn(0x7efe4c074510 0x7efe4c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe50a00640 1 -- 172.21.15.114:0/3187142650 >> v1:172.21.15.153:6789/0 conn(0x7efe4c072700 legacy=0x7efe4c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.191+0000 7efe50a00640 1 -- 172.21.15.114:0/3187142650 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c06f740 con 0x7efe4c0722f0 2024-05-09T00:20:11.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.192+0000 7efe50a00640 1 --2- 172.21.15.114:0/3187142650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1584e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c5c30 tx=0x7efe3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef12b0dbabeab61 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.192+0000 7efe4be00640 1 -- 172.21.15.114:0/3187142650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38037070 con 0x7efe4c0722f0 2024-05-09T00:20:11.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.192+0000 7efe4be00640 1 -- 172.21.15.114:0/3187142650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe38032440 con 0x7efe4c0722f0 2024-05-09T00:20:11.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.192+0000 7efe4be00640 1 -- 172.21.15.114:0/3187142650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38032810 con 0x7efe4c0722f0 2024-05-09T00:20:11.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 -- 172.21.15.114:0/3187142650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 msgr2=0x7efe4c1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 --2- 172.21.15.114:0/3187142650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1584e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c5c30 tx=0x7efe3802a1e0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 -- 172.21.15.114:0/3187142650 shutdown_connections 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 --2- 172.21.15.114:0/3187142650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1584e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 --2- 172.21.15.114:0/3187142650 >> v2:172.21.15.153:3300/0 conn(0x7efe4c074510 0x7efe4c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 -- 172.21.15.114:0/3187142650 >> 172.21.15.114:0/3187142650 conn(0x7efe4c06ca70 msgr2=0x7efe4c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 -- 172.21.15.114:0/3187142650 shutdown_connections 2024-05-09T00:20:11.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.193+0000 7efe53e00640 1 -- 172.21.15.114:0/3187142650 wait complete. 2024-05-09T00:20:11.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.196+0000 7efe53e00640 1 Processor -- start 2024-05-09T00:20:11.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.196+0000 7efe53e00640 1 -- start start 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe53e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe53e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c072700 0x7efe4c146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe53e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c074510 0x7efe4c140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe53e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c06fec0 con 0x7efe4c0722f0 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe53e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c159110 con 0x7efe4c072700 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe53e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c070040 con 0x7efe4c074510 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.197+0000 7efe51400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48578/0 (socket says 172.21.15.114:48578) 2024-05-09T00:20:11.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 -- 172.21.15.114:0/2960797543 learned_addr learned my addr 172.21.15.114:0/2960797543 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 -- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c074510 msgr2=0x7efe4c140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c074510 0x7efe4c140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe50a00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c072700 0x7efe4c146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 -- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c072700 msgr2=0x7efe4c146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c072700 0x7efe4c146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 -- 172.21.15.114:0/2960797543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c155bd0 con 0x7efe4c0722f0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.198+0000 7efe51400640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1f22f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe4000d5f0 tx=0x7efe4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.199+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe400125f0 con 0x7efe4c0722f0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.199+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40019070 con 0x7efe4c0722f0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.199+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c0c90c0 con 0x7efe4c0722f0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.199+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe400129d0 con 0x7efe4c0722f0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.199+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c14df80 con 0x7efe4c0722f0 2024-05-09T00:20:11.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.200+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe4c077430 con 0x7efe4c0722f0 2024-05-09T00:20:11.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.201+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe40012b70 con 0x7efe4c0722f0 2024-05-09T00:20:11.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.202+0000 7efe49600640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe2c0762d0 0x7efe2c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.202+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7efe40098180 con 0x7efe4c0722f0 2024-05-09T00:20:11.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.202+0000 7efe50a00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe2c0762d0 0x7efe2c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.202+0000 7efe49600640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7efe2c081550 0x7efe2c083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.202+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 --> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe4001aec0 con 0x7efe2c081550 2024-05-09T00:20:11.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.202+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7efe4009f050 con 0x7efe4c0722f0 2024-05-09T00:20:11.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.203+0000 7efe50a00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe2c0762d0 0x7efe2c0787e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe38034000 tx=0x7efe3802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.203+0000 7efe51e00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7efe2c081550 0x7efe2c083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.204+0000 7efe51e00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7efe2c081550 0x7efe2c083a40 crc :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.206+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== osd.4 v2:172.21.15.153:6800/2251471129 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe4001aec0 con 0x7efe2c081550 2024-05-09T00:20:11.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.221+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 --> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efe4c06e050 con 0x7efe2c081550 2024-05-09T00:20:11.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.222+0000 7efe49600640 1 -- 172.21.15.114:0/2960797543 <== osd.4 v2:172.21.15.153:6800/2251471129 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efe4c06e050 con 0x7efe2c081550 2024-05-09T00:20:11.223 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:11.223 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7efe2c081550 msgr2=0x7efe2c083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.153:6800/2251471129,v1:172.21.15.153:6801/2251471129] conn(0x7efe2c081550 0x7efe2c083a40 crc :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe2c0762d0 msgr2=0x7efe2c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7efe2c0762d0 0x7efe2c0787e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe38034000 tx=0x7efe3802e000 comp rx=0 tx=0).stop 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 msgr2=0x7efe4c1f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 --2- 172.21.15.114:0/2960797543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe4c0722f0 0x7efe4c1f22f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe4000d5f0 tx=0x7efe4000dab0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe51e00640 1 -- 172.21.15.114:0/2960797543 reap_dead start 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 shutdown_connections 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.223+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 >> 172.21.15.114:0/2960797543 conn(0x7efe4c06ca70 msgr2=0x7efe4c06eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:11.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.224+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 shutdown_connections 2024-05-09T00:20:11.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.224+0000 7efe53e00640 1 -- 172.21.15.114:0/2960797543 wait complete. 2024-05-09T00:20:11.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T00:20:11.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.512+0000 7f7cfb200640 1 Processor -- start 2024-05-09T00:20:11.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.513+0000 7f7cfb200640 1 -- start start 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7cf413f360 0x7f7cf406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 0x7f7cf40acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfb200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf406f490 con 0x7f7cf41567d0 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf40ad260 con 0x7f7cf413f360 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf406f920 con 0x7f7cf40af270 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfa800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7cf41567d0 0x7f7cf40c4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35444/0 (socket says 172.21.15.114:35444) 2024-05-09T00:20:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.515+0000 7f7cfa800640 1 -- 172.21.15.114:0/2059778603 learned_addr learned my addr 172.21.15.114:0/2059778603 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf9400640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 0x7f7cf40acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/2059778603 >> v2:172.21.15.153:3300/0 conn(0x7f7cf413f360 0x7f7cf406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925810313 0 0) 0x7f7cf406f490 con 0x7f7cf41567d0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cdc003520 con 0x7f7cf41567d0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653778923 0 0) 0x7f7cdc003520 con 0x7f7cf41567d0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 msgr2=0x7f7cf40acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 0x7f7cf40acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 >> v2:172.21.15.153:3300/0 conn(0x7f7cf413f360 msgr2=0x7f7cf406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 --2- 172.21.15.114:0/2059778603 >> v2:172.21.15.153:3300/0 conn(0x7f7cf413f360 0x7f7cf406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf406fc00 con 0x7f7cf41567d0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f7cf0001a70 con 0x7f7cf41567d0 2024-05-09T00:20:11.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 >> v1:172.21.15.114:6789/0 conn(0x7f7cf41567d0 legacy=0x7f7cf40c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cdc003a00 0x7f7cdc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 0x7f7cdc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc004d40 0x7f7cdc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf40ad260 con 0x7f7cdc003a00 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf406f920 con 0x7f7cdc004d40 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.516+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc00baf0 con 0x7f7cf40af270 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cdc003a00 0x7f7cdc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cfa800640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc004d40 0x7f7cdc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cf9e00640 1 -- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 msgr2=0x7f7cdc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cf40af270 0x7f7cdc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cf9e00640 1 -- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc004d40 msgr2=0x7f7cdc005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc004d40 0x7f7cdc005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.517+0000 7f7cf9e00640 1 -- 172.21.15.114:0/2059778603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc003520 con 0x7f7cdc003a00 2024-05-09T00:20:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.518+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cdc003a00 0x7f7cdc003e70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009a90 tx=0x7f7cdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2474ba3e47491c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.518+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8036070 con 0x7f7cdc003a00 2024-05-09T00:20:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.518+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8031400 con 0x7f7cdc003a00 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.518+0000 7f7cf8a00640 1 -- 172.21.15.114:0/2059778603 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8009690 con 0x7f7cdc003a00 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfb200640 1 -- 172.21.15.114:0/2059778603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cdc003a00 msgr2=0x7f7cdc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfb200640 1 --2- 172.21.15.114:0/2059778603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cdc003a00 0x7f7cdc003e70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009a90 tx=0x7f7cdc005830 comp rx=0 tx=0).stop 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfa800640 1 -- 172.21.15.114:0/2059778603 reap_dead start 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfb200640 1 -- 172.21.15.114:0/2059778603 shutdown_connections 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfb200640 1 -- 172.21.15.114:0/2059778603 >> 172.21.15.114:0/2059778603 conn(0x7f7cf40c5ea0 msgr2=0x7f7cf40c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfb200640 1 -- 172.21.15.114:0/2059778603 shutdown_connections 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.519+0000 7f7cfb200640 1 -- 172.21.15.114:0/2059778603 wait complete. 2024-05-09T00:20:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.522+0000 7f7cfb200640 1 Processor -- start 2024-05-09T00:20:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.522+0000 7f7cfb200640 1 -- start start 2024-05-09T00:20:11.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cdc003a00 0x7f7cf4139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf40c29b0 0x7f7cf4152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 0x7f7cf4153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf40c54c0 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf406fee0 con 0x7f7cf40c29b0 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf40c5640 con 0x7f7cdc003a00 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 0x7f7cf4153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 0x7f7cf4153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48598/0 (socket says 172.21.15.114:48598) 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.523+0000 7f7cfa800640 1 -- 172.21.15.114:0/3561798963 learned_addr learned my addr 172.21.15.114:0/3561798963 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cf9400640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf40c29b0 0x7f7cf4152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cdc003a00 0x7f7cf4139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfa800640 1 -- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cdc003a00 msgr2=0x7f7cf4139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfa800640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cdc003a00 0x7f7cf4139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfa800640 1 -- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf40c29b0 msgr2=0x7f7cf4152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfa800640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf40c29b0 0x7f7cf4152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfa800640 1 -- 172.21.15.114:0/3561798963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf413a900 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfa800640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 0x7f7cf4153390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4071f10 tx=0x7f7cf000b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000b8d0 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf000ba70 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000be60 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.524+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf4073350 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.525+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf4073910 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.525+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf4139b00 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.527+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7cf001b020 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.528+0000 7f7cee000640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cd80762d0 0x7f7cd80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:11.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.528+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f7cf0097f60 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.528+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cd80762d0 0x7f7cd80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:11.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.529+0000 7f7cf9e00640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cd80762d0 0x7f7cd80787e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8033000 tx=0x7f7ce8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:11.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.532+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7cf00610b0 con 0x7f7cf40c2dc0 2024-05-09T00:20:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.722+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7cf40c5a30 con 0x7f7cd80762d0 2024-05-09T00:20:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.723+0000 7f7cee000640 1 -- 172.21.15.114:0/3561798963 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7cf40c5a30 con 0x7f7cd80762d0 2024-05-09T00:20:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T00:20:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cd80762d0 msgr2=0x7f7cd80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cd80762d0 0x7f7cd80787e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8033000 tx=0x7f7ce8008030 comp rx=0 tx=0).stop 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 msgr2=0x7f7cf4153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 0x7f7cf4153390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4071f10 tx=0x7f7cf000b0d0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 shutdown_connections 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f7cd80762d0 0x7f7cd80787e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf40c2dc0 0x7f7cf4153390 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cf40c29b0 0x7f7cf4152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 --2- 172.21.15.114:0/3561798963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7cdc003a00 0x7f7cf4139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 >> 172.21.15.114:0/3561798963 conn(0x7f7cf40c5ea0 msgr2=0x7f7cf413cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 shutdown_connections 2024-05-09T00:20:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:11.726+0000 7f7cfb200640 1 -- 172.21.15.114:0/3561798963 wait complete. 2024-05-09T00:20:11.751 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T00:20:11.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:12.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.020+0000 7fca27600640 1 Processor -- start 2024-05-09T00:20:12.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.021+0000 7fca27600640 1 -- start start 2024-05-09T00:20:12.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.023+0000 7fca27600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 0x7fca20154970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.023+0000 7fca27600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca200746e0 con 0x7fca201585b0 2024-05-09T00:20:12.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.023+0000 7fca27600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca20073e80 con 0x7fca200c4230 2024-05-09T00:20:12.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.023+0000 7fca27600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fca20158b70 con 0x7fca200af130 2024-05-09T00:20:12.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.024+0000 7fca17e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fca201585b0 0x7fca20154eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35454/0 (socket says 172.21.15.114:35454) 2024-05-09T00:20:12.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.024+0000 7fca17e00640 1 -- 172.21.15.114:0/3511453555 learned_addr learned my addr 172.21.15.114:0/3511453555 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.024+0000 7fca24c00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 0x7fca20154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.024+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 159032102 0 0) 0x7fca200746e0 con 0x7fca201585b0 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.024+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca04003520 con 0x7fca201585b0 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992741853 0 0) 0x7fca04003520 con 0x7fca201585b0 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 msgr2=0x7fca20154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 0x7fca20154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 >> v1:172.21.15.153:6789/0 conn(0x7fca200c4230 legacy=0x7fca200c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca20074120 con 0x7fca201585b0 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fca080016f0 con 0x7fca201585b0 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 >> v1:172.21.15.114:6789/0 conn(0x7fca201585b0 legacy=0x7fca20154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca04003a30 0x7fca04003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca04004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 0x7fca0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fca20158b70 con 0x7fca04004800 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca04005590 con 0x7fca04003a30 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fca0400bf00 con 0x7fca200af130 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca17e00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca04004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca24c00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca04003a30 0x7fca04003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.025+0000 7fca25600640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 0x7fca0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.026+0000 7fca17e00640 1 -- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 msgr2=0x7fca0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.026+0000 7fca17e00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca200af130 0x7fca0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.026+0000 7fca17e00640 1 -- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca04003a30 msgr2=0x7fca04003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.026+0000 7fca17e00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca04003a30 0x7fca04003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.026+0000 7fca17e00640 1 -- 172.21.15.114:0/3511453555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca04003520 con 0x7fca04004800 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.027+0000 7fca17e00640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca04004c10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fca200c56a0 tx=0x7fca04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c748113dfbab12d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.027+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08007d30 con 0x7fca04004800 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.027+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08005ad0 con 0x7fca04004800 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.027+0000 7fca1fe00640 1 -- 172.21.15.114:0/3511453555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08007070 con 0x7fca04004800 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca27600640 1 -- 172.21.15.114:0/3511453555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 msgr2=0x7fca04004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca27600640 1 --2- 172.21.15.114:0/3511453555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca04004c10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fca200c56a0 tx=0x7fca04005830 comp rx=0 tx=0).stop 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca25600640 1 -- 172.21.15.114:0/3511453555 reap_dead start 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca27600640 1 -- 172.21.15.114:0/3511453555 shutdown_connections 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca27600640 1 -- 172.21.15.114:0/3511453555 >> 172.21.15.114:0/3511453555 conn(0x7fca2006ca70 msgr2=0x7fca2006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca27600640 1 -- 172.21.15.114:0/3511453555 shutdown_connections 2024-05-09T00:20:12.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.028+0000 7fca27600640 1 -- 172.21.15.114:0/3511453555 wait complete. 2024-05-09T00:20:12.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.030+0000 7fca27600640 1 Processor -- start 2024-05-09T00:20:12.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.030+0000 7fca27600640 1 -- start start 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca27600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca20152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca27600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca20153e80 0x7fca20152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca27600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca20146f00 0x7fca20147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca27600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fca200aec80 con 0x7fca04004800 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca27600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca201555c0 con 0x7fca20146f00 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca27600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fca200ac710 con 0x7fca20153e80 2024-05-09T00:20:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca24c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca20152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca24c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca20152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48624/0 (socket says 172.21.15.114:48624) 2024-05-09T00:20:12.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca24c00640 1 -- 172.21.15.114:0/4261141187 learned_addr learned my addr 172.21.15.114:0/4261141187 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca24c00640 1 -- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca20153e80 msgr2=0x7fca20152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.032+0000 7fca17e00640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca20153e80 0x7fca20152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca24c00640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca20153e80 0x7fca20152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca24c00640 1 -- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca20146f00 msgr2=0x7fca20147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca24c00640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca20146f00 0x7fca20147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca24c00640 1 -- 172.21.15.114:0/4261141187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca200c88a0 con 0x7fca04004800 2024-05-09T00:20:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca24c00640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca20152aa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fca10011600 tx=0x7fca10011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10015870 con 0x7fca04004800 2024-05-09T00:20:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10015a10 con 0x7fca04004800 2024-05-09T00:20:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10015e00 con 0x7fca04004800 2024-05-09T00:20:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca201f2180 con 0x7fca04004800 2024-05-09T00:20:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.033+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2014b7c0 con 0x7fca04004800 2024-05-09T00:20:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.034+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca20077430 con 0x7fca04004800 2024-05-09T00:20:12.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.036+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca1000f450 con 0x7fca04004800 2024-05-09T00:20:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.037+0000 7fca1d600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc9fc076300 0x7fc9fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.037+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fca10098860 con 0x7fca04004800 2024-05-09T00:20:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.037+0000 7fca17e00640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc9fc076300 0x7fc9fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.037+0000 7fca1d600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fc9fc081580 0x7fc9fc083a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.037+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 --> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca10016e50 con 0x7fc9fc081580 2024-05-09T00:20:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.037+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fca10098cf0 con 0x7fca04004800 2024-05-09T00:20:12.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.038+0000 7fca17e00640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc9fc076300 0x7fc9fc078810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca08032000 tx=0x7fca0802d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.038+0000 7fca25600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fc9fc081580 0x7fc9fc083a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.039+0000 7fca25600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fc9fc081580 0x7fc9fc083a70 crc :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.041+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== osd.5 v2:172.21.15.153:6824/4042985411 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca10016e50 con 0x7fc9fc081580 2024-05-09T00:20:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.056+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 --> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fca20151fd0 con 0x7fc9fc081580 2024-05-09T00:20:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca1d600640 1 -- 172.21.15.114:0/4261141187 <== osd.5 v2:172.21.15.153:6824/4042985411 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fca20151fd0 con 0x7fc9fc081580 2024-05-09T00:20:12.057 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:12.057 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:12.057 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fc9fc081580 msgr2=0x7fc9fc083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca27600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.153:6824/4042985411,v1:172.21.15.153:6825/4042985411] conn(0x7fc9fc081580 0x7fc9fc083a70 crc :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc9fc076300 msgr2=0x7fc9fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca27600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc9fc076300 0x7fc9fc078810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca08032000 tx=0x7fca0802d000 comp rx=0 tx=0).stop 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 msgr2=0x7fca20152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca27600640 1 --2- 172.21.15.114:0/4261141187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca04004800 0x7fca20152aa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fca10011600 tx=0x7fca10011ac0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.057+0000 7fca25600640 1 -- 172.21.15.114:0/4261141187 reap_dead start 2024-05-09T00:20:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.058+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 shutdown_connections 2024-05-09T00:20:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.058+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 >> 172.21.15.114:0/4261141187 conn(0x7fca2006ca70 msgr2=0x7fca200722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.058+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 shutdown_connections 2024-05-09T00:20:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.058+0000 7fca27600640 1 -- 172.21.15.114:0/4261141187 wait complete. 2024-05-09T00:20:12.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T00:20:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.358+0000 7f20b1200640 1 Processor -- start 2024-05-09T00:20:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.359+0000 7f20b1200640 1 -- start start 2024-05-09T00:20:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.360+0000 7f20b1200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f20ac073800 0x7f20ac072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.360+0000 7f20b1200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20ac1585c0 0x7f20ac1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.360+0000 7f20b1200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac074040 con 0x7f20ac0c4a70 2024-05-09T00:20:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.360+0000 7f20b1200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac073df0 con 0x7f20ac1585c0 2024-05-09T00:20:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.360+0000 7f20b1200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac0c5f40 con 0x7f20ac073800 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20ac1585c0 0x7f20ac1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20ac1585c0 0x7f20ac1589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48636/0 (socket says 172.21.15.114:48636) 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 -- 172.21.15.114:0/310095240 learned_addr learned my addr 172.21.15.114:0/310095240 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20a9e00640 1 --2- 172.21.15.114:0/310095240 >> v2:172.21.15.153:3300/0 conn(0x7f20ac073800 0x7f20ac072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 -- 172.21.15.114:0/310095240 >> v2:172.21.15.153:3300/0 conn(0x7f20ac073800 msgr2=0x7f20ac072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 --2- 172.21.15.114:0/310095240 >> v2:172.21.15.153:3300/0 conn(0x7f20ac073800 0x7f20ac072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 -- 172.21.15.114:0/310095240 >> v1:172.21.15.153:6789/0 conn(0x7f20ac0c4a70 legacy=0x7f20ac0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.361+0000 7f20aa800640 1 -- 172.21.15.114:0/310095240 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac0c58f0 con 0x7f20ac1585c0 2024-05-09T00:20:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.363+0000 7f20aa800640 1 --2- 172.21.15.114:0/310095240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac1589d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f20ac06d470 tx=0x7f20a402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4eef06e9257087 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.363+0000 7f20a8a00640 1 -- 172.21.15.114:0/310095240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a400b2e0 con 0x7f20ac1585c0 2024-05-09T00:20:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.363+0000 7f20a8a00640 1 -- 172.21.15.114:0/310095240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4009600 con 0x7f20ac1585c0 2024-05-09T00:20:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.363+0000 7f20a8a00640 1 -- 172.21.15.114:0/310095240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a400b480 con 0x7f20ac1585c0 2024-05-09T00:20:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 -- 172.21.15.114:0/310095240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 msgr2=0x7f20ac1589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 --2- 172.21.15.114:0/310095240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac1589d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f20ac06d470 tx=0x7f20a402c8a0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 -- 172.21.15.114:0/310095240 shutdown_connections 2024-05-09T00:20:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 --2- 172.21.15.114:0/310095240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac1589d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 --2- 172.21.15.114:0/310095240 >> v2:172.21.15.153:3300/0 conn(0x7f20ac073800 0x7f20ac072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 -- 172.21.15.114:0/310095240 >> 172.21.15.114:0/310095240 conn(0x7f20ac06c680 msgr2=0x7f20ac06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 -- 172.21.15.114:0/310095240 shutdown_connections 2024-05-09T00:20:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.364+0000 7f20b1200640 1 -- 172.21.15.114:0/310095240 wait complete. 2024-05-09T00:20:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.367+0000 7f20b1200640 1 Processor -- start 2024-05-09T00:20:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.367+0000 7f20b1200640 1 -- start start 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.368+0000 7f20b1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac073800 0x7f20ac0c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.368+0000 7f20b1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0c4a70 0x7f20ac151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.368+0000 7f20b1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.368+0000 7f20b1200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac074320 con 0x7f20ac1585c0 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.368+0000 7f20b1200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac0c4e80 con 0x7f20ac073800 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.368+0000 7f20b1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac1ec380 con 0x7f20ac0c4a70 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48640/0 (socket says 172.21.15.114:48640) 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 -- 172.21.15.114:0/472737413 learned_addr learned my addr 172.21.15.114:0/472737413 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20a9400640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0c4a70 0x7f20ac151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20a9e00640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac073800 0x7f20ac0c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 -- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0c4a70 msgr2=0x7f20ac151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0c4a70 0x7f20ac151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 -- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac073800 msgr2=0x7f20ac0c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac073800 0x7f20ac0c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20aa800640 1 -- 172.21.15.114:0/472737413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac1ef380 con 0x7f20ac1585c0 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.369+0000 7f20a9e00640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac073800 0x7f20ac0c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.370+0000 7f20aa800640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac154650 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f20a400d210 tx=0x7f20a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.370+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4040070 con 0x7f20ac1585c0 2024-05-09T00:20:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.370+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4009370 con 0x7f20ac1585c0 2024-05-09T00:20:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.370+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a403ca30 con 0x7f20ac1585c0 2024-05-09T00:20:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.370+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac152690 con 0x7f20ac1585c0 2024-05-09T00:20:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.371+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac1f2200 con 0x7f20ac1585c0 2024-05-09T00:20:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.372+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac1f2460 con 0x7f20ac1585c0 2024-05-09T00:20:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.374+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20a403cbd0 con 0x7f20ac1585c0 2024-05-09T00:20:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.376+0000 7f20a2000640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f208c0762d0 0x7f208c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.376+0000 7f20a9e00640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f208c0762d0 0x7f208c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.376+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f20a4030020 con 0x7f20ac1585c0 2024-05-09T00:20:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.378+0000 7f20a9e00640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f208c0762d0 0x7f208c0787e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f209c006fd0 tx=0x7f209c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.381+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f20a4049030 con 0x7f20ac1585c0 2024-05-09T00:20:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.588+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f20ac1ef660 con 0x7f208c0762d0 2024-05-09T00:20:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.589+0000 7f20a2000640 1 -- 172.21.15.114:0/472737413 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f209c009d70 con 0x7f208c0762d0 2024-05-09T00:20:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T00:20:12.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f208c0762d0 msgr2=0x7f208c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f208c0762d0 0x7f208c0787e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f209c006fd0 tx=0x7f209c008040 comp rx=0 tx=0).stop 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 msgr2=0x7f20ac154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac154650 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f20a400d210 tx=0x7f20a4004a40 comp rx=0 tx=0).stop 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 shutdown_connections 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f208c0762d0 0x7f208c0787e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20ac1585c0 0x7f20ac154650 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0c4a70 0x7f20ac151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 --2- 172.21.15.114:0/472737413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac073800 0x7f20ac0c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 >> 172.21.15.114:0/472737413 conn(0x7f20ac06c680 msgr2=0x7f20ac0c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 shutdown_connections 2024-05-09T00:20:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.592+0000 7f20b1200640 1 -- 172.21.15.114:0/472737413 wait complete. 2024-05-09T00:20:12.620 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T00:20:12.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.911+0000 7f0c4fe00640 1 Processor -- start 2024-05-09T00:20:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.911+0000 7f0c4fe00640 1 -- start start 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50153420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c4fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c500c97a0 0x7f0c5006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c4fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c5006cbc0 0x7f0c500c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c4fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0c500c46d0 con 0x7f0c500c97a0 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c4fe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0c500c5cd0 con 0x7f0c5006cbc0 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0c500c59f0 con 0x7f0c500c3fe0 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c47e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c500c97a0 0x7f0c5006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.913+0000 7f0c47e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c500c97a0 0x7f0c5006c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48652/0 (socket says 172.21.15.114:48652) 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c47e00640 1 -- 172.21.15.114:0/448162275 learned_addr learned my addr 172.21.15.114:0/448162275 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c4f400640 1 --2- 172.21.15.114:0/448162275 >> v2:172.21.15.153:3300/0 conn(0x7f0c5006cbc0 0x7f0c500c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c4ea00640 1 --2- 172.21.15.114:0/448162275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c47e00640 1 -- 172.21.15.114:0/448162275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 msgr2=0x7f0c50153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c47e00640 1 --2- 172.21.15.114:0/448162275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c47e00640 1 -- 172.21.15.114:0/448162275 >> v2:172.21.15.153:3300/0 conn(0x7f0c5006cbc0 msgr2=0x7f0c500c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c47e00640 1 --2- 172.21.15.114:0/448162275 >> v2:172.21.15.153:3300/0 conn(0x7f0c5006cbc0 0x7f0c500c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.914+0000 7f0c47e00640 1 -- 172.21.15.114:0/448162275 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c50159e30 con 0x7f0c500c97a0 2024-05-09T00:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.915+0000 7f0c47e00640 1 --2- 172.21.15.114:0/448162275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c5006c680 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0c5006d7c0 tx=0x7f0c3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24197d7f7a972daf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.916+0000 7f0c4e000640 1 -- 172.21.15.114:0/448162275 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38037070 con 0x7f0c500c97a0 2024-05-09T00:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.916+0000 7f0c4e000640 1 -- 172.21.15.114:0/448162275 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c38032440 con 0x7f0c500c97a0 2024-05-09T00:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.916+0000 7f0c4e000640 1 -- 172.21.15.114:0/448162275 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38032810 con 0x7f0c500c97a0 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.916+0000 7f0c4fe00640 1 -- 172.21.15.114:0/448162275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 msgr2=0x7f0c5006c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.916+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/448162275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c5006c680 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0c5006d7c0 tx=0x7f0c3802a1e0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 -- 172.21.15.114:0/448162275 shutdown_connections 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/448162275 >> v2:172.21.15.153:3300/0 conn(0x7f0c5006cbc0 0x7f0c500c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/448162275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c5006c680 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/448162275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 -- 172.21.15.114:0/448162275 >> 172.21.15.114:0/448162275 conn(0x7f0c500aba80 msgr2=0x7f0c500abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 -- 172.21.15.114:0/448162275 shutdown_connections 2024-05-09T00:20:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.917+0000 7f0c4fe00640 1 -- 172.21.15.114:0/448162275 wait complete. 2024-05-09T00:20:12.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.919+0000 7f0c4fe00640 1 Processor -- start 2024-05-09T00:20:12.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.919+0000 7f0c4fe00640 1 -- start start 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5006cbc0 0x7f0c501581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c50143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50068a90 con 0x7f0c500c97a0 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50153960 con 0x7f0c5006cbc0 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0c50068c10 con 0x7f0c500c3fe0 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c50143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c50143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48668/0 (socket says 172.21.15.114:48668) 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4f400640 1 -- 172.21.15.114:0/3047295351 learned_addr learned my addr 172.21.15.114:0/3047295351 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c4ea00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5006cbc0 0x7f0c501581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.921+0000 7f0c47e00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4f400640 1 -- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 msgr2=0x7f0c50156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4f400640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c500c3fe0 0x7f0c50156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4f400640 1 -- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5006cbc0 msgr2=0x7f0c501581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4f400640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5006cbc0 0x7f0c501581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4f400640 1 -- 172.21.15.114:0/3047295351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5014cc70 con 0x7f0c500c97a0 2024-05-09T00:20:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4f400640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c50143eb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007d10 tx=0x7f0c4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48014420 con 0x7f0c500c97a0 2024-05-09T00:20:12.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c48019070 con 0x7f0c500c97a0 2024-05-09T00:20:12.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5014cf50 con 0x7f0c500c97a0 2024-05-09T00:20:12.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48014800 con 0x7f0c500c97a0 2024-05-09T00:20:12.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.922+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5014b530 con 0x7f0c500c97a0 2024-05-09T00:20:12.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.923+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c5014d470 con 0x7f0c500c97a0 2024-05-09T00:20:12.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.925+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c480149a0 con 0x7f0c500c97a0 2024-05-09T00:20:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.926+0000 7f0c46a00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c2c076300 0x7f0c2c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.926+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f0c48098e80 con 0x7f0c500c97a0 2024-05-09T00:20:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.926+0000 7f0c4ea00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c2c076300 0x7f0c2c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.926+0000 7f0c46a00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f0c2c081580 0x7f0c2c083a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.926+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 --> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c480091a0 con 0x7f0c2c081580 2024-05-09T00:20:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.926+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0c48099310 con 0x7f0c500c97a0 2024-05-09T00:20:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.927+0000 7f0c4ea00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c2c076300 0x7f0c2c078810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c40006fd0 tx=0x7f0c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.927+0000 7f0c47e00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f0c2c081580 0x7f0c2c083a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:12.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.928+0000 7f0c47e00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f0c2c081580 0x7f0c2c083a70 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.931+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== osd.6 v2:172.21.15.153:6808/3084340676 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c480091a0 con 0x7f0c2c081580 2024-05-09T00:20:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.946+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 --> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0c501eeb70 con 0x7f0c2c081580 2024-05-09T00:20:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.947+0000 7f0c46a00640 1 -- 172.21.15.114:0/3047295351 <== osd.6 v2:172.21.15.153:6808/3084340676 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0c501eeb70 con 0x7f0c2c081580 2024-05-09T00:20:12.947 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:12.947 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.947+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f0c2c081580 msgr2=0x7f0c2c083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.153:6808/3084340676,v1:172.21.15.153:6809/3084340676] conn(0x7f0c2c081580 0x7f0c2c083a70 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c2c076300 msgr2=0x7f0c2c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c2c076300 0x7f0c2c078810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c40006fd0 tx=0x7f0c40008040 comp rx=0 tx=0).stop 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 msgr2=0x7f0c50143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 --2- 172.21.15.114:0/3047295351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500c97a0 0x7f0c50143eb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007d10 tx=0x7f0c4800e4b0 comp rx=0 tx=0).stop 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4f400640 1 -- 172.21.15.114:0/3047295351 reap_dead start 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 shutdown_connections 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 >> 172.21.15.114:0/3047295351 conn(0x7f0c500aba80 msgr2=0x7f0c500702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 shutdown_connections 2024-05-09T00:20:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:12.948+0000 7f0c4fe00640 1 -- 172.21.15.114:0/3047295351 wait complete. 2024-05-09T00:20:12.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T00:20:13.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.238+0000 7f30bb400640 1 Processor -- start 2024-05-09T00:20:13.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.238+0000 7f30bb400640 1 -- start start 2024-05-09T00:20:13.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30bb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30bb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30b41585c0 0x7f30b41589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30bb400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b4074040 con 0x7f30b4073800 2024-05-09T00:20:13.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30bb400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f30b4073df0 con 0x7f30b41585c0 2024-05-09T00:20:13.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30bb400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40c5f40 con 0x7f30b4072720 2024-05-09T00:20:13.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30b9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30b41585c0 0x7f30b41589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30b9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30b41585c0 0x7f30b41589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48672/0 (socket says 172.21.15.114:48672) 2024-05-09T00:20:13.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.240+0000 7f30b9400640 1 -- 172.21.15.114:0/1919132380 learned_addr learned my addr 172.21.15.114:0/1919132380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:13.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.241+0000 7f30b3e00640 1 --2- 172.21.15.114:0/1919132380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.241+0000 7f30b9400640 1 -- 172.21.15.114:0/1919132380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 msgr2=0x7f30b40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:13.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.241+0000 7f30b9400640 1 --2- 172.21.15.114:0/1919132380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.241+0000 7f30b9400640 1 -- 172.21.15.114:0/1919132380 >> v1:172.21.15.153:6789/0 conn(0x7f30b4073800 legacy=0x7f30b40c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.241+0000 7f30b9400640 1 -- 172.21.15.114:0/1919132380 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b40c58f0 con 0x7f30b41585c0 2024-05-09T00:20:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.242+0000 7f30b9400640 1 --2- 172.21.15.114:0/1919132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b41585c0 0x7f30b41589d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00d150 tx=0x7f30ac02c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd25cc4f247cdec1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.242+0000 7f30b3400640 1 -- 172.21.15.114:0/1919132380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac039070 con 0x7f30b41585c0 2024-05-09T00:20:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.242+0000 7f30b3400640 1 -- 172.21.15.114:0/1919132380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac009600 con 0x7f30b41585c0 2024-05-09T00:20:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.242+0000 7f30b3400640 1 -- 172.21.15.114:0/1919132380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0099d0 con 0x7f30b41585c0 2024-05-09T00:20:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 -- 172.21.15.114:0/1919132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b41585c0 msgr2=0x7f30b41589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 --2- 172.21.15.114:0/1919132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b41585c0 0x7f30b41589d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00d150 tx=0x7f30ac02c880 comp rx=0 tx=0).stop 2024-05-09T00:20:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 -- 172.21.15.114:0/1919132380 shutdown_connections 2024-05-09T00:20:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 --2- 172.21.15.114:0/1919132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b41585c0 0x7f30b41589d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 --2- 172.21.15.114:0/1919132380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 -- 172.21.15.114:0/1919132380 >> 172.21.15.114:0/1919132380 conn(0x7f30b406c680 msgr2=0x7f30b406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 -- 172.21.15.114:0/1919132380 shutdown_connections 2024-05-09T00:20:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.243+0000 7f30bb400640 1 -- 172.21.15.114:0/1919132380 wait complete. 2024-05-09T00:20:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.246+0000 7f30bb400640 1 Processor -- start 2024-05-09T00:20:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.246+0000 7f30bb400640 1 -- start start 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.247+0000 7f30bb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.247+0000 7f30bb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 0x7f30b41f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.247+0000 7f30bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b41585c0 0x7f30b414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.247+0000 7f30bb400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4074320 con 0x7f30b4073800 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.247+0000 7f30bb400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4072b30 con 0x7f30b41585c0 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.247+0000 7f30bb400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30b41ee7f0 con 0x7f30b4072720 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 0x7f30b41f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 0x7f30b41f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48676/0 (socket says 172.21.15.114:48676) 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 -- 172.21.15.114:0/28266043 learned_addr learned my addr 172.21.15.114:0/28266043 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b8a00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b9400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b41585c0 0x7f30b414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 -- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 msgr2=0x7f30b40c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 -- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b41585c0 msgr2=0x7f30b414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b41585c0 0x7f30b414aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.248+0000 7f30b3e00640 1 -- 172.21.15.114:0/28266043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b414df40 con 0x7f30b4073800 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.249+0000 7f30b3e00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 0x7f30b41f2150 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f30a000d5f0 tx=0x7f30a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.249+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a00125f0 con 0x7f30b4073800 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.249+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0019070 con 0x7f30b4073800 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.249+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b4152a70 con 0x7f30b4073800 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.249+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a00129d0 con 0x7f30b4073800 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.249+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b41f1950 con 0x7f30b4073800 2024-05-09T00:20:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.250+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b4077430 con 0x7f30b4073800 2024-05-09T00:20:13.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.251+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30a0012b70 con 0x7f30b4073800 2024-05-09T00:20:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.252+0000 7f30b0c00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3094076300 0x7f3094078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.252+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f30a00980b0 con 0x7f30b4073800 2024-05-09T00:20:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.253+0000 7f30b8a00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3094076300 0x7f3094078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.253+0000 7f30b8a00640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3094076300 0x7f3094078810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006fd0 tx=0x7f30a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.257+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30a0061290 con 0x7f30b4073800 2024-05-09T00:20:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.473+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f30b4152820 con 0x7f3094076300 2024-05-09T00:20:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.474+0000 7f30b0c00640 1 -- 172.21.15.114:0/28266043 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30b4152820 con 0x7f3094076300 2024-05-09T00:20:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T00:20:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3094076300 msgr2=0x7f3094078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3094076300 0x7f3094078810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006fd0 tx=0x7f30a8008040 comp rx=0 tx=0).stop 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 msgr2=0x7f30b41f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 0x7f30b41f2150 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f30a000d5f0 tx=0x7f30a000dab0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 shutdown_connections 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f3094076300 0x7f3094078810 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b41585c0 0x7f30b414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4073800 0x7f30b41f2150 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 --2- 172.21.15.114:0/28266043 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b4072720 0x7f30b40c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 >> 172.21.15.114:0/28266043 conn(0x7f30b406c680 msgr2=0x7f30b4157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 shutdown_connections 2024-05-09T00:20:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.477+0000 7f30bb400640 1 -- 172.21.15.114:0/28266043 wait complete. 2024-05-09T00:20:13.502 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T00:20:13.502 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T00:20:13.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.786+0000 7f2859e00640 1 Processor -- start 2024-05-09T00:20:13.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.787+0000 7f2859e00640 1 -- start start 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28540733b0 0x7f2854073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2854155790 0x7f285406f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f285406f970 0x7f28540c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2854074590 con 0x7f2854155790 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f28540737c0 con 0x7f28540733b0 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f28540ac400 con 0x7f285406f970 2024-05-09T00:20:13.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2853e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2854155790 0x7f285406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2853e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2854155790 0x7f285406f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48688/0 (socket says 172.21.15.114:48688) 2024-05-09T00:20:13.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2853e00640 1 -- 172.21.15.114:0/3072473238 learned_addr learned my addr 172.21.15.114:0/3072473238 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2858a00640 1 --2- 172.21.15.114:0/3072473238 >> v2:172.21.15.153:3300/0 conn(0x7f28540733b0 0x7f2854073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2859400640 1 --2- 172.21.15.114:0/3072473238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f285406f970 0x7f28540c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2853e00640 1 -- 172.21.15.114:0/3072473238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f285406f970 msgr2=0x7f28540c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.789+0000 7f2853e00640 1 --2- 172.21.15.114:0/3072473238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f285406f970 0x7f28540c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.790+0000 7f2853e00640 1 -- 172.21.15.114:0/3072473238 >> v2:172.21.15.153:3300/0 conn(0x7f28540733b0 msgr2=0x7f2854073eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.790+0000 7f2853e00640 1 --2- 172.21.15.114:0/3072473238 >> v2:172.21.15.153:3300/0 conn(0x7f28540733b0 0x7f2854073eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.790+0000 7f2853e00640 1 -- 172.21.15.114:0/3072473238 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28540abe40 con 0x7f2854155790 2024-05-09T00:20:13.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.790+0000 7f2858a00640 1 --2- 172.21.15.114:0/3072473238 >> v2:172.21.15.153:3300/0 conn(0x7f28540733b0 0x7f2854073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:13.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.791+0000 7f2853e00640 1 --2- 172.21.15.114:0/3072473238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2854155790 0x7f285406f430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2854069ff0 tx=0x7f284002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d59bedd689deaf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.791+0000 7f2853400640 1 -- 172.21.15.114:0/3072473238 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840037070 con 0x7f2854155790 2024-05-09T00:20:13.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.791+0000 7f2853400640 1 -- 172.21.15.114:0/3072473238 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2840032440 con 0x7f2854155790 2024-05-09T00:20:13.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.791+0000 7f2853400640 1 -- 172.21.15.114:0/3072473238 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840032810 con 0x7f2854155790 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 -- 172.21.15.114:0/3072473238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2854155790 msgr2=0x7f285406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 --2- 172.21.15.114:0/3072473238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2854155790 0x7f285406f430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2854069ff0 tx=0x7f284002a140 comp rx=0 tx=0).stop 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 -- 172.21.15.114:0/3072473238 shutdown_connections 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 --2- 172.21.15.114:0/3072473238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f285406f970 0x7f28540c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 --2- 172.21.15.114:0/3072473238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2854155790 0x7f285406f430 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 --2- 172.21.15.114:0/3072473238 >> v2:172.21.15.153:3300/0 conn(0x7f28540733b0 0x7f2854073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 -- 172.21.15.114:0/3072473238 >> 172.21.15.114:0/3072473238 conn(0x7f28540c5ff0 msgr2=0x7f28540c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 -- 172.21.15.114:0/3072473238 shutdown_connections 2024-05-09T00:20:13.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.792+0000 7f2859e00640 1 -- 172.21.15.114:0/3072473238 wait complete. 2024-05-09T00:20:13.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.794+0000 7f2859e00640 1 Processor -- start 2024-05-09T00:20:13.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.794+0000 7f2859e00640 1 -- start start 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285406f970 0x7f28541e2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28540733b0 0x7f28541478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854155790 0x7f2854147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2854155ba0 con 0x7f285406f970 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28540c4fa0 con 0x7f2854155790 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2854072770 con 0x7f28540733b0 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285406f970 0x7f28541e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285406f970 0x7f28541e2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48694/0 (socket says 172.21.15.114:48694) 2024-05-09T00:20:13.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 -- 172.21.15.114:0/2234615114 learned_addr learned my addr 172.21.15.114:0/2234615114 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2859400640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854155790 0x7f2854147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2853e00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28540733b0 0x7f28541478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 -- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28540733b0 msgr2=0x7f28541478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28540733b0 0x7f28541478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 -- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854155790 msgr2=0x7f2854147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854155790 0x7f2854147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.796+0000 7f2858a00640 1 -- 172.21.15.114:0/2234615114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285414e730 con 0x7f285406f970 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.797+0000 7f2858a00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285406f970 0x7f28541e2990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f284800c7f0 tx=0x7f284800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.797+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848015070 con 0x7f285406f970 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.797+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848007820 con 0x7f285406f970 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.797+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848007bd0 con 0x7f285406f970 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.797+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28541ee610 con 0x7f285406f970 2024-05-09T00:20:13.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.797+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28540aed70 con 0x7f285406f970 2024-05-09T00:20:13.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.798+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28540784d0 con 0x7f285406f970 2024-05-09T00:20:13.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.799+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2848018070 con 0x7f285406f970 2024-05-09T00:20:13.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.800+0000 7f2850c00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f28340762d0 0x7f28340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.801+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f2848098490 con 0x7f285406f970 2024-05-09T00:20:13.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.801+0000 7f2853e00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f28340762d0 0x7f28340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.801+0000 7f2850c00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f2834081550 0x7f2834083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:13.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.801+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 --> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2848008e50 con 0x7f2834081550 2024-05-09T00:20:13.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.801+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2848098840 con 0x7f285406f970 2024-05-09T00:20:13.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.801+0000 7f2853e00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f28340762d0 0x7f28340787e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2840034000 tx=0x7f284002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.802+0000 7f2859400640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f2834081550 0x7f2834083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:13.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.803+0000 7f2859400640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f2834081550 0x7f2834083a40 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:13.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.805+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== osd.7 v2:172.21.15.153:6816/3047453472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2848008e50 con 0x7f2834081550 2024-05-09T00:20:13.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.820+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 --> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2854072550 con 0x7f2834081550 2024-05-09T00:20:13.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2850c00640 1 -- 172.21.15.114:0/2234615114 <== osd.7 v2:172.21.15.153:6816/3047453472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2854072550 con 0x7f2834081550 2024-05-09T00:20:13.821 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-05-09T00:20:13.821 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T00:20:13.821 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-05-09T00:20:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f2834081550 msgr2=0x7f2834083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859e00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.153:6816/3047453472,v1:172.21.15.153:6817/3047453472] conn(0x7f2834081550 0x7f2834083a40 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f28340762d0 msgr2=0x7f28340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859e00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f28340762d0 0x7f28340787e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2840034000 tx=0x7f284002e000 comp rx=0 tx=0).stop 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285406f970 msgr2=0x7f28541e2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859e00640 1 --2- 172.21.15.114:0/2234615114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285406f970 0x7f28541e2990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f284800c7f0 tx=0x7f284800ccb0 comp rx=0 tx=0).stop 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.821+0000 7f2859400640 1 -- 172.21.15.114:0/2234615114 reap_dead start 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.822+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 shutdown_connections 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.822+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 >> 172.21.15.114:0/2234615114 conn(0x7f28540c5ff0 msgr2=0x7f2854075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.822+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 shutdown_connections 2024-05-09T00:20:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:13.822+0000 7f2859e00640 1 -- 172.21.15.114:0/2234615114 wait complete. 2024-05-09T00:20:13.846 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T00:20:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.111+0000 7f0cab200640 1 Processor -- start 2024-05-09T00:20:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.112+0000 7f0cab200640 1 -- start start 2024-05-09T00:20:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.113+0000 7f0cab200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0cac154e60 0x7f0cac158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.113+0000 7f0cab200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac0721a0 con 0x7f0cac0af230 2024-05-09T00:20:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.113+0000 7f0cab200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac1584f0 con 0x7f0cac0c4db0 2024-05-09T00:20:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.113+0000 7f0cab200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0cac072ca0 con 0x7f0cac154e60 2024-05-09T00:20:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.114+0000 7f0ca9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0cac0af230 0x7f0cac072590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35466/0 (socket says 172.21.15.114:35466) 2024-05-09T00:20:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.114+0000 7f0ca9e00640 1 -- 172.21.15.114:0/460821865 learned_addr learned my addr 172.21.15.114:0/460821865 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.114+0000 7f0ca1400640 1 --2- 172.21.15.114:0/460821865 >> v2:172.21.15.153:3300/0 conn(0x7f0cac154e60 0x7f0cac158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.114+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669761576 0 0) 0x7f0cac0721a0 con 0x7f0cac0af230 2024-05-09T00:20:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.114+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c90003520 con 0x7f0cac0af230 2024-05-09T00:20:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 722845961 0 0) 0x7f0c90003520 con 0x7f0cac0af230 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 >> v2:172.21.15.153:3300/0 conn(0x7f0cac154e60 msgr2=0x7f0cac158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 --2- 172.21.15.114:0/460821865 >> v2:172.21.15.153:3300/0 conn(0x7f0cac154e60 0x7f0cac158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 >> v1:172.21.15.153:6789/0 conn(0x7f0cac0c4db0 legacy=0x7f0cac15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac073e00 con 0x7f0cac0af230 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f0c9c0016f0 con 0x7f0cac0af230 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 >> v1:172.21.15.114:6789/0 conn(0x7f0cac0af230 legacy=0x7f0cac072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0c90003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 0x7f0c90004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900053a0 0x7f0c9000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac072ca0 con 0x7f0c90003a50 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9000c330 con 0x7f0c900053a0 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9000c530 con 0x7f0c90004800 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.115+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0c90003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0ca9e00640 1 -- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 msgr2=0x7f0c90004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 0x7f0c90004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0caa800640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900053a0 0x7f0c9000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0ca9e00640 1 -- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900053a0 msgr2=0x7f0c9000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900053a0 0x7f0c9000ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0ca9e00640 1 -- 172.21.15.114:0/460821865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c90003520 con 0x7f0c90003a50 2024-05-09T00:20:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.116+0000 7f0caa800640 1 -- 172.21.15.114:0/460821865 reap_dead start 2024-05-09T00:20:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.117+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0c90003ec0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c210 tx=0x7f0c90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5eaa83ce9f2586 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.117+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c007d70 con 0x7f0c90003a50 2024-05-09T00:20:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.117+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c02e070 con 0x7f0c90003a50 2024-05-09T00:20:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.117+0000 7f0ca9400640 1 -- 172.21.15.114:0/460821865 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c005d10 con 0x7f0c90003a50 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 -- 172.21.15.114:0/460821865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 msgr2=0x7f0c90003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0c90003ec0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c210 tx=0x7f0c90005830 comp rx=0 tx=0).stop 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 -- 172.21.15.114:0/460821865 shutdown_connections 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 --2- 172.21.15.114:0/460821865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0c90003ec0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 -- 172.21.15.114:0/460821865 >> 172.21.15.114:0/460821865 conn(0x7f0cac0c5ea0 msgr2=0x7f0cac0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 -- 172.21.15.114:0/460821865 shutdown_connections 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.118+0000 7f0cab200640 1 -- 172.21.15.114:0/460821865 wait complete. 2024-05-09T00:20:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.120+0000 7f0cab200640 1 Processor -- start 2024-05-09T00:20:14.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.120+0000 7f0cab200640 1 -- start start 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0cab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0cac1ead70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0cab200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cac14edf0 0x7f0cac14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0cab200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cac1e00a0 0x7f0cac1e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0cab200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac155270 con 0x7f0c90003a50 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0cab200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac158820 con 0x7f0cac14edf0 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0cab200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0cac0743c0 con 0x7f0cac1e00a0 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0ca9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0cac1ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0ca9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0cac1ead70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48706/0 (socket says 172.21.15.114:48706) 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0ca9e00640 1 -- 172.21.15.114:0/4294568932 learned_addr learned my addr 172.21.15.114:0/4294568932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.122+0000 7f0ca1400640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cac14edf0 0x7f0cac14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0caa800640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cac1e00a0 0x7f0cac1e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca9e00640 1 -- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cac1e00a0 msgr2=0x7f0cac1e04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cac1e00a0 0x7f0cac1e04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca9e00640 1 -- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cac14edf0 msgr2=0x7f0cac14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cac14edf0 0x7f0cac14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca9e00640 1 -- 172.21.15.114:0/4294568932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac0c7230 con 0x7f0c90003a50 2024-05-09T00:20:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca9e00640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0cac1ead70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c210 tx=0x7f0cac073fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c007270 con 0x7f0c90003a50 2024-05-09T00:20:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c007410 con 0x7f0c90003a50 2024-05-09T00:20:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0077c0 con 0x7f0c90003a50 2024-05-09T00:20:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.123+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac1e12d0 con 0x7f0c90003a50 2024-05-09T00:20:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.124+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1df9a0 con 0x7f0c90003a50 2024-05-09T00:20:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.125+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac077430 con 0x7f0c90003a50 2024-05-09T00:20:14.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.126+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c9c033470 con 0x7f0c90003a50 2024-05-09T00:20:14.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.127+0000 7f0ca2a00640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c88076470 0x7f0c88078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.127+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f0c9c0b8110 con 0x7f0c90003a50 2024-05-09T00:20:14.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.127+0000 7f0ca1400640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c88076470 0x7f0c88078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.128+0000 7f0ca1400640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c88076470 0x7f0c88078980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009670 tx=0x7f0c9400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:14.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.132+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0cac077430 con 0x7f0c90003a50 2024-05-09T00:20:14.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.340+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0cac078430 con 0x7f0c88076470 2024-05-09T00:20:14.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.340+0000 7f0ca2a00640 1 -- 172.21.15.114:0/4294568932 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0cac078430 con 0x7f0c88076470 2024-05-09T00:20:14.340 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T00:20:14.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c88076470 msgr2=0x7f0c88078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c88076470 0x7f0c88078980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009670 tx=0x7f0c9400b040 comp rx=0 tx=0).stop 2024-05-09T00:20:14.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 msgr2=0x7f0cac1ead70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0cac1ead70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c210 tx=0x7f0cac073fd0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 shutdown_connections 2024-05-09T00:20:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f0c88076470 0x7f0c88078980 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cac1e00a0 0x7f0cac1e04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cac14edf0 0x7f0cac14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 --2- 172.21.15.114:0/4294568932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c90003a50 0x7f0cac1ead70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.343+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 >> 172.21.15.114:0/4294568932 conn(0x7f0cac0c5ea0 msgr2=0x7f0cac0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.344+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 shutdown_connections 2024-05-09T00:20:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.344+0000 7f0cab200640 1 -- 172.21.15.114:0/4294568932 wait complete. 2024-05-09T00:20:14.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:20:14.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.633+0000 7fbf6c400640 1 Processor -- start 2024-05-09T00:20:14.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.633+0000 7fbf6c400640 1 -- start start 2024-05-09T00:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.635+0000 7fbf6c400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf64153760 0x7fbf64159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.635+0000 7fbf6c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf64156bb0 con 0x7fbf640c43c0 2024-05-09T00:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.635+0000 7fbf6c400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf64156e90 con 0x7fbf640ae940 2024-05-09T00:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.635+0000 7fbf6c400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbf640ac710 con 0x7fbf64153760 2024-05-09T00:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.636+0000 7fbf69a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbf640c43c0 0x7fbf64159830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35470/0 (socket says 172.21.15.114:35470) 2024-05-09T00:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.636+0000 7fbf69a00640 1 -- 172.21.15.114:0/1400895129 learned_addr learned my addr 172.21.15.114:0/1400895129 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.636+0000 7fbf69000640 1 --2- 172.21.15.114:0/1400895129 >> v2:172.21.15.153:3300/0 conn(0x7fbf64153760 0x7fbf64159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.636+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5324994 0 0) 0x7fbf64156bb0 con 0x7fbf640c43c0 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.636+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf4c003520 con 0x7fbf640c43c0 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2950578518 0 0) 0x7fbf4c003520 con 0x7fbf640c43c0 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 >> v2:172.21.15.153:3300/0 conn(0x7fbf64153760 msgr2=0x7fbf64159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 --2- 172.21.15.114:0/1400895129 >> v2:172.21.15.153:3300/0 conn(0x7fbf64153760 0x7fbf64159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 >> v1:172.21.15.153:6789/0 conn(0x7fbf640ae940 legacy=0x7fbf640aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf640ac960 con 0x7fbf640c43c0 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fbf580016f0 con 0x7fbf640c43c0 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 >> v1:172.21.15.114:6789/0 conn(0x7fbf640c43c0 legacy=0x7fbf64159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf4c003a50 0x7fbf4c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c004800 0x7fbf4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c005350 0x7fbf4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf640ac710 con 0x7fbf4c003a50 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c00c2a0 con 0x7fbf4c005350 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4c00c4a0 con 0x7fbf4c004800 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.637+0000 7fbf69a00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf4c003a50 0x7fbf4c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf69000640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c004800 0x7fbf4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf69a00640 1 -- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c004800 msgr2=0x7fbf4c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf69a00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c004800 0x7fbf4c004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf69a00640 1 -- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c005350 msgr2=0x7fbf4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf69a00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c005350 0x7fbf4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf69a00640 1 -- 172.21.15.114:0/1400895129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c003520 con 0x7fbf4c003a50 2024-05-09T00:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.638+0000 7fbf6a400640 1 -- 172.21.15.114:0/1400895129 reap_dead start 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.639+0000 7fbf69a00640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf4c003a50 0x7fbf4c003ee0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c210 tx=0x7fbf4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dff7100e2e588e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.639+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58007d70 con 0x7fbf4c003a50 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.639+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5802e070 con 0x7fbf4c003a50 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.639+0000 7fbf63e00640 1 -- 172.21.15.114:0/1400895129 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58005d10 con 0x7fbf4c003a50 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 -- 172.21.15.114:0/1400895129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf4c003a50 msgr2=0x7fbf4c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf4c003a50 0x7fbf4c003ee0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c210 tx=0x7fbf4c005830 comp rx=0 tx=0).stop 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 -- 172.21.15.114:0/1400895129 shutdown_connections 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 --2- 172.21.15.114:0/1400895129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf4c003a50 0x7fbf4c003ee0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 -- 172.21.15.114:0/1400895129 >> 172.21.15.114:0/1400895129 conn(0x7fbf6406c680 msgr2=0x7fbf6406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 -- 172.21.15.114:0/1400895129 shutdown_connections 2024-05-09T00:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.640+0000 7fbf6c400640 1 -- 172.21.15.114:0/1400895129 wait complete. 2024-05-09T00:20:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.642+0000 7fbf6c400640 1 Processor -- start 2024-05-09T00:20:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.642+0000 7fbf6c400640 1 -- start start 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c003a50 0x7fbf64073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf641ee280 0x7fbf640c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 0x7fbf64155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf640aed50 con 0x7fbf64155450 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf640ad3c0 con 0x7fbf641ee280 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbf640aeed0 con 0x7fbf4c003a50 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 0x7fbf64155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 0x7fbf64155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48728/0 (socket says 172.21.15.114:48728) 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf6a400640 1 -- 172.21.15.114:0/91658196 learned_addr learned my addr 172.21.15.114:0/91658196 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf69a00640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c003a50 0x7fbf64073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.644+0000 7fbf69000640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf641ee280 0x7fbf640c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6a400640 1 -- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c003a50 msgr2=0x7fbf64073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6a400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c003a50 0x7fbf64073f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6a400640 1 -- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf641ee280 msgr2=0x7fbf640c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6a400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf641ee280 0x7fbf640c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6a400640 1 -- 172.21.15.114:0/91658196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf641f2200 con 0x7fbf64155450 2024-05-09T00:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6a400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 0x7fbf64155860 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbf64070900 tx=0x7fbf5c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c017070 con 0x7fbf64155450 2024-05-09T00:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c005d40 con 0x7fbf64155450 2024-05-09T00:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00a830 con 0x7fbf64155450 2024-05-09T00:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf64152cc0 con 0x7fbf64155450 2024-05-09T00:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.645+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6414b380 con 0x7fbf64155450 2024-05-09T00:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.646+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf641f2700 con 0x7fbf64155450 2024-05-09T00:20:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.648+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf5c01a070 con 0x7fbf64155450 2024-05-09T00:20:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.649+0000 7fbf61600640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf440762d0 0x7fbf440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.649+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fbf5c097080 con 0x7fbf64155450 2024-05-09T00:20:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.649+0000 7fbf69a00640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf440762d0 0x7fbf440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:14.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.650+0000 7fbf69a00640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf440762d0 0x7fbf440787e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf58032000 tx=0x7fbf58007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.654+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf641f2700 con 0x7fbf64155450 2024-05-09T00:20:14.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.863+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf64077430 con 0x7fbf440762d0 2024-05-09T00:20:14.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.900+0000 7fbf61600640 1 -- 172.21.15.114:0/91658196 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+491112 (secure 0 0 0) 0x7fbf64077430 con 0x7fbf440762d0 2024-05-09T00:20:14.907 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:14.911 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf440762d0 msgr2=0x7fbf440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf440762d0 0x7fbf440787e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf58032000 tx=0x7fbf58007000 comp rx=0 tx=0).stop 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 msgr2=0x7fbf64155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 0x7fbf64155860 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbf64070900 tx=0x7fbf5c00cb90 comp rx=0 tx=0).stop 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 shutdown_connections 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf440762d0 0x7fbf440787e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf64155450 0x7fbf64155860 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf641ee280 0x7fbf640c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 --2- 172.21.15.114:0/91658196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf4c003a50 0x7fbf64073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:14.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.908+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 >> 172.21.15.114:0/91658196 conn(0x7fbf6406c680 msgr2=0x7fbf640c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:14.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.909+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 shutdown_connections 2024-05-09T00:20:14.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:14.909+0000 7fbf6c400640 1 -- 172.21.15.114:0/91658196 wait complete. 2024-05-09T00:20:14.936 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-05-09T00:20:14.638238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":188582243,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":2536,"num_read_kb":419209,"num_write":6426446,"num_write_kb":81417639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":439947,"ondisk_log_size":439947,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4295432,"kb_used_data":371720,"kb_used_omap":12,"kb_used_meta":3923635,"kb_avail":750679288,"statfs":{"total":773094113280,"available":768695590912,"internally_reserved":0,"allocated":380641280,"data_stored":378712902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":4017802800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5060505983,"num_objects":-1406,"num_object_clones":0,"num_object_copies":-2812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1406,"num_whiteouts":0,"num_read":3,"num_read_kb":25,"num_write":1437,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005737"},"pg_stats":[{"pgid":"5.18","version":"38'3510","reported_seq":3570,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.650214+0000","last_change":"2024-05-09T00:08:55.240098+0000","last_active":"2024-05-09T00:19:53.650214+0000","last_peered":"2024-05-09T00:19:53.650214+0000","last_clean":"2024-05-09T00:19:53.650214+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:19:53.650214+0000","last_undegraded":"2024-05-09T00:19:53.650214+0000","last_fullsized":"2024-05-09T00:19:53.650214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":51796,"num_write_kb":675575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"32'26","reported_seq":93,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:11.023267+0000","last_change":"2024-05-09T00:08:44.102781+0000","last_active":"2024-05-09T00:19:11.023267+0000","last_peered":"2024-05-09T00:19:11.023267+0000","last_clean":"2024-05-09T00:19:11.023267+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:19:11.023267+0000","last_undegraded":"2024-05-09T00:19:11.023267+0000","last_fullsized":"2024-05-09T00:19:11.023267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":12312,"num_write":21,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"38'3268","reported_seq":3318,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.983806+0000","last_change":"2024-05-09T00:08:45.116076+0000","last_active":"2024-05-09T00:20:03.983806+0000","last_peered":"2024-05-09T00:20:03.983806+0000","last_clean":"2024-05-09T00:20:03.983806+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:20:03.983806+0000","last_undegraded":"2024-05-09T00:20:03.983806+0000","last_fullsized":"2024-05-09T00:20:03.983806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:07.814109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":48401,"num_write_kb":608968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"38'5","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:54.772350+0000","last_change":"2024-05-09T00:08:54.227257+0000","last_active":"2024-05-09T00:18:54.772350+0000","last_peered":"2024-05-09T00:18:54.772350+0000","last_clean":"2024-05-09T00:18:54.772350+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:18:54.772350+0000","last_undegraded":"2024-05-09T00:18:54.772350+0000","last_fullsized":"2024-05-09T00:18:54.772350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.574432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"38'4249","reported_seq":4311,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644263+0000","last_change":"2024-05-09T00:08:55.231884+0000","last_active":"2024-05-09T00:19:53.644263+0000","last_peered":"2024-05-09T00:19:53.644263+0000","last_clean":"2024-05-09T00:19:53.644263+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:19:53.644263+0000","last_undegraded":"2024-05-09T00:19:53.644263+0000","last_fullsized":"2024-05-09T00:19:53.644263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4249,"log_dups_size":0,"ondisk_log_size":4249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":63068,"num_write_kb":790226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"38'12","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.062973+0000","last_change":"2024-05-09T00:08:44.101184+0000","last_active":"2024-05-09T00:20:04.062973+0000","last_peered":"2024-05-09T00:20:04.062973+0000","last_clean":"2024-05-09T00:20:04.062973+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:20:04.062973+0000","last_undegraded":"2024-05-09T00:20:04.062973+0000","last_fullsized":"2024-05-09T00:20:04.062973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:18:59.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"38'3802","reported_seq":3861,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.105763+0000","last_change":"2024-05-09T00:08:45.097822+0000","last_active":"2024-05-09T00:20:04.105763+0000","last_peered":"2024-05-09T00:20:04.105763+0000","last_clean":"2024-05-09T00:20:04.105763+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:20:04.105763+0000","last_undegraded":"2024-05-09T00:20:04.105763+0000","last_fullsized":"2024-05-09T00:20:04.105763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3802,"log_dups_size":0,"ondisk_log_size":3802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:46.196657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":56279,"num_write_kb":712681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"38'34","reported_seq":81,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.604620+0000","last_change":"2024-05-09T00:08:54.225870+0000","last_active":"2024-05-09T00:19:53.604620+0000","last_peered":"2024-05-09T00:19:53.604620+0000","last_clean":"2024-05-09T00:19:53.604620+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:19:53.604620+0000","last_undegraded":"2024-05-09T00:19:53.604620+0000","last_fullsized":"2024-05-09T00:19:53.604620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":31,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"38'3172","reported_seq":3224,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628348+0000","last_change":"2024-05-09T00:08:55.232873+0000","last_active":"2024-05-09T00:19:53.628348+0000","last_peered":"2024-05-09T00:19:53.628348+0000","last_clean":"2024-05-09T00:19:53.628348+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:19:53.628348+0000","last_undegraded":"2024-05-09T00:19:53.628348+0000","last_fullsized":"2024-05-09T00:19:53.628348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46816,"num_write_kb":580338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"38'70","reported_seq":139,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.072807+0000","last_change":"2024-05-09T00:08:44.095710+0000","last_active":"2024-05-09T00:20:04.072807+0000","last_peered":"2024-05-09T00:20:04.072807+0000","last_clean":"2024-05-09T00:20:04.072807+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:20:04.072807+0000","last_undegraded":"2024-05-09T00:20:04.072807+0000","last_fullsized":"2024-05-09T00:20:04.072807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":24612,"num_write":55,"num_write_kb":12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2295","reported_seq":2346,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.113292+0000","last_change":"2024-05-09T00:08:45.098221+0000","last_active":"2024-05-09T00:20:04.113292+0000","last_peered":"2024-05-09T00:20:04.113292+0000","last_clean":"2024-05-09T00:20:04.113292+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:20:04.113292+0000","last_undegraded":"2024-05-09T00:20:04.113292+0000","last_fullsized":"2024-05-09T00:20:04.113292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":33922,"num_write_kb":416723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"38'1159","reported_seq":1206,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.554109+0000","last_change":"2024-05-09T00:08:54.219238+0000","last_active":"2024-05-09T00:19:53.554109+0000","last_peered":"2024-05-09T00:19:53.554109+0000","last_clean":"2024-05-09T00:19:53.554109+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:19:53.554109+0000","last_undegraded":"2024-05-09T00:19:53.554109+0000","last_fullsized":"2024-05-09T00:19:53.554109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1156,"num_write_kb":5131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"38'2810","reported_seq":2866,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.643697+0000","last_change":"2024-05-09T00:08:55.216984+0000","last_active":"2024-05-09T00:19:53.643697+0000","last_peered":"2024-05-09T00:19:53.643697+0000","last_clean":"2024-05-09T00:19:53.643697+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:19:53.643697+0000","last_undegraded":"2024-05-09T00:19:53.643697+0000","last_fullsized":"2024-05-09T00:19:53.643697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":41711,"num_write_kb":539991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"38'20","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.073216+0000","last_change":"2024-05-09T00:08:44.088175+0000","last_active":"2024-05-09T00:20:04.073216+0000","last_peered":"2024-05-09T00:20:04.073216+0000","last_clean":"2024-05-09T00:20:04.073216+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:20:04.073216+0000","last_undegraded":"2024-05-09T00:20:04.073216+0000","last_fullsized":"2024-05-09T00:20:04.073216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"38'3819","reported_seq":3873,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.036703+0000","last_change":"2024-05-09T00:08:45.111541+0000","last_active":"2024-05-09T00:20:04.036703+0000","last_peered":"2024-05-09T00:20:04.036703+0000","last_clean":"2024-05-09T00:20:04.036703+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:20:04.036703+0000","last_undegraded":"2024-05-09T00:20:04.036703+0000","last_fullsized":"2024-05-09T00:20:04.036703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56698,"num_write_kb":717087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"38'128","reported_seq":176,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.622781+0000","last_change":"2024-05-09T00:08:54.217523+0000","last_active":"2024-05-09T00:19:53.622781+0000","last_peered":"2024-05-09T00:19:53.622781+0000","last_clean":"2024-05-09T00:19:53.622781+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:19:53.622781+0000","last_undegraded":"2024-05-09T00:19:53.622781+0000","last_fullsized":"2024-05-09T00:19:53.622781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12967,"num_write":119,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"38'3858","reported_seq":3921,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.628541+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:19:53.628541+0000","last_peered":"2024-05-09T00:19:53.628541+0000","last_clean":"2024-05-09T00:19:53.628541+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:19:53.628541+0000","last_undegraded":"2024-05-09T00:19:53.628541+0000","last_fullsized":"2024-05-09T00:19:53.628541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:52.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":57322,"num_write_kb":713128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"38'2905","reported_seq":2958,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.741376+0000","last_change":"2024-05-09T00:08:45.105416+0000","last_active":"2024-05-09T00:20:03.741376+0000","last_peered":"2024-05-09T00:20:03.741376+0000","last_clean":"2024-05-09T00:20:03.741376+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:20:03.741376+0000","last_undegraded":"2024-05-09T00:20:03.741376+0000","last_fullsized":"2024-05-09T00:20:03.741376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2905,"log_dups_size":0,"ondisk_log_size":2905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:47.077074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":43150,"num_write_kb":535156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"38'443","reported_seq":508,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.072640+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:20:04.072640+0000","last_peered":"2024-05-09T00:20:04.072640+0000","last_clean":"2024-05-09T00:20:04.072640+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:20:04.072640+0000","last_undegraded":"2024-05-09T00:20:04.072640+0000","last_fullsized":"2024-05-09T00:20:04.072640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:13.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":13833,"num_write":428,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"38'28","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:49.858859+0000","last_change":"2024-05-09T00:08:54.210584+0000","last_active":"2024-05-09T00:18:49.858859+0000","last_peered":"2024-05-09T00:18:49.858859+0000","last_clean":"2024-05-09T00:18:49.858859+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:18:49.858859+0000","last_undegraded":"2024-05-09T00:18:49.858859+0000","last_fullsized":"2024-05-09T00:18:49.858859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:23.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":25,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"38'3696","reported_seq":3753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644711+0000","last_change":"2024-05-09T00:08:55.241147+0000","last_active":"2024-05-09T00:19:53.644711+0000","last_peered":"2024-05-09T00:19:53.644711+0000","last_clean":"2024-05-09T00:19:53.644711+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:19:53.644711+0000","last_undegraded":"2024-05-09T00:19:53.644711+0000","last_fullsized":"2024-05-09T00:19:53.644711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54745,"num_write_kb":690364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"38'2635","reported_seq":2689,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.085041+0000","last_change":"2024-05-09T00:08:45.103529+0000","last_active":"2024-05-09T00:20:04.085041+0000","last_peered":"2024-05-09T00:20:04.085041+0000","last_clean":"2024-05-09T00:20:04.085041+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:20:04.085041+0000","last_undegraded":"2024-05-09T00:20:04.085041+0000","last_fullsized":"2024-05-09T00:20:04.085041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2635,"log_dups_size":0,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:11.997213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":39020,"num_write_kb":478044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"38'85","reported_seq":136,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.069228+0000","last_change":"2024-05-09T00:08:44.105466+0000","last_active":"2024-05-09T00:20:04.069228+0000","last_peered":"2024-05-09T00:20:04.069228+0000","last_clean":"2024-05-09T00:20:04.069228+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:20:04.069228+0000","last_undegraded":"2024-05-09T00:20:04.069228+0000","last_fullsized":"2024-05-09T00:20:04.069228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:28.839728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110967,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":1124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"38'3","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:08.358776+0000","last_change":"2024-05-09T00:08:54.217594+0000","last_active":"2024-05-09T00:20:08.358776+0000","last_peered":"2024-05-09T00:20:08.358776+0000","last_clean":"2024-05-09T00:20:08.358776+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:20:08.358776+0000","last_undegraded":"2024-05-09T00:20:08.358776+0000","last_fullsized":"2024-05-09T00:20:08.358776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"38'3606","reported_seq":3668,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.542603+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:19:53.542603+0000","last_peered":"2024-05-09T00:19:53.542603+0000","last_clean":"2024-05-09T00:19:53.542603+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:19:53.542603+0000","last_undegraded":"2024-05-09T00:19:53.542603+0000","last_fullsized":"2024-05-09T00:19:53.542603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:26.322694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":53395,"num_write_kb":656713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"38'3287","reported_seq":3340,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.003817+0000","last_change":"2024-05-09T00:08:45.094073+0000","last_active":"2024-05-09T00:20:04.003817+0000","last_peered":"2024-05-09T00:20:04.003817+0000","last_clean":"2024-05-09T00:20:04.003817+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:20:04.003817+0000","last_undegraded":"2024-05-09T00:20:04.003817+0000","last_fullsized":"2024-05-09T00:20:04.003817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48685,"num_write_kb":618917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"38'3","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.073709+0000","last_change":"2024-05-09T00:08:44.098946+0000","last_active":"2024-05-09T00:20:04.073709+0000","last_peered":"2024-05-09T00:20:04.073709+0000","last_clean":"2024-05-09T00:20:04.073709+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:20:04.073709+0000","last_undegraded":"2024-05-09T00:20:04.073709+0000","last_fullsized":"2024-05-09T00:20:04.073709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"38'114","reported_seq":164,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613428+0000","last_change":"2024-05-09T00:08:54.227759+0000","last_active":"2024-05-09T00:19:53.613428+0000","last_peered":"2024-05-09T00:19:53.613428+0000","last_clean":"2024-05-09T00:19:53.613428+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:19:53.613428+0000","last_undegraded":"2024-05-09T00:19:53.613428+0000","last_fullsized":"2024-05-09T00:19:53.613428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.683439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4101,"num_write":111,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"38'4190","reported_seq":4251,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.618390+0000","last_change":"2024-05-09T00:08:55.235289+0000","last_active":"2024-05-09T00:19:53.618390+0000","last_peered":"2024-05-09T00:19:53.618390+0000","last_clean":"2024-05-09T00:19:53.618390+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:19:53.618390+0000","last_undegraded":"2024-05-09T00:19:53.618390+0000","last_fullsized":"2024-05-09T00:19:53.618390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":62004,"num_write_kb":783810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"38'2923","reported_seq":2977,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.053315+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:20:04.053315+0000","last_peered":"2024-05-09T00:20:04.053315+0000","last_clean":"2024-05-09T00:20:04.053315+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:20:04.053315+0000","last_undegraded":"2024-05-09T00:20:04.053315+0000","last_fullsized":"2024-05-09T00:20:04.053315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:55.723133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43377,"num_write_kb":534691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"38'15","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.083831+0000","last_change":"2024-05-09T00:08:44.092755+0000","last_active":"2024-05-09T00:20:04.083831+0000","last_peered":"2024-05-09T00:20:04.083831+0000","last_clean":"2024-05-09T00:20:04.083831+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:20:04.083831+0000","last_undegraded":"2024-05-09T00:20:04.083831+0000","last_fullsized":"2024-05-09T00:20:04.083831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":10,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"38'19","reported_seq":83,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.365293+0000","last_change":"2024-05-09T00:20:10.365293+0000","last_active":"2024-05-09T00:20:10.365293+0000","last_peered":"2024-05-09T00:20:10.365293+0000","last_clean":"2024-05-09T00:20:10.365293+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:20:10.365293+0000","last_undegraded":"2024-05-09T00:20:10.365293+0000","last_fullsized":"2024-05-09T00:20:10.365293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'19","last_scrub_stamp":"2024-05-09T00:20:10.365166+0000","last_deep_scrub":"38'19","last_deep_scrub_stamp":"2024-05-09T00:20:10.365166+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.365166+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:39.230901+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":8222,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"38'3415","reported_seq":3471,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.616993+0000","last_change":"2024-05-09T00:08:55.231218+0000","last_active":"2024-05-09T00:19:53.616993+0000","last_peered":"2024-05-09T00:19:53.616993+0000","last_clean":"2024-05-09T00:19:53.616993+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:19:53.616993+0000","last_undegraded":"2024-05-09T00:19:53.616993+0000","last_fullsized":"2024-05-09T00:19:53.616993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":50480,"num_write_kb":654641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"38'2737","reported_seq":2791,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.040717+0000","last_change":"2024-05-09T00:08:45.096554+0000","last_active":"2024-05-09T00:20:04.040717+0000","last_peered":"2024-05-09T00:20:04.040717+0000","last_clean":"2024-05-09T00:20:04.040717+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:20:04.040717+0000","last_undegraded":"2024-05-09T00:20:04.040717+0000","last_fullsized":"2024-05-09T00:20:04.040717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":40218,"num_write_kb":499329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"38'5","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.073995+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:20:04.073995+0000","last_peered":"2024-05-09T00:20:04.073995+0000","last_clean":"2024-05-09T00:20:04.073995+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:20:04.073995+0000","last_undegraded":"2024-05-09T00:20:04.073995+0000","last_fullsized":"2024-05-09T00:20:04.073995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.244232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'29","reported_seq":103,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.199548+0000","last_change":"2024-05-09T00:08:54.213848+0000","last_active":"2024-05-09T00:20:04.199548+0000","last_peered":"2024-05-09T00:20:04.199548+0000","last_clean":"2024-05-09T00:20:04.199548+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:20:04.199548+0000","last_undegraded":"2024-05-09T00:20:04.199548+0000","last_fullsized":"2024-05-09T00:20:04.199548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":104,"num_write":26,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"38'3402","reported_seq":3461,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.564961+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:19:53.564961+0000","last_peered":"2024-05-09T00:19:53.564961+0000","last_clean":"2024-05-09T00:19:53.564961+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:19:53.564961+0000","last_undegraded":"2024-05-09T00:19:53.564961+0000","last_fullsized":"2024-05-09T00:19:53.564961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:37.737453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":50468,"num_write_kb":661545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"38'3255","reported_seq":3308,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.110452+0000","last_change":"2024-05-09T00:08:45.102828+0000","last_active":"2024-05-09T00:20:04.110452+0000","last_peered":"2024-05-09T00:20:04.110452+0000","last_clean":"2024-05-09T00:20:04.110452+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:20:04.110452+0000","last_undegraded":"2024-05-09T00:20:04.110452+0000","last_fullsized":"2024-05-09T00:20:04.110452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48118,"num_write_kb":593457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"38'287","reported_seq":345,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.078827+0000","last_change":"2024-05-09T00:08:44.086701+0000","last_active":"2024-05-09T00:20:04.078827+0000","last_peered":"2024-05-09T00:20:04.078827+0000","last_clean":"2024-05-09T00:20:04.078827+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:20:04.078827+0000","last_undegraded":"2024-05-09T00:20:04.078827+0000","last_fullsized":"2024-05-09T00:20:04.078827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":56,"num_write":605,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"38'125","reported_seq":174,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627688+0000","last_change":"2024-05-09T00:08:54.220861+0000","last_active":"2024-05-09T00:19:53.627688+0000","last_peered":"2024-05-09T00:19:53.627688+0000","last_clean":"2024-05-09T00:19:53.627688+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:19:53.627688+0000","last_undegraded":"2024-05-09T00:19:53.627688+0000","last_fullsized":"2024-05-09T00:19:53.627688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":117,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"38'3842","reported_seq":3901,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.535072+0000","last_change":"2024-05-09T00:08:55.241004+0000","last_active":"2024-05-09T00:19:53.535072+0000","last_peered":"2024-05-09T00:19:53.535072+0000","last_clean":"2024-05-09T00:19:53.535072+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:19:53.535072+0000","last_undegraded":"2024-05-09T00:19:53.535072+0000","last_fullsized":"2024-05-09T00:19:53.535072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":57074,"num_write_kb":711138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"38'3196","reported_seq":3250,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.062817+0000","last_change":"2024-05-09T00:08:45.109082+0000","last_active":"2024-05-09T00:20:04.062817+0000","last_peered":"2024-05-09T00:20:04.062817+0000","last_clean":"2024-05-09T00:20:04.062817+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:20:04.062817+0000","last_undegraded":"2024-05-09T00:20:04.062817+0000","last_fullsized":"2024-05-09T00:20:04.062817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":47419,"num_write_kb":602470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"38'4","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.053474+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:20:04.053474+0000","last_peered":"2024-05-09T00:20:04.053474+0000","last_clean":"2024-05-09T00:20:04.053474+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:20:04.053474+0000","last_undegraded":"2024-05-09T00:20:04.053474+0000","last_fullsized":"2024-05-09T00:20:04.053474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:11.897436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'1","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.063462+0000","last_change":"2024-05-09T00:08:54.216953+0000","last_active":"2024-05-09T00:18:35.063462+0000","last_peered":"2024-05-09T00:18:35.063462+0000","last_clean":"2024-05-09T00:18:35.063462+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:18:35.063462+0000","last_undegraded":"2024-05-09T00:18:35.063462+0000","last_fullsized":"2024-05-09T00:18:35.063462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:29.070666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"38'3423","reported_seq":3486,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.635684+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:19:53.635684+0000","last_peered":"2024-05-09T00:19:53.635684+0000","last_clean":"2024-05-09T00:19:53.635684+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:19:53.635684+0000","last_undegraded":"2024-05-09T00:19:53.635684+0000","last_fullsized":"2024-05-09T00:19:53.635684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":50760,"num_write_kb":664501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"38'2723","reported_seq":2778,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.106719+0000","last_change":"2024-05-09T00:08:45.111727+0000","last_active":"2024-05-09T00:20:04.106719+0000","last_peered":"2024-05-09T00:20:04.106719+0000","last_clean":"2024-05-09T00:20:04.106719+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:20:04.106719+0000","last_undegraded":"2024-05-09T00:20:04.106719+0000","last_fullsized":"2024-05-09T00:20:04.106719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40273,"num_write_kb":520250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"38'5","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.054936+0000","last_change":"2024-05-09T00:08:44.096816+0000","last_active":"2024-05-09T00:20:04.054936+0000","last_peered":"2024-05-09T00:20:04.054936+0000","last_clean":"2024-05-09T00:20:04.054936+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:20:04.054936+0000","last_undegraded":"2024-05-09T00:20:04.054936+0000","last_fullsized":"2024-05-09T00:20:04.054936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:31.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'61","reported_seq":110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.601835+0000","last_change":"2024-05-09T00:08:54.213456+0000","last_active":"2024-05-09T00:19:53.601835+0000","last_peered":"2024-05-09T00:19:53.601835+0000","last_clean":"2024-05-09T00:19:53.601835+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:19:53.601835+0000","last_undegraded":"2024-05-09T00:19:53.601835+0000","last_fullsized":"2024-05-09T00:19:53.601835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.392033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18843,"num_write":53,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"38'3161","reported_seq":3218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.561070+0000","last_change":"2024-05-09T00:08:55.243201+0000","last_active":"2024-05-09T00:19:53.561070+0000","last_peered":"2024-05-09T00:19:53.561070+0000","last_clean":"2024-05-09T00:19:53.561070+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:19:53.561070+0000","last_undegraded":"2024-05-09T00:19:53.561070+0000","last_fullsized":"2024-05-09T00:19:53.561070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3161,"log_dups_size":0,"ondisk_log_size":3161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":46450,"num_write_kb":620498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"38'2916","reported_seq":2979,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:09.126671+0000","last_change":"2024-05-09T00:20:09.126722+0000","last_active":"2024-05-09T00:20:09.126671+0000","last_peered":"2024-05-09T00:20:09.126671+0000","last_clean":"2024-05-09T00:20:09.126671+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:20:09.126671+0000","last_undegraded":"2024-05-09T00:20:09.126671+0000","last_fullsized":"2024-05-09T00:20:09.126671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2916","last_scrub_stamp":"2024-05-09T00:20:09.126512+0000","last_deep_scrub":"38'2916","last_deep_scrub_stamp":"2024-05-09T00:20:09.126512+0000","last_clean_scrub_stamp":"2024-05-09T00:20:09.126512+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:47.161350+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43303,"num_write_kb":562205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"38'34","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.073681+0000","last_change":"2024-05-09T00:08:44.106848+0000","last_active":"2024-05-09T00:20:04.073681+0000","last_peered":"2024-05-09T00:20:04.073681+0000","last_clean":"2024-05-09T00:20:04.073681+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:20:04.073681+0000","last_undegraded":"2024-05-09T00:20:04.073681+0000","last_fullsized":"2024-05-09T00:20:04.073681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:12.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":25,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"38'5","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.569752+0000","last_change":"2024-05-09T00:08:54.222195+0000","last_active":"2024-05-09T00:19:53.569752+0000","last_peered":"2024-05-09T00:19:53.569752+0000","last_clean":"2024-05-09T00:19:53.569752+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:19:53.569752+0000","last_undegraded":"2024-05-09T00:19:53.569752+0000","last_fullsized":"2024-05-09T00:19:53.569752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:53.214505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"38'3104","reported_seq":3159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.529663+0000","last_change":"2024-05-09T00:08:55.236612+0000","last_active":"2024-05-09T00:19:53.529663+0000","last_peered":"2024-05-09T00:19:53.529663+0000","last_clean":"2024-05-09T00:19:53.529663+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:19:53.529663+0000","last_undegraded":"2024-05-09T00:19:53.529663+0000","last_fullsized":"2024-05-09T00:19:53.529663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45747,"num_write_kb":566089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"38'2907","reported_seq":2964,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.103654+0000","last_change":"2024-05-09T00:08:45.093472+0000","last_active":"2024-05-09T00:20:04.103654+0000","last_peered":"2024-05-09T00:20:04.103654+0000","last_clean":"2024-05-09T00:20:04.103654+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:20:04.103654+0000","last_undegraded":"2024-05-09T00:20:04.103654+0000","last_fullsized":"2024-05-09T00:20:04.103654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:05.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42913,"num_write_kb":561201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"38'35","reported_seq":123,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.305827+0000","last_change":"2024-05-09T00:08:44.093183+0000","last_active":"2024-05-09T00:20:03.305827+0000","last_peered":"2024-05-09T00:20:03.305827+0000","last_clean":"2024-05-09T00:20:03.305827+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:20:03.305827+0000","last_undegraded":"2024-05-09T00:20:03.305827+0000","last_fullsized":"2024-05-09T00:20:03.305827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.435112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":106,"num_write":32,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"38'5","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587860+0000","last_change":"2024-05-09T00:08:54.209265+0000","last_active":"2024-05-09T00:19:53.587860+0000","last_peered":"2024-05-09T00:19:53.587860+0000","last_clean":"2024-05-09T00:19:53.587860+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:19:53.587860+0000","last_undegraded":"2024-05-09T00:19:53.587860+0000","last_fullsized":"2024-05-09T00:19:53.587860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:34.883526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"38'3544","reported_seq":3606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580100+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:19:53.580100+0000","last_peered":"2024-05-09T00:19:53.580100+0000","last_clean":"2024-05-09T00:19:53.580100+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:19:53.580100+0000","last_undegraded":"2024-05-09T00:19:53.580100+0000","last_fullsized":"2024-05-09T00:19:53.580100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:07.652967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":1,"num_write":52513,"num_write_kb":669201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"38'3009","reported_seq":3063,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.037765+0000","last_change":"2024-05-09T00:08:45.113431+0000","last_active":"2024-05-09T00:20:04.037765+0000","last_peered":"2024-05-09T00:20:04.037765+0000","last_clean":"2024-05-09T00:20:04.037765+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:20:04.037765+0000","last_undegraded":"2024-05-09T00:20:04.037765+0000","last_fullsized":"2024-05-09T00:20:04.037765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3009,"log_dups_size":0,"ondisk_log_size":3009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:27.461939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44755,"num_write_kb":572857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"38'444","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.068960+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:20:04.068960+0000","last_peered":"2024-05-09T00:20:04.068960+0000","last_clean":"2024-05-09T00:20:04.068960+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:20:04.068960+0000","last_undegraded":"2024-05-09T00:20:04.068960+0000","last_fullsized":"2024-05-09T00:20:04.068960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:25.173384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14538,"num_write":435,"num_write_kb":8538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"38'273","reported_seq":321,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.082158+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:19:56.082158+0000","last_peered":"2024-05-09T00:19:56.082158+0000","last_clean":"2024-05-09T00:19:56.082158+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:19:56.082158+0000","last_undegraded":"2024-05-09T00:19:56.082158+0000","last_fullsized":"2024-05-09T00:19:56.082158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:09:33.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":46,"num_write":566,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"38'3750","reported_seq":3814,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.626279+0000","last_change":"2024-05-09T00:08:55.233572+0000","last_active":"2024-05-09T00:19:53.626279+0000","last_peered":"2024-05-09T00:19:53.626279+0000","last_clean":"2024-05-09T00:19:53.626279+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:19:53.626279+0000","last_undegraded":"2024-05-09T00:19:53.626279+0000","last_fullsized":"2024-05-09T00:19:53.626279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":0,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":55664,"num_write_kb":710441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"38'3179","reported_seq":3233,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.999390+0000","last_change":"2024-05-09T00:08:45.104018+0000","last_active":"2024-05-09T00:20:03.999390+0000","last_peered":"2024-05-09T00:20:03.999390+0000","last_clean":"2024-05-09T00:20:03.999390+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:20:03.999390+0000","last_undegraded":"2024-05-09T00:20:03.999390+0000","last_fullsized":"2024-05-09T00:20:03.999390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3179,"log_dups_size":0,"ondisk_log_size":3179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":46937,"num_write_kb":587038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:35.075720+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:18:35.075720+0000","last_peered":"2024-05-09T00:18:35.075720+0000","last_clean":"2024-05-09T00:18:35.075720+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:18:35.075720+0000","last_undegraded":"2024-05-09T00:18:35.075720+0000","last_fullsized":"2024-05-09T00:18:35.075720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:26.580435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"38'74","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:09.819397+0000","last_change":"2024-05-09T00:20:09.819526+0000","last_active":"2024-05-09T00:20:09.819397+0000","last_peered":"2024-05-09T00:20:09.819397+0000","last_clean":"2024-05-09T00:20:09.819397+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:20:09.819397+0000","last_undegraded":"2024-05-09T00:20:09.819397+0000","last_fullsized":"2024-05-09T00:20:09.819397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-05-09T00:20:09.819189+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-05-09T00:20:09.819189+0000","last_clean_scrub_stamp":"2024-05-09T00:20:09.819189+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:44.100719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'4","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.580602+0000","last_change":"2024-05-09T00:08:54.211106+0000","last_active":"2024-05-09T00:19:53.580602+0000","last_peered":"2024-05-09T00:19:53.580602+0000","last_clean":"2024-05-09T00:19:53.580602+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:19:53.580602+0000","last_undegraded":"2024-05-09T00:19:53.580602+0000","last_fullsized":"2024-05-09T00:19:53.580602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:56.250005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"38'3132","reported_seq":3184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.633771+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:19:53.633771+0000","last_peered":"2024-05-09T00:19:53.633771+0000","last_clean":"2024-05-09T00:19:53.633771+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:19:53.633771+0000","last_undegraded":"2024-05-09T00:19:53.633771+0000","last_fullsized":"2024-05-09T00:19:53.633771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3132,"log_dups_size":0,"ondisk_log_size":3132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:35.459747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46383,"num_write_kb":562908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'2979","reported_seq":3036,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.087276+0000","last_change":"2024-05-09T00:08:45.098252+0000","last_active":"2024-05-09T00:20:04.087276+0000","last_peered":"2024-05-09T00:20:04.087276+0000","last_clean":"2024-05-09T00:20:04.087276+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:20:04.087276+0000","last_undegraded":"2024-05-09T00:20:04.087276+0000","last_fullsized":"2024-05-09T00:20:04.087276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:12.391181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":44170,"num_write_kb":571148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"38'3","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.035333+0000","last_change":"2024-05-09T00:08:44.101580+0000","last_active":"2024-05-09T00:20:04.035333+0000","last_peered":"2024-05-09T00:20:04.035333+0000","last_clean":"2024-05-09T00:20:04.035333+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:20:04.035333+0000","last_undegraded":"2024-05-09T00:20:04.035333+0000","last_fullsized":"2024-05-09T00:20:04.035333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:19.502616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"38'177","reported_seq":223,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:05.939427+0000","last_change":"2024-05-09T00:08:54.217793+0000","last_active":"2024-05-09T00:20:05.939427+0000","last_peered":"2024-05-09T00:20:05.939427+0000","last_clean":"2024-05-09T00:20:05.939427+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:20:05.939427+0000","last_undegraded":"2024-05-09T00:20:05.939427+0000","last_fullsized":"2024-05-09T00:20:05.939427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2152331,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":38,"num_write":171,"num_write_kb":2182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"38'3176","reported_seq":3240,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.578160+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:19:53.578160+0000","last_peered":"2024-05-09T00:19:53.578160+0000","last_clean":"2024-05-09T00:19:53.578160+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:19:53.578160+0000","last_undegraded":"2024-05-09T00:19:53.578160+0000","last_fullsized":"2024-05-09T00:19:53.578160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3176,"log_dups_size":0,"ondisk_log_size":3176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:47.362570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":47105,"num_write_kb":619272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"38'3217","reported_seq":3281,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.109658+0000","last_change":"2024-05-09T00:20:11.109724+0000","last_active":"2024-05-09T00:20:11.109658+0000","last_peered":"2024-05-09T00:20:11.109658+0000","last_clean":"2024-05-09T00:20:11.109658+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:20:11.109658+0000","last_undegraded":"2024-05-09T00:20:11.109658+0000","last_fullsized":"2024-05-09T00:20:11.109658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3217","last_scrub_stamp":"2024-05-09T00:20:11.109393+0000","last_deep_scrub":"38'3217","last_deep_scrub_stamp":"2024-05-09T00:20:11.109393+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.109393+0000","objects_scrubbed":0,"log_size":3217,"log_dups_size":0,"ondisk_log_size":3217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:04.651233+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":47564,"num_write_kb":594884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"38'18","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.019395+0000","last_change":"2024-05-09T00:08:44.105565+0000","last_active":"2024-05-09T00:19:56.019395+0000","last_peered":"2024-05-09T00:19:56.019395+0000","last_clean":"2024-05-09T00:19:56.019395+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:19:56.019395+0000","last_undegraded":"2024-05-09T00:19:56.019395+0000","last_fullsized":"2024-05-09T00:19:56.019395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:04.742914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"38'246","reported_seq":299,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.619084+0000","last_change":"2024-05-09T00:08:54.221472+0000","last_active":"2024-05-09T00:19:53.619084+0000","last_peered":"2024-05-09T00:19:53.619084+0000","last_clean":"2024-05-09T00:19:53.619084+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:19:53.619084+0000","last_undegraded":"2024-05-09T00:19:53.619084+0000","last_fullsized":"2024-05-09T00:19:53.619084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.316032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":16394,"num_write":232,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"38'3503","reported_seq":3562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:55.881780+0000","last_change":"2024-05-09T00:08:55.232010+0000","last_active":"2024-05-09T00:19:55.881780+0000","last_peered":"2024-05-09T00:19:55.881780+0000","last_clean":"2024-05-09T00:19:55.881780+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:19:55.881780+0000","last_undegraded":"2024-05-09T00:19:55.881780+0000","last_fullsized":"2024-05-09T00:19:55.881780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":51910,"num_write_kb":640187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"38'3580","reported_seq":3635,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:08.358531+0000","last_change":"2024-05-09T00:08:45.100735+0000","last_active":"2024-05-09T00:20:08.358531+0000","last_peered":"2024-05-09T00:20:08.358531+0000","last_clean":"2024-05-09T00:20:08.358531+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:20:08.358531+0000","last_undegraded":"2024-05-09T00:20:08.358531+0000","last_fullsized":"2024-05-09T00:20:08.358531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3580,"log_dups_size":0,"ondisk_log_size":3580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":53064,"num_write_kb":670486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"38'20","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.725266+0000","last_change":"2024-05-09T00:08:44.101399+0000","last_active":"2024-05-09T00:20:11.725266+0000","last_peered":"2024-05-09T00:20:11.725266+0000","last_clean":"2024-05-09T00:20:11.725266+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:20:11.725266+0000","last_undegraded":"2024-05-09T00:20:11.725266+0000","last_fullsized":"2024-05-09T00:20:11.725266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":16,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"38'22","reported_seq":67,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.567706+0000","last_change":"2024-05-09T00:08:54.207196+0000","last_active":"2024-05-09T00:19:53.567706+0000","last_peered":"2024-05-09T00:19:53.567706+0000","last_clean":"2024-05-09T00:19:53.567706+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:19:53.567706+0000","last_undegraded":"2024-05-09T00:19:53.567706+0000","last_fullsized":"2024-05-09T00:19:53.567706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:24.933918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":17,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"38'3625","reported_seq":3683,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.482782+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:19:53.482782+0000","last_peered":"2024-05-09T00:19:53.482782+0000","last_clean":"2024-05-09T00:19:53.482782+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:19:53.482782+0000","last_undegraded":"2024-05-09T00:19:53.482782+0000","last_fullsized":"2024-05-09T00:19:53.482782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53630,"num_write_kb":693205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"38'2900","reported_seq":2957,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:06.158921+0000","last_change":"2024-05-09T00:08:45.111788+0000","last_active":"2024-05-09T00:20:06.158921+0000","last_peered":"2024-05-09T00:20:06.158921+0000","last_clean":"2024-05-09T00:20:06.158921+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:20:06.158921+0000","last_undegraded":"2024-05-09T00:20:06.158921+0000","last_fullsized":"2024-05-09T00:20:06.158921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2900,"log_dups_size":0,"ondisk_log_size":2900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42993,"num_write_kb":541677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"38'138","reported_seq":196,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.079883+0000","last_change":"2024-05-09T00:08:44.101744+0000","last_active":"2024-05-09T00:20:04.079883+0000","last_peered":"2024-05-09T00:20:04.079883+0000","last_clean":"2024-05-09T00:20:04.079883+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:20:04.079883+0000","last_undegraded":"2024-05-09T00:20:04.079883+0000","last_fullsized":"2024-05-09T00:20:04.079883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":135,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"38'3","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.589685+0000","last_change":"2024-05-09T00:08:54.214217+0000","last_active":"2024-05-09T00:19:53.589685+0000","last_peered":"2024-05-09T00:19:53.589685+0000","last_clean":"2024-05-09T00:19:53.589685+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:19:53.589685+0000","last_undegraded":"2024-05-09T00:19:53.589685+0000","last_fullsized":"2024-05-09T00:19:53.589685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"38'3203","reported_seq":3258,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.632878+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:19:53.632878+0000","last_peered":"2024-05-09T00:19:53.632878+0000","last_clean":"2024-05-09T00:19:53.632878+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:19:53.632878+0000","last_undegraded":"2024-05-09T00:19:53.632878+0000","last_fullsized":"2024-05-09T00:19:53.632878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47433,"num_write_kb":581618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"38'2989","reported_seq":3044,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.086379+0000","last_change":"2024-05-09T00:08:45.116447+0000","last_active":"2024-05-09T00:20:04.086379+0000","last_peered":"2024-05-09T00:20:04.086379+0000","last_clean":"2024-05-09T00:20:04.086379+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:20:04.086379+0000","last_undegraded":"2024-05-09T00:20:04.086379+0000","last_fullsized":"2024-05-09T00:20:04.086379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:12.781551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":44159,"num_write_kb":579264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"38'11","reported_seq":96,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.063100+0000","last_change":"2024-05-09T00:08:44.093432+0000","last_active":"2024-05-09T00:20:04.063100+0000","last_peered":"2024-05-09T00:20:04.063100+0000","last_clean":"2024-05-09T00:20:04.063100+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:20:04.063100+0000","last_undegraded":"2024-05-09T00:20:04.063100+0000","last_fullsized":"2024-05-09T00:20:04.063100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"38'4","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588611+0000","last_change":"2024-05-09T00:08:54.223458+0000","last_active":"2024-05-09T00:19:53.588611+0000","last_peered":"2024-05-09T00:19:53.588611+0000","last_clean":"2024-05-09T00:19:53.588611+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:19:53.588611+0000","last_undegraded":"2024-05-09T00:19:53.588611+0000","last_fullsized":"2024-05-09T00:19:53.588611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:56:02.708952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"38'3658","reported_seq":3715,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.575409+0000","last_change":"2024-05-09T00:08:55.214848+0000","last_active":"2024-05-09T00:19:53.575409+0000","last_peered":"2024-05-09T00:19:53.575409+0000","last_clean":"2024-05-09T00:19:53.575409+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:19:53.575409+0000","last_undegraded":"2024-05-09T00:19:53.575409+0000","last_fullsized":"2024-05-09T00:19:53.575409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:07.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54120,"num_write_kb":669829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"38'3320","reported_seq":3377,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.115076+0000","last_change":"2024-05-09T00:08:45.092241+0000","last_active":"2024-05-09T00:20:04.115076+0000","last_peered":"2024-05-09T00:20:04.115076+0000","last_clean":"2024-05-09T00:20:04.115076+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:20:04.115076+0000","last_undegraded":"2024-05-09T00:20:04.115076+0000","last_fullsized":"2024-05-09T00:20:04.115076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":48969,"num_write_kb":615876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"38'6","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076786+0000","last_change":"2024-05-09T00:08:44.102800+0000","last_active":"2024-05-09T00:20:04.076786+0000","last_peered":"2024-05-09T00:20:04.076786+0000","last_clean":"2024-05-09T00:20:04.076786+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:20:04.076786+0000","last_undegraded":"2024-05-09T00:20:04.076786+0000","last_fullsized":"2024-05-09T00:20:04.076786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"38'3","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:45.156335+0000","last_change":"2024-05-09T00:08:54.213263+0000","last_active":"2024-05-09T00:19:45.156335+0000","last_peered":"2024-05-09T00:19:45.156335+0000","last_clean":"2024-05-09T00:19:45.156335+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:19:45.156335+0000","last_undegraded":"2024-05-09T00:19:45.156335+0000","last_fullsized":"2024-05-09T00:19:45.156335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:05.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"38'3403","reported_seq":3462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.514767+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:19:52.514767+0000","last_peered":"2024-05-09T00:19:52.514767+0000","last_clean":"2024-05-09T00:19:52.514767+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:19:52.514767+0000","last_undegraded":"2024-05-09T00:19:52.514767+0000","last_fullsized":"2024-05-09T00:19:52.514767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:45.688566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":50653,"num_write_kb":630818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'3543","reported_seq":3598,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.107694+0000","last_change":"2024-05-09T00:08:45.110136+0000","last_active":"2024-05-09T00:20:04.107694+0000","last_peered":"2024-05-09T00:20:04.107694+0000","last_clean":"2024-05-09T00:20:04.107694+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:20:04.107694+0000","last_undegraded":"2024-05-09T00:20:04.107694+0000","last_fullsized":"2024-05-09T00:20:04.107694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:44.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":52618,"num_write_kb":653340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"38'5","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076899+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:20:04.076899+0000","last_peered":"2024-05-09T00:20:04.076899+0000","last_clean":"2024-05-09T00:20:04.076899+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:20:04.076899+0000","last_undegraded":"2024-05-09T00:20:04.076899+0000","last_fullsized":"2024-05-09T00:20:04.076899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:09.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"38'236","reported_seq":304,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.594685+0000","last_change":"2024-05-09T00:08:54.215228+0000","last_active":"2024-05-09T00:19:53.594685+0000","last_peered":"2024-05-09T00:19:53.594685+0000","last_clean":"2024-05-09T00:19:53.594685+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:19:53.594685+0000","last_undegraded":"2024-05-09T00:19:53.594685+0000","last_fullsized":"2024-05-09T00:19:53.594685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:14.881797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":16430,"num_write":227,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"38'4717","reported_seq":4781,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.648895+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:19:53.648895+0000","last_peered":"2024-05-09T00:19:53.648895+0000","last_clean":"2024-05-09T00:19:53.648895+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:19:53.648895+0000","last_undegraded":"2024-05-09T00:19:53.648895+0000","last_fullsized":"2024-05-09T00:19:53.648895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":69946,"num_write_kb":894340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"38'2901","reported_seq":2957,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.750625+0000","last_change":"2024-05-09T00:08:45.109063+0000","last_active":"2024-05-09T00:20:03.750625+0000","last_peered":"2024-05-09T00:20:03.750625+0000","last_clean":"2024-05-09T00:20:03.750625+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:20:03.750625+0000","last_undegraded":"2024-05-09T00:20:03.750625+0000","last_fullsized":"2024-05-09T00:20:03.750625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":0,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:49.693940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42843,"num_write_kb":549063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"38'199","reported_seq":265,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076872+0000","last_change":"2024-05-09T00:08:44.097654+0000","last_active":"2024-05-09T00:20:04.076872+0000","last_peered":"2024-05-09T00:20:04.076872+0000","last_clean":"2024-05-09T00:20:04.076872+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:20:04.076872+0000","last_undegraded":"2024-05-09T00:20:04.076872+0000","last_fullsized":"2024-05-09T00:20:04.076872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":12336,"num_write":190,"num_write_kb":8288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"38'21","reported_seq":78,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.202285+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:19:56.202285+0000","last_peered":"2024-05-09T00:19:56.202285+0000","last_clean":"2024-05-09T00:19:56.202285+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:19:56.202285+0000","last_undegraded":"2024-05-09T00:19:56.202285+0000","last_fullsized":"2024-05-09T00:19:56.202285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:49.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"38'4177","reported_seq":4235,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645296+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:19:53.645296+0000","last_peered":"2024-05-09T00:19:53.645296+0000","last_clean":"2024-05-09T00:19:53.645296+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:19:53.645296+0000","last_undegraded":"2024-05-09T00:19:53.645296+0000","last_fullsized":"2024-05-09T00:19:53.645296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":61984,"num_write_kb":766120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"38'2855","reported_seq":2908,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.919648+0000","last_change":"2024-05-09T00:08:45.102713+0000","last_active":"2024-05-09T00:20:03.919648+0000","last_peered":"2024-05-09T00:20:03.919648+0000","last_clean":"2024-05-09T00:20:03.919648+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:20:03.919648+0000","last_undegraded":"2024-05-09T00:20:03.919648+0000","last_fullsized":"2024-05-09T00:20:03.919648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":42236,"num_write_kb":541614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"38'240","reported_seq":322,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:06.534029+0000","last_change":"2024-05-09T00:08:44.101407+0000","last_active":"2024-05-09T00:20:06.534029+0000","last_peered":"2024-05-09T00:20:06.534029+0000","last_clean":"2024-05-09T00:20:06.534029+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:20:06.534029+0000","last_undegraded":"2024-05-09T00:20:06.534029+0000","last_fullsized":"2024-05-09T00:20:06.534029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":55,"num_read_kb":20534,"num_write":232,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"38'5","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.648338+0000","last_change":"2024-05-09T00:08:54.224496+0000","last_active":"2024-05-09T00:19:53.648338+0000","last_peered":"2024-05-09T00:19:53.648338+0000","last_clean":"2024-05-09T00:19:53.648338+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:19:53.648338+0000","last_undegraded":"2024-05-09T00:19:53.648338+0000","last_fullsized":"2024-05-09T00:19:53.648338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"38'3435","reported_seq":3490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.349109+0000","last_change":"2024-05-09T00:08:55.208544+0000","last_active":"2024-05-09T00:19:53.349109+0000","last_peered":"2024-05-09T00:19:53.349109+0000","last_clean":"2024-05-09T00:19:53.349109+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:19:53.349109+0000","last_undegraded":"2024-05-09T00:19:53.349109+0000","last_fullsized":"2024-05-09T00:19:53.349109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:02.650492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":50796,"num_write_kb":644347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"38'4141","reported_seq":4195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.019685+0000","last_change":"2024-05-09T00:08:45.119248+0000","last_active":"2024-05-09T00:20:04.019685+0000","last_peered":"2024-05-09T00:20:04.019685+0000","last_clean":"2024-05-09T00:20:04.019685+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:20:04.019685+0000","last_undegraded":"2024-05-09T00:20:04.019685+0000","last_fullsized":"2024-05-09T00:20:04.019685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":4141,"log_dups_size":0,"ondisk_log_size":4141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:23.797069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":61445,"num_write_kb":763576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"38'22","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.069399+0000","last_change":"2024-05-09T00:08:44.103238+0000","last_active":"2024-05-09T00:20:04.069399+0000","last_peered":"2024-05-09T00:20:04.069399+0000","last_clean":"2024-05-09T00:20:04.069399+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:20:04.069399+0000","last_undegraded":"2024-05-09T00:20:04.069399+0000","last_fullsized":"2024-05-09T00:20:04.069399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:19.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"38'47","reported_seq":105,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627951+0000","last_change":"2024-05-09T00:08:54.218223+0000","last_active":"2024-05-09T00:19:53.627951+0000","last_peered":"2024-05-09T00:19:53.627951+0000","last_clean":"2024-05-09T00:19:53.627951+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:19:53.627951+0000","last_undegraded":"2024-05-09T00:19:53.627951+0000","last_fullsized":"2024-05-09T00:19:53.627951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20520,"num_write":39,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"38'3630","reported_seq":3687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.617924+0000","last_change":"2024-05-09T00:08:55.212896+0000","last_active":"2024-05-09T00:19:53.617924+0000","last_peered":"2024-05-09T00:19:53.617924+0000","last_clean":"2024-05-09T00:19:53.617924+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:19:53.617924+0000","last_undegraded":"2024-05-09T00:19:53.617924+0000","last_fullsized":"2024-05-09T00:19:53.617924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:00.630635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53585,"num_write_kb":685544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"38'2753","reported_seq":2810,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.084473+0000","last_change":"2024-05-09T00:08:45.107438+0000","last_active":"2024-05-09T00:20:04.084473+0000","last_peered":"2024-05-09T00:20:04.084473+0000","last_clean":"2024-05-09T00:20:04.084473+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:20:04.084473+0000","last_undegraded":"2024-05-09T00:20:04.084473+0000","last_fullsized":"2024-05-09T00:20:04.084473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:25.776834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":40582,"num_write_kb":508970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"38'3","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.072844+0000","last_change":"2024-05-09T00:08:44.096795+0000","last_active":"2024-05-09T00:20:04.072844+0000","last_peered":"2024-05-09T00:20:04.072844+0000","last_clean":"2024-05-09T00:20:04.072844+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:20:04.072844+0000","last_undegraded":"2024-05-09T00:20:04.072844+0000","last_fullsized":"2024-05-09T00:20:04.072844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"38'12","reported_seq":82,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.591220+0000","last_change":"2024-05-09T00:08:54.222982+0000","last_active":"2024-05-09T00:19:53.591220+0000","last_peered":"2024-05-09T00:19:53.591220+0000","last_clean":"2024-05-09T00:19:53.591220+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:19:53.591220+0000","last_undegraded":"2024-05-09T00:19:53.591220+0000","last_fullsized":"2024-05-09T00:19:53.591220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.341034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"38'3942","reported_seq":4003,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644626+0000","last_change":"2024-05-09T00:08:55.207614+0000","last_active":"2024-05-09T00:19:53.644626+0000","last_peered":"2024-05-09T00:19:53.644626+0000","last_clean":"2024-05-09T00:19:53.644626+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:19:53.644626+0000","last_undegraded":"2024-05-09T00:19:53.644626+0000","last_fullsized":"2024-05-09T00:19:53.644626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":58547,"num_write_kb":727316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"38'3075","reported_seq":3133,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.098971+0000","last_change":"2024-05-09T00:08:45.111546+0000","last_active":"2024-05-09T00:20:04.098971+0000","last_peered":"2024-05-09T00:20:04.098971+0000","last_clean":"2024-05-09T00:20:04.098971+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:20:04.098971+0000","last_undegraded":"2024-05-09T00:20:04.098971+0000","last_fullsized":"2024-05-09T00:20:04.098971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":45259,"num_write_kb":566177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"38'3","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.767654+0000","last_change":"2024-05-09T00:20:10.767719+0000","last_active":"2024-05-09T00:20:10.767654+0000","last_peered":"2024-05-09T00:20:10.767654+0000","last_clean":"2024-05-09T00:20:10.767654+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:20:10.767654+0000","last_undegraded":"2024-05-09T00:20:10.767654+0000","last_fullsized":"2024-05-09T00:20:10.767654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:10.767407+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:10.767407+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.767407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:35.434460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"38'6","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.610497+0000","last_change":"2024-05-09T00:08:54.217198+0000","last_active":"2024-05-09T00:19:53.610497+0000","last_peered":"2024-05-09T00:19:53.610497+0000","last_clean":"2024-05-09T00:19:53.610497+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:19:53.610497+0000","last_undegraded":"2024-05-09T00:19:53.610497+0000","last_fullsized":"2024-05-09T00:19:53.610497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4386","reported_seq":4444,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.640050+0000","last_change":"2024-05-09T00:08:55.213509+0000","last_active":"2024-05-09T00:19:53.640050+0000","last_peered":"2024-05-09T00:19:53.640050+0000","last_clean":"2024-05-09T00:19:53.640050+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:19:53.640050+0000","last_undegraded":"2024-05-09T00:19:53.640050+0000","last_fullsized":"2024-05-09T00:19:53.640050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4386,"log_dups_size":0,"ondisk_log_size":4386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":64971,"num_write_kb":841081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"38'49","reported_seq":96,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627315+0000","last_change":"2024-05-09T00:08:54.220540+0000","last_active":"2024-05-09T00:19:53.627315+0000","last_peered":"2024-05-09T00:19:53.627315+0000","last_clean":"2024-05-09T00:19:53.627315+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:19:53.627315+0000","last_undegraded":"2024-05-09T00:19:53.627315+0000","last_fullsized":"2024-05-09T00:19:53.627315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":42,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"38'3567","reported_seq":3624,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.105792+0000","last_change":"2024-05-09T00:08:45.088273+0000","last_active":"2024-05-09T00:20:04.105792+0000","last_peered":"2024-05-09T00:20:04.105792+0000","last_clean":"2024-05-09T00:20:04.105792+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:20:04.105792+0000","last_undegraded":"2024-05-09T00:20:04.105792+0000","last_fullsized":"2024-05-09T00:20:04.105792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":52856,"num_write_kb":662790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"38'41","reported_seq":94,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.980492+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:20:03.980492+0000","last_peered":"2024-05-09T00:20:03.980492+0000","last_clean":"2024-05-09T00:20:03.980492+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:20:03.980492+0000","last_undegraded":"2024-05-09T00:20:03.980492+0000","last_fullsized":"2024-05-09T00:20:03.980492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:38.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":37,"num_write_kb":8217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3892","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.486914+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:19:53.486914+0000","last_peered":"2024-05-09T00:19:53.486914+0000","last_clean":"2024-05-09T00:19:53.486914+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:19:53.486914+0000","last_undegraded":"2024-05-09T00:19:53.486914+0000","last_fullsized":"2024-05-09T00:19:53.486914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:55.735187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":57751,"num_write_kb":734560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"30'34","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:02.237009+0000","last_change":"2024-05-09T00:08:54.213346+0000","last_active":"2024-05-09T00:19:02.237009+0000","last_peered":"2024-05-09T00:19:02.237009+0000","last_clean":"2024-05-09T00:19:02.237009+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:19:02.237009+0000","last_undegraded":"2024-05-09T00:19:02.237009+0000","last_fullsized":"2024-05-09T00:19:02.237009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:22.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":16404,"num_write":31,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2980","reported_seq":3035,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.087607+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:20:04.087607+0000","last_peered":"2024-05-09T00:20:04.087607+0000","last_clean":"2024-05-09T00:20:04.087607+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:20:04.087607+0000","last_undegraded":"2024-05-09T00:20:04.087607+0000","last_fullsized":"2024-05-09T00:20:04.087607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:32.004559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":43962,"num_write_kb":568639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"38'4","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:54.452043+0000","last_change":"2024-05-09T00:08:44.098396+0000","last_active":"2024-05-09T00:18:54.452043+0000","last_peered":"2024-05-09T00:18:54.452043+0000","last_clean":"2024-05-09T00:18:54.452043+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:18:54.452043+0000","last_undegraded":"2024-05-09T00:18:54.452043+0000","last_fullsized":"2024-05-09T00:18:54.452043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:30.686153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"38'4410","reported_seq":4473,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.640160+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:19:53.640160+0000","last_peered":"2024-05-09T00:19:53.640160+0000","last_clean":"2024-05-09T00:19:53.640160+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:19:53.640160+0000","last_undegraded":"2024-05-09T00:19:53.640160+0000","last_fullsized":"2024-05-09T00:19:53.640160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":65571,"num_write_kb":822347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"38'31","reported_seq":84,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.067752+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:20:04.067752+0000","last_peered":"2024-05-09T00:20:04.067752+0000","last_clean":"2024-05-09T00:20:04.067752+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:20:04.067752+0000","last_undegraded":"2024-05-09T00:20:04.067752+0000","last_fullsized":"2024-05-09T00:20:04.067752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:54:12.401277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2411","reported_seq":2462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.089164+0000","last_change":"2024-05-09T00:08:45.105883+0000","last_active":"2024-05-09T00:20:04.089164+0000","last_peered":"2024-05-09T00:20:04.089164+0000","last_clean":"2024-05-09T00:20:04.089164+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:20:04.089164+0000","last_undegraded":"2024-05-09T00:20:04.089164+0000","last_fullsized":"2024-05-09T00:20:04.089164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2411,"log_dups_size":0,"ondisk_log_size":2411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":35584,"num_write_kb":447799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"38'20","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615942+0000","last_change":"2024-05-09T00:08:54.221677+0000","last_active":"2024-05-09T00:19:53.615942+0000","last_peered":"2024-05-09T00:19:53.615942+0000","last_clean":"2024-05-09T00:19:53.615942+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:19:53.615942+0000","last_undegraded":"2024-05-09T00:19:53.615942+0000","last_fullsized":"2024-05-09T00:19:53.615942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2608","reported_seq":2665,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.648744+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:19:53.648744+0000","last_peered":"2024-05-09T00:19:53.648744+0000","last_clean":"2024-05-09T00:19:53.648744+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:19:53.648744+0000","last_undegraded":"2024-05-09T00:19:53.648744+0000","last_fullsized":"2024-05-09T00:19:53.648744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2608,"log_dups_size":0,"ondisk_log_size":2608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":38767,"num_write_kb":481995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"38'1147","reported_seq":1202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:18:44.387115+0000","last_change":"2024-05-09T00:08:44.106795+0000","last_active":"2024-05-09T00:18:44.387115+0000","last_peered":"2024-05-09T00:18:44.387115+0000","last_clean":"2024-05-09T00:18:44.387115+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:18:44.387115+0000","last_undegraded":"2024-05-09T00:18:44.387115+0000","last_fullsized":"2024-05-09T00:18:44.387115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:06.163855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1144,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2597","reported_seq":2649,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.102064+0000","last_change":"2024-05-09T00:08:45.093092+0000","last_active":"2024-05-09T00:20:04.102064+0000","last_peered":"2024-05-09T00:20:04.102064+0000","last_clean":"2024-05-09T00:20:04.102064+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:20:04.102064+0000","last_undegraded":"2024-05-09T00:20:04.102064+0000","last_fullsized":"2024-05-09T00:20:04.102064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2597,"log_dups_size":0,"ondisk_log_size":2597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":38330,"num_write_kb":482954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"38'91","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.576346+0000","last_change":"2024-05-09T00:08:54.226773+0000","last_active":"2024-05-09T00:19:53.576346+0000","last_peered":"2024-05-09T00:19:53.576346+0000","last_clean":"2024-05-09T00:19:53.576346+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:19:53.576346+0000","last_undegraded":"2024-05-09T00:19:53.576346+0000","last_fullsized":"2024-05-09T00:19:53.576346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:55.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":30171,"num_write":78,"num_write_kb":12339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"38'3350","reported_seq":3396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.588764+0000","last_change":"2024-05-09T00:09:31.619347+0000","last_active":"2024-05-09T00:19:53.588764+0000","last_peered":"2024-05-09T00:19:53.588764+0000","last_clean":"2024-05-09T00:19:53.588764+0000","last_became_active":"2024-05-09T00:09:31.617773+0000","last_became_peered":"2024-05-09T00:09:31.617773+0000","last_unstale":"2024-05-09T00:19:53.588764+0000","last_undegraded":"2024-05-09T00:19:53.588764+0000","last_fullsized":"2024-05-09T00:19:53.588764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:19.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":49731,"num_write_kb":622162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"38'3807","reported_seq":3863,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.089914+0000","last_change":"2024-05-09T00:08:45.104160+0000","last_active":"2024-05-09T00:20:04.089914+0000","last_peered":"2024-05-09T00:20:04.089914+0000","last_clean":"2024-05-09T00:20:04.089914+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:20:04.089914+0000","last_undegraded":"2024-05-09T00:20:04.089914+0000","last_fullsized":"2024-05-09T00:20:04.089914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56537,"num_write_kb":719929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"38'4248","reported_seq":4305,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.774392+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:19:56.774392+0000","last_peered":"2024-05-09T00:19:56.774392+0000","last_clean":"2024-05-09T00:19:56.774392+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:19:56.774392+0000","last_undegraded":"2024-05-09T00:19:56.774392+0000","last_fullsized":"2024-05-09T00:19:56.774392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":62726,"num_write_kb":786275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"38'3362","reported_seq":3413,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.748866+0000","last_change":"2024-05-09T00:08:45.111211+0000","last_active":"2024-05-09T00:20:03.748866+0000","last_peered":"2024-05-09T00:20:03.748866+0000","last_clean":"2024-05-09T00:20:03.748866+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:20:03.748866+0000","last_undegraded":"2024-05-09T00:20:03.748866+0000","last_fullsized":"2024-05-09T00:20:03.748866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.713450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":49795,"num_write_kb":622024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"38'3281","reported_seq":3338,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.648879+0000","last_change":"2024-05-09T00:08:55.209217+0000","last_active":"2024-05-09T00:19:53.648879+0000","last_peered":"2024-05-09T00:19:53.648879+0000","last_clean":"2024-05-09T00:19:53.648879+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:19:53.648879+0000","last_undegraded":"2024-05-09T00:19:53.648879+0000","last_fullsized":"2024-05-09T00:19:53.648879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":48739,"num_write_kb":615858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"38'3810","reported_seq":3863,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.013880+0000","last_change":"2024-05-09T00:08:45.105038+0000","last_active":"2024-05-09T00:20:04.013880+0000","last_peered":"2024-05-09T00:20:04.013880+0000","last_clean":"2024-05-09T00:20:04.013880+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:20:04.013880+0000","last_undegraded":"2024-05-09T00:20:04.013880+0000","last_fullsized":"2024-05-09T00:20:04.013880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3810,"log_dups_size":0,"ondisk_log_size":3810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:08.164675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":56385,"num_write_kb":712291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"38'3855","reported_seq":3921,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.454978+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:19:53.454978+0000","last_peered":"2024-05-09T00:19:53.454978+0000","last_clean":"2024-05-09T00:19:53.454978+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:19:53.454978+0000","last_undegraded":"2024-05-09T00:19:53.454978+0000","last_fullsized":"2024-05-09T00:19:53.454978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:32.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":57187,"num_write_kb":738779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"38'2596","reported_seq":2651,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.065981+0000","last_change":"2024-05-09T00:08:45.096022+0000","last_active":"2024-05-09T00:20:04.065981+0000","last_peered":"2024-05-09T00:20:04.065981+0000","last_clean":"2024-05-09T00:20:04.065981+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:20:04.065981+0000","last_undegraded":"2024-05-09T00:20:04.065981+0000","last_fullsized":"2024-05-09T00:20:04.065981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2596,"log_dups_size":0,"ondisk_log_size":2596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:04.234608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":38426,"num_write_kb":503771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"38'4370","reported_seq":4437,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644706+0000","last_change":"2024-05-09T00:08:55.240494+0000","last_active":"2024-05-09T00:19:53.644706+0000","last_peered":"2024-05-09T00:19:53.644706+0000","last_clean":"2024-05-09T00:19:53.644706+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:19:53.644706+0000","last_undegraded":"2024-05-09T00:19:53.644706+0000","last_fullsized":"2024-05-09T00:19:53.644706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":64728,"num_write_kb":825535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"38'2760","reported_seq":2812,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.038540+0000","last_change":"2024-05-09T00:08:45.117086+0000","last_active":"2024-05-09T00:20:04.038540+0000","last_peered":"2024-05-09T00:20:04.038540+0000","last_clean":"2024-05-09T00:20:04.038540+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:20:04.038540+0000","last_undegraded":"2024-05-09T00:20:04.038540+0000","last_fullsized":"2024-05-09T00:20:04.038540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2760,"log_dups_size":0,"ondisk_log_size":2760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:54.130886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40728,"num_write_kb":512798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"38'3218","reported_seq":3282,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.602967+0000","last_change":"2024-05-09T00:09:31.551214+0000","last_active":"2024-05-09T00:19:53.602967+0000","last_peered":"2024-05-09T00:19:53.602967+0000","last_clean":"2024-05-09T00:19:53.602967+0000","last_became_active":"2024-05-09T00:09:31.550552+0000","last_became_peered":"2024-05-09T00:09:31.550552+0000","last_unstale":"2024-05-09T00:19:53.602967+0000","last_undegraded":"2024-05-09T00:19:53.602967+0000","last_fullsized":"2024-05-09T00:19:53.602967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":47610,"num_write_kb":596071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"38'3281","reported_seq":3332,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.920229+0000","last_change":"2024-05-09T00:08:45.102997+0000","last_active":"2024-05-09T00:20:03.920229+0000","last_peered":"2024-05-09T00:20:03.920229+0000","last_clean":"2024-05-09T00:20:03.920229+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:20:03.920229+0000","last_undegraded":"2024-05-09T00:20:03.920229+0000","last_fullsized":"2024-05-09T00:20:03.920229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:25.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":48628,"num_write_kb":610539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"38'4466","reported_seq":4526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.613481+0000","last_change":"2024-05-09T00:08:55.215328+0000","last_active":"2024-05-09T00:19:53.613481+0000","last_peered":"2024-05-09T00:19:53.613481+0000","last_clean":"2024-05-09T00:19:53.613481+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:19:53.613481+0000","last_undegraded":"2024-05-09T00:19:53.613481+0000","last_fullsized":"2024-05-09T00:19:53.613481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:33.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":66102,"num_write_kb":855861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"38'2915","reported_seq":2968,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.110352+0000","last_change":"2024-05-09T00:08:45.113675+0000","last_active":"2024-05-09T00:20:04.110352+0000","last_peered":"2024-05-09T00:20:04.110352+0000","last_clean":"2024-05-09T00:20:04.110352+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:20:04.110352+0000","last_undegraded":"2024-05-09T00:20:04.110352+0000","last_fullsized":"2024-05-09T00:20:04.110352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":43083,"num_write_kb":548362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"38'3894","reported_seq":3954,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.504183+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:19:53.504183+0000","last_peered":"2024-05-09T00:19:53.504183+0000","last_clean":"2024-05-09T00:19:53.504183+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:19:53.504183+0000","last_undegraded":"2024-05-09T00:19:53.504183+0000","last_fullsized":"2024-05-09T00:19:53.504183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":57917,"num_write_kb":734296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"38'3613","reported_seq":3669,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076365+0000","last_change":"2024-05-09T00:08:45.100057+0000","last_active":"2024-05-09T00:20:04.076365+0000","last_peered":"2024-05-09T00:20:04.076365+0000","last_clean":"2024-05-09T00:20:04.076365+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:20:04.076365+0000","last_undegraded":"2024-05-09T00:20:04.076365+0000","last_fullsized":"2024-05-09T00:20:04.076365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:19.963974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":53572,"num_write_kb":689167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"38'3075","reported_seq":3129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627461+0000","last_change":"2024-05-09T00:08:55.227974+0000","last_active":"2024-05-09T00:19:53.627461+0000","last_peered":"2024-05-09T00:19:53.627461+0000","last_clean":"2024-05-09T00:19:53.627461+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:19:53.627461+0000","last_undegraded":"2024-05-09T00:19:53.627461+0000","last_fullsized":"2024-05-09T00:19:53.627461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:42.080181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45134,"num_write_kb":543879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"38'2785","reported_seq":2837,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.107685+0000","last_change":"2024-05-09T00:08:45.104269+0000","last_active":"2024-05-09T00:20:04.107685+0000","last_peered":"2024-05-09T00:20:04.107685+0000","last_clean":"2024-05-09T00:20:04.107685+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:20:04.107685+0000","last_undegraded":"2024-05-09T00:20:04.107685+0000","last_fullsized":"2024-05-09T00:20:04.107685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2785,"log_dups_size":0,"ondisk_log_size":2785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:39.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":41154,"num_write_kb":511430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"38'4375","reported_seq":4436,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.541127+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:19:53.541127+0000","last_peered":"2024-05-09T00:19:53.541127+0000","last_clean":"2024-05-09T00:19:53.541127+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:19:53.541127+0000","last_undegraded":"2024-05-09T00:19:53.541127+0000","last_fullsized":"2024-05-09T00:19:53.541127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:08.076208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":64891,"num_write_kb":820909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"38'3014","reported_seq":3068,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.735585+0000","last_change":"2024-05-09T00:08:45.112003+0000","last_active":"2024-05-09T00:20:03.735585+0000","last_peered":"2024-05-09T00:20:03.735585+0000","last_clean":"2024-05-09T00:20:03.735585+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:20:03.735585+0000","last_undegraded":"2024-05-09T00:20:03.735585+0000","last_fullsized":"2024-05-09T00:20:03.735585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:35.749498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44654,"num_write_kb":570209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"38'3563","reported_seq":3621,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.600582+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:19:53.600582+0000","last_peered":"2024-05-09T00:19:53.600582+0000","last_clean":"2024-05-09T00:19:53.600582+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:19:53.600582+0000","last_undegraded":"2024-05-09T00:19:53.600582+0000","last_fullsized":"2024-05-09T00:19:53.600582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":52470,"num_write_kb":678263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"38'3369","reported_seq":3423,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.116638+0000","last_change":"2024-05-09T00:08:45.098199+0000","last_active":"2024-05-09T00:20:04.116638+0000","last_peered":"2024-05-09T00:20:04.116638+0000","last_clean":"2024-05-09T00:20:04.116638+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:20:04.116638+0000","last_undegraded":"2024-05-09T00:20:04.116638+0000","last_fullsized":"2024-05-09T00:20:04.116638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":49853,"num_write_kb":630819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"38'3672","reported_seq":3731,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627538+0000","last_change":"2024-05-09T00:08:55.225830+0000","last_active":"2024-05-09T00:19:53.627538+0000","last_peered":"2024-05-09T00:19:53.627538+0000","last_clean":"2024-05-09T00:19:53.627538+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:19:53.627538+0000","last_undegraded":"2024-05-09T00:19:53.627538+0000","last_fullsized":"2024-05-09T00:19:53.627538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:23.657406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":54179,"num_write_kb":674825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"38'3222","reported_seq":3282,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.106899+0000","last_change":"2024-05-09T00:08:45.100396+0000","last_active":"2024-05-09T00:20:04.106899+0000","last_peered":"2024-05-09T00:20:04.106899+0000","last_clean":"2024-05-09T00:20:04.106899+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:20:04.106899+0000","last_undegraded":"2024-05-09T00:20:04.106899+0000","last_fullsized":"2024-05-09T00:20:04.106899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3222,"log_dups_size":0,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":47611,"num_write_kb":602581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"38'3892","reported_seq":3954,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.051273+0000","last_change":"2024-05-09T00:09:31.545900+0000","last_active":"2024-05-09T00:20:10.051273+0000","last_peered":"2024-05-09T00:20:10.051273+0000","last_clean":"2024-05-09T00:20:10.051273+0000","last_became_active":"2024-05-09T00:09:31.545211+0000","last_became_peered":"2024-05-09T00:09:31.545211+0000","last_unstale":"2024-05-09T00:20:10.051273+0000","last_undegraded":"2024-05-09T00:20:10.051273+0000","last_fullsized":"2024-05-09T00:20:10.051273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":57743,"num_write_kb":746959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"38'3008","reported_seq":3069,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.112345+0000","last_change":"2024-05-09T00:20:10.112378+0000","last_active":"2024-05-09T00:20:10.112345+0000","last_peered":"2024-05-09T00:20:10.112345+0000","last_clean":"2024-05-09T00:20:10.112345+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:20:10.112345+0000","last_undegraded":"2024-05-09T00:20:10.112345+0000","last_fullsized":"2024-05-09T00:20:10.112345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3008","last_scrub_stamp":"2024-05-09T00:20:10.112226+0000","last_deep_scrub":"38'3008","last_deep_scrub_stamp":"2024-05-09T00:20:10.112226+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.112226+0000","objects_scrubbed":0,"log_size":3008,"log_dups_size":0,"ondisk_log_size":3008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:04.325861+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":44592,"num_write_kb":561827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"38'3782","reported_seq":3842,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645229+0000","last_change":"2024-05-09T00:08:55.230997+0000","last_active":"2024-05-09T00:19:53.645229+0000","last_peered":"2024-05-09T00:19:53.645229+0000","last_clean":"2024-05-09T00:19:53.645229+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:19:53.645229+0000","last_undegraded":"2024-05-09T00:19:53.645229+0000","last_fullsized":"2024-05-09T00:19:53.645229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3782,"log_dups_size":0,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":56061,"num_write_kb":704361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"38'3143","reported_seq":3195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.113876+0000","last_change":"2024-05-09T00:08:45.098203+0000","last_active":"2024-05-09T00:20:04.113876+0000","last_peered":"2024-05-09T00:20:04.113876+0000","last_clean":"2024-05-09T00:20:04.113876+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:20:04.113876+0000","last_undegraded":"2024-05-09T00:20:04.113876+0000","last_fullsized":"2024-05-09T00:20:04.113876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3143,"log_dups_size":0,"ondisk_log_size":3143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":46620,"num_write_kb":572561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"38'3200","reported_seq":3256,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.156143+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:19:56.156143+0000","last_peered":"2024-05-09T00:19:56.156143+0000","last_clean":"2024-05-09T00:19:56.156143+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:19:56.156143+0000","last_undegraded":"2024-05-09T00:19:56.156143+0000","last_fullsized":"2024-05-09T00:19:56.156143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47638,"num_write_kb":598134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"38'2549","reported_seq":2609,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.084481+0000","last_change":"2024-05-09T00:08:45.114319+0000","last_active":"2024-05-09T00:20:04.084481+0000","last_peered":"2024-05-09T00:20:04.084481+0000","last_clean":"2024-05-09T00:20:04.084481+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:20:04.084481+0000","last_undegraded":"2024-05-09T00:20:04.084481+0000","last_fullsized":"2024-05-09T00:20:04.084481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2549,"log_dups_size":0,"ondisk_log_size":2549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:22.775022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":37364,"num_write_kb":466647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"38'3628","reported_seq":3686,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.647404+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:19:53.647404+0000","last_peered":"2024-05-09T00:19:53.647404+0000","last_clean":"2024-05-09T00:19:53.647404+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:19:53.647404+0000","last_undegraded":"2024-05-09T00:19:53.647404+0000","last_fullsized":"2024-05-09T00:19:53.647404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:38.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53577,"num_write_kb":665989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"38'3771","reported_seq":3827,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.021164+0000","last_change":"2024-05-09T00:09:31.551757+0000","last_active":"2024-05-09T00:20:04.021164+0000","last_peered":"2024-05-09T00:20:04.021164+0000","last_clean":"2024-05-09T00:20:04.021164+0000","last_became_active":"2024-05-09T00:09:31.551042+0000","last_became_peered":"2024-05-09T00:09:31.551042+0000","last_unstale":"2024-05-09T00:20:04.021164+0000","last_undegraded":"2024-05-09T00:20:04.021164+0000","last_fullsized":"2024-05-09T00:20:04.021164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3771,"log_dups_size":0,"ondisk_log_size":3771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:57.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":55729,"num_write_kb":713868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"38'4117","reported_seq":4178,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.587157+0000","last_change":"2024-05-09T00:08:55.225965+0000","last_active":"2024-05-09T00:19:53.587157+0000","last_peered":"2024-05-09T00:19:53.587157+0000","last_clean":"2024-05-09T00:19:53.587157+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:19:53.587157+0000","last_undegraded":"2024-05-09T00:19:53.587157+0000","last_fullsized":"2024-05-09T00:19:53.587157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":60808,"num_write_kb":797910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"38'2692","reported_seq":2744,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.037872+0000","last_change":"2024-05-09T00:08:45.112848+0000","last_active":"2024-05-09T00:20:04.037872+0000","last_peered":"2024-05-09T00:20:04.037872+0000","last_clean":"2024-05-09T00:20:04.037872+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:20:04.037872+0000","last_undegraded":"2024-05-09T00:20:04.037872+0000","last_fullsized":"2024-05-09T00:20:04.037872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2692,"log_dups_size":0,"ondisk_log_size":2692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":39850,"num_write_kb":524211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"38'4344","reported_seq":4408,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.646677+0000","last_change":"2024-05-09T00:08:55.242629+0000","last_active":"2024-05-09T00:19:53.646677+0000","last_peered":"2024-05-09T00:19:53.646677+0000","last_clean":"2024-05-09T00:19:53.646677+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:19:53.646677+0000","last_undegraded":"2024-05-09T00:19:53.646677+0000","last_fullsized":"2024-05-09T00:19:53.646677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":64402,"num_write_kb":850383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"38'3032","reported_seq":3089,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076952+0000","last_change":"2024-05-09T00:08:45.107312+0000","last_active":"2024-05-09T00:20:04.076952+0000","last_peered":"2024-05-09T00:20:04.076952+0000","last_clean":"2024-05-09T00:20:04.076952+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:20:04.076952+0000","last_undegraded":"2024-05-09T00:20:04.076952+0000","last_fullsized":"2024-05-09T00:20:04.076952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3032,"log_dups_size":0,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:38.638015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":44827,"num_write_kb":567733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"38'3034","reported_seq":3092,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.651336+0000","last_change":"2024-05-09T00:08:55.219247+0000","last_active":"2024-05-09T00:19:53.651336+0000","last_peered":"2024-05-09T00:19:53.651336+0000","last_clean":"2024-05-09T00:19:53.651336+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:19:53.651336+0000","last_undegraded":"2024-05-09T00:19:53.651336+0000","last_fullsized":"2024-05-09T00:19:53.651336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":44931,"num_write_kb":564239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"38'2966","reported_seq":3022,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.010821+0000","last_change":"2024-05-09T00:08:45.105791+0000","last_active":"2024-05-09T00:20:04.010821+0000","last_peered":"2024-05-09T00:20:04.010821+0000","last_clean":"2024-05-09T00:20:04.010821+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:20:04.010821+0000","last_undegraded":"2024-05-09T00:20:04.010821+0000","last_fullsized":"2024-05-09T00:20:04.010821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2966,"log_dups_size":0,"ondisk_log_size":2966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:42.854124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":43736,"num_write_kb":568620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"38'3544","reported_seq":3601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.437269+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:19:53.437269+0000","last_peered":"2024-05-09T00:19:53.437269+0000","last_clean":"2024-05-09T00:19:53.437269+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:19:53.437269+0000","last_undegraded":"2024-05-09T00:19:53.437269+0000","last_fullsized":"2024-05-09T00:19:53.437269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:18.527447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":52851,"num_write_kb":659445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"38'2755","reported_seq":2813,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.089370+0000","last_change":"2024-05-09T00:08:45.109091+0000","last_active":"2024-05-09T00:20:04.089370+0000","last_peered":"2024-05-09T00:20:04.089370+0000","last_clean":"2024-05-09T00:20:04.089370+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:20:04.089370+0000","last_undegraded":"2024-05-09T00:20:04.089370+0000","last_fullsized":"2024-05-09T00:20:04.089370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:41.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":40873,"num_write_kb":526996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"38'3706","reported_seq":3770,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644676+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:19:53.644676+0000","last_peered":"2024-05-09T00:19:53.644676+0000","last_clean":"2024-05-09T00:19:53.644676+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:19:53.644676+0000","last_undegraded":"2024-05-09T00:19:53.644676+0000","last_fullsized":"2024-05-09T00:19:53.644676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":54772,"num_write_kb":692736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"38'2556","reported_seq":2611,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.108944+0000","last_change":"2024-05-09T00:08:45.104771+0000","last_active":"2024-05-09T00:20:04.108944+0000","last_peered":"2024-05-09T00:20:04.108944+0000","last_clean":"2024-05-09T00:20:04.108944+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:20:04.108944+0000","last_undegraded":"2024-05-09T00:20:04.108944+0000","last_fullsized":"2024-05-09T00:20:04.108944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2556,"log_dups_size":0,"ondisk_log_size":2556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":37712,"num_write_kb":481655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"38'3255","reported_seq":3315,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.621452+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:19:53.621452+0000","last_peered":"2024-05-09T00:19:53.621452+0000","last_clean":"2024-05-09T00:19:53.621452+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:19:53.621452+0000","last_undegraded":"2024-05-09T00:19:53.621452+0000","last_fullsized":"2024-05-09T00:19:53.621452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:30.002670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":48245,"num_write_kb":626583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"38'2916","reported_seq":2971,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.919941+0000","last_change":"2024-05-09T00:08:45.125754+0000","last_active":"2024-05-09T00:20:03.919941+0000","last_peered":"2024-05-09T00:20:03.919941+0000","last_clean":"2024-05-09T00:20:03.919941+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:20:03.919941+0000","last_undegraded":"2024-05-09T00:20:03.919941+0000","last_fullsized":"2024-05-09T00:20:03.919941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":43226,"num_write_kb":536465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"38'3196","reported_seq":3249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.581376+0000","last_change":"2024-05-09T00:08:55.234207+0000","last_active":"2024-05-09T00:19:53.581376+0000","last_peered":"2024-05-09T00:19:53.581376+0000","last_clean":"2024-05-09T00:19:53.581376+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:19:53.581376+0000","last_undegraded":"2024-05-09T00:19:53.581376+0000","last_fullsized":"2024-05-09T00:19:53.581376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":47414,"num_write_kb":607139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"38'3503","reported_seq":3566,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.107047+0000","last_change":"2024-05-09T00:20:12.107113+0000","last_active":"2024-05-09T00:20:12.107047+0000","last_peered":"2024-05-09T00:20:12.107047+0000","last_clean":"2024-05-09T00:20:12.107047+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:20:12.107047+0000","last_undegraded":"2024-05-09T00:20:12.107047+0000","last_fullsized":"2024-05-09T00:20:12.107047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3503","last_scrub_stamp":"2024-05-09T00:20:12.106895+0000","last_deep_scrub":"38'3503","last_deep_scrub_stamp":"2024-05-09T00:20:12.106895+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.106895+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:44.222985+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":51962,"num_write_kb":660810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"38'3882","reported_seq":3944,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.616266+0000","last_change":"2024-05-09T00:08:55.232623+0000","last_active":"2024-05-09T00:19:53.616266+0000","last_peered":"2024-05-09T00:19:53.616266+0000","last_clean":"2024-05-09T00:19:53.616266+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:19:53.616266+0000","last_undegraded":"2024-05-09T00:19:53.616266+0000","last_fullsized":"2024-05-09T00:19:53.616266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3882,"log_dups_size":0,"ondisk_log_size":3882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":57695,"num_write_kb":692841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"38'3732","reported_seq":3783,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.113557+0000","last_change":"2024-05-09T00:08:45.098787+0000","last_active":"2024-05-09T00:20:04.113557+0000","last_peered":"2024-05-09T00:20:04.113557+0000","last_clean":"2024-05-09T00:20:04.113557+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:20:04.113557+0000","last_undegraded":"2024-05-09T00:20:04.113557+0000","last_fullsized":"2024-05-09T00:20:04.113557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":55072,"num_write_kb":708295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"38'4565","reported_seq":4628,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.629043+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:19:53.629043+0000","last_peered":"2024-05-09T00:19:53.629043+0000","last_clean":"2024-05-09T00:19:53.629043+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:19:53.629043+0000","last_undegraded":"2024-05-09T00:19:53.629043+0000","last_fullsized":"2024-05-09T00:19:53.629043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:43.703496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":67870,"num_write_kb":862032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"38'3274","reported_seq":3328,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.749552+0000","last_change":"2024-05-09T00:08:45.104640+0000","last_active":"2024-05-09T00:20:03.749552+0000","last_peered":"2024-05-09T00:20:03.749552+0000","last_clean":"2024-05-09T00:20:03.749552+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:20:03.749552+0000","last_undegraded":"2024-05-09T00:20:03.749552+0000","last_fullsized":"2024-05-09T00:20:03.749552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:43.266532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":48595,"num_write_kb":613070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"38'3191","reported_seq":3249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.647964+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:19:53.647964+0000","last_peered":"2024-05-09T00:19:53.647964+0000","last_clean":"2024-05-09T00:19:53.647964+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:19:53.647964+0000","last_undegraded":"2024-05-09T00:19:53.647964+0000","last_fullsized":"2024-05-09T00:19:53.647964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3191,"log_dups_size":0,"ondisk_log_size":3191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":47307,"num_write_kb":598779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"38'2895","reported_seq":2951,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.102347+0000","last_change":"2024-05-09T00:08:45.103395+0000","last_active":"2024-05-09T00:20:04.102347+0000","last_peered":"2024-05-09T00:20:04.102347+0000","last_clean":"2024-05-09T00:20:04.102347+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:20:04.102347+0000","last_undegraded":"2024-05-09T00:20:04.102347+0000","last_fullsized":"2024-05-09T00:20:04.102347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2895,"log_dups_size":0,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42980,"num_write_kb":536887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"38'3240","reported_seq":3297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.005810+0000","last_change":"2024-05-09T00:09:31.549449+0000","last_active":"2024-05-09T00:19:52.005810+0000","last_peered":"2024-05-09T00:19:52.005810+0000","last_clean":"2024-05-09T00:19:52.005810+0000","last_became_active":"2024-05-09T00:09:31.548548+0000","last_became_peered":"2024-05-09T00:09:31.548548+0000","last_unstale":"2024-05-09T00:19:52.005810+0000","last_undegraded":"2024-05-09T00:19:52.005810+0000","last_fullsized":"2024-05-09T00:19:52.005810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:51.033109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":48187,"num_write_kb":638325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3a","version":"38'2713","reported_seq":2765,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.084495+0000","last_change":"2024-05-09T00:08:45.113226+0000","last_active":"2024-05-09T00:20:04.084495+0000","last_peered":"2024-05-09T00:20:04.084495+0000","last_clean":"2024-05-09T00:20:04.084495+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:20:04.084495+0000","last_undegraded":"2024-05-09T00:20:04.084495+0000","last_fullsized":"2024-05-09T00:20:04.084495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2713,"log_dups_size":0,"ondisk_log_size":2713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40136,"num_write_kb":502625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"38'3769","reported_seq":3829,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.615217+0000","last_change":"2024-05-09T00:08:55.210805+0000","last_active":"2024-05-09T00:19:53.615217+0000","last_peered":"2024-05-09T00:19:53.615217+0000","last_clean":"2024-05-09T00:19:53.615217+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:19:53.615217+0000","last_undegraded":"2024-05-09T00:19:53.615217+0000","last_fullsized":"2024-05-09T00:19:53.615217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7,"num_write":55645,"num_write_kb":699546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"38'3742","reported_seq":3802,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.112159+0000","last_change":"2024-05-09T00:08:45.103123+0000","last_active":"2024-05-09T00:20:04.112159+0000","last_peered":"2024-05-09T00:20:04.112159+0000","last_clean":"2024-05-09T00:20:04.112159+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:20:04.112159+0000","last_undegraded":"2024-05-09T00:20:04.112159+0000","last_fullsized":"2024-05-09T00:20:04.112159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":55258,"num_write_kb":668332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"38'3188","reported_seq":3243,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.430180+0000","last_change":"2024-05-09T00:08:55.217532+0000","last_active":"2024-05-09T00:19:53.430180+0000","last_peered":"2024-05-09T00:19:53.430180+0000","last_clean":"2024-05-09T00:19:53.430180+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:19:53.430180+0000","last_undegraded":"2024-05-09T00:19:53.430180+0000","last_fullsized":"2024-05-09T00:19:53.430180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:34:56.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":47104,"num_write_kb":589873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"38'2889","reported_seq":2942,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:03.556553+0000","last_change":"2024-05-09T00:08:45.112889+0000","last_active":"2024-05-09T00:20:03.556553+0000","last_peered":"2024-05-09T00:20:03.556553+0000","last_clean":"2024-05-09T00:20:03.556553+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:20:03.556553+0000","last_undegraded":"2024-05-09T00:20:03.556553+0000","last_fullsized":"2024-05-09T00:20:03.556553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":42948,"num_write_kb":549753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"38'4368","reported_seq":4426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645257+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:19:53.645257+0000","last_peered":"2024-05-09T00:19:53.645257+0000","last_clean":"2024-05-09T00:19:53.645257+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:19:53.645257+0000","last_undegraded":"2024-05-09T00:19:53.645257+0000","last_fullsized":"2024-05-09T00:19:53.645257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:39.058271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":64699,"num_write_kb":791644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"38'3241","reported_seq":3293,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.063144+0000","last_change":"2024-05-09T00:08:45.094983+0000","last_active":"2024-05-09T00:20:04.063144+0000","last_peered":"2024-05-09T00:20:04.063144+0000","last_clean":"2024-05-09T00:20:04.063144+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:20:04.063144+0000","last_undegraded":"2024-05-09T00:20:04.063144+0000","last_fullsized":"2024-05-09T00:20:04.063144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:54.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":47841,"num_write_kb":582702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"38'3908","reported_seq":3974,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.533863+0000","last_change":"2024-05-09T00:08:55.200457+0000","last_active":"2024-05-09T00:19:53.533863+0000","last_peered":"2024-05-09T00:19:53.533863+0000","last_clean":"2024-05-09T00:19:53.533863+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:19:53.533863+0000","last_undegraded":"2024-05-09T00:19:53.533863+0000","last_fullsized":"2024-05-09T00:19:53.533863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":58133,"num_write_kb":728914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"38'3816","reported_seq":3871,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.087961+0000","last_change":"2024-05-09T00:08:45.103201+0000","last_active":"2024-05-09T00:20:04.087961+0000","last_peered":"2024-05-09T00:20:04.087961+0000","last_clean":"2024-05-09T00:20:04.087961+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:20:04.087961+0000","last_undegraded":"2024-05-09T00:20:04.087961+0000","last_fullsized":"2024-05-09T00:20:04.087961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3816,"log_dups_size":0,"ondisk_log_size":3816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:22.044206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56666,"num_write_kb":741300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"38'3575","reported_seq":3626,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.650858+0000","last_change":"2024-05-09T00:08:55.214511+0000","last_active":"2024-05-09T00:19:53.650858+0000","last_peered":"2024-05-09T00:19:53.650858+0000","last_clean":"2024-05-09T00:19:53.650858+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:19:53.650858+0000","last_undegraded":"2024-05-09T00:19:53.650858+0000","last_fullsized":"2024-05-09T00:19:53.650858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":52889,"num_write_kb":664811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"38'2753","reported_seq":2808,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.112135+0000","last_change":"2024-05-09T00:08:45.127339+0000","last_active":"2024-05-09T00:20:04.112135+0000","last_peered":"2024-05-09T00:20:04.112135+0000","last_clean":"2024-05-09T00:20:04.112135+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:20:04.112135+0000","last_undegraded":"2024-05-09T00:20:04.112135+0000","last_fullsized":"2024-05-09T00:20:04.112135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40609,"num_write_kb":513099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1156,"num_read_kb":11,"num_write":3472550,"num_write_kb":43957042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234380,"ondisk_log_size":234380,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":94516670,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":449,"num_read_kb":234536,"num_write":3119,"num_write_kb":94508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":189095936,"data_stored":189033340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2969,"ondisk_log_size":2969,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":0,"num_write":2947124,"num_write_kb":37270707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199144,"ondisk_log_size":199144,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93475205,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":515,"num_read_kb":184607,"num_write":3552,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187015168,"data_stored":186950410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3380,"ondisk_log_size":3380,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509581,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407236,"kb_used_data":29180,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93964604,"statfs":{"total":96636764160,"available":96219754496,"internally_reserved":0,"allocated":29880320,"data_stored":29641906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":387119562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":512232,"kb_used_data":34272,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93859608,"statfs":{"total":96636764160,"available":96112238592,"internally_reserved":0,"allocated":35094528,"data_stored":34859623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":489421254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533384,"kb_used_data":55424,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93838456,"statfs":{"total":96636764160,"available":96090578944,"internally_reserved":0,"allocated":56754176,"data_stored":56509593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509576,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":576580,"kb_used_data":72252,"kb_used_omap":1,"kb_used_meta":504318,"kb_avail":93795260,"statfs":{"total":96636764160,"available":96046346240,"internally_reserved":0,"allocated":73986048,"data_stored":73738590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":516422087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509573,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":611836,"kb_used_data":43572,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93760004,"statfs":{"total":96636764160,"available":96010244096,"internally_reserved":0,"allocated":44617728,"data_stored":44377810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509580,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":482412,"kb_used_data":50148,"kb_used_omap":1,"kb_used_meta":432254,"kb_avail":93889428,"statfs":{"total":96636764160,"available":96142774272,"internally_reserved":0,"allocated":51351552,"data_stored":51115708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":442628549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581804,"kb_used_data":37284,"kb_used_omap":1,"kb_used_meta":544510,"kb_avail":93790036,"statfs":{"total":96636764160,"available":96040996864,"internally_reserved":0,"allocated":38178816,"data_stored":37942434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":557578693},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589948,"kb_used_data":49588,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":93781892,"statfs":{"total":96636764160,"available":96032657408,"internally_reserved":0,"allocated":50778112,"data_stored":50527238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37748792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12583584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37749318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30572544,"data_stored":30559267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13693879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12671116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31608832,"data_stored":31600674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35815424,"data_stored":35795720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25166406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:20:14.982 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.982 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.982 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.983 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.984 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.985 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.986 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.987 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.988 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.989 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.989 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.989 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.989 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.990 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.991 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.992 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.993 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.994 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.995 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.996 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.997 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.998 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:14.999 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.000 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.001 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.002 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:15.003 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T00:20:18.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:20:18.705 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:20:35.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:20:35.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.282+0000 7f55c2e00640 1 Processor -- start 2024-05-09T00:20:35.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.282+0000 7f55c2e00640 1 -- start start 2024-05-09T00:20:35.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55bc1566f0 0x7f55bc0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55bc156b00 0x7f55bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f55bc156260 con 0x7f55bc1566f0 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f55bc0ad340 con 0x7f55bc156b00 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc155f10 con 0x7f55bc0aba00 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55bc1566f0 0x7f55bc0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55bc1566f0 0x7f55bc0ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42498/0 (socket says 172.21.15.114:42498) 2024-05-09T00:20:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 -- 172.21.15.114:0/1144008462 learned_addr learned my addr 172.21.15.114:0/1144008462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 -- 172.21.15.114:0/1144008462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 msgr2=0x7f55bc0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 --2- 172.21.15.114:0/1144008462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 -- 172.21.15.114:0/1144008462 >> v2:172.21.15.153:3300/0 conn(0x7f55bc156b00 msgr2=0x7f55bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c2400640 1 --2- 172.21.15.114:0/1144008462 >> v2:172.21.15.153:3300/0 conn(0x7f55bc156b00 0x7f55bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 --2- 172.21.15.114:0/1144008462 >> v2:172.21.15.153:3300/0 conn(0x7f55bc156b00 0x7f55bc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.284+0000 7f55c1000640 1 -- 172.21.15.114:0/1144008462 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc0c4f40 con 0x7f55bc1566f0 2024-05-09T00:20:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.285+0000 7f55c1000640 1 --2- 172.21.15.114:0/1144008462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc0ae820 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0c5dc0 tx=0x7f55b002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0016c283af7d77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.286+0000 7f55bbe00640 1 -- 172.21.15.114:0/1144008462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0037070 con 0x7f55bc1566f0 2024-05-09T00:20:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.286+0000 7f55bbe00640 1 -- 172.21.15.114:0/1144008462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0032440 con 0x7f55bc1566f0 2024-05-09T00:20:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.286+0000 7f55bbe00640 1 -- 172.21.15.114:0/1144008462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0032810 con 0x7f55bc1566f0 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.286+0000 7f55c2e00640 1 -- 172.21.15.114:0/1144008462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 msgr2=0x7f55bc0ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.286+0000 7f55c2e00640 1 --2- 172.21.15.114:0/1144008462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc0ae820 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0c5dc0 tx=0x7f55b002a200 comp rx=0 tx=0).stop 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 -- 172.21.15.114:0/1144008462 shutdown_connections 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 --2- 172.21.15.114:0/1144008462 >> v2:172.21.15.153:3300/0 conn(0x7f55bc156b00 0x7f55bc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 --2- 172.21.15.114:0/1144008462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc0ae820 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 --2- 172.21.15.114:0/1144008462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc0accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 -- 172.21.15.114:0/1144008462 >> 172.21.15.114:0/1144008462 conn(0x7f55bc0c9730 msgr2=0x7f55bc0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 -- 172.21.15.114:0/1144008462 shutdown_connections 2024-05-09T00:20:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.287+0000 7f55c2e00640 1 -- 172.21.15.114:0/1144008462 wait complete. 2024-05-09T00:20:35.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.289+0000 7f55c2e00640 1 Processor -- start 2024-05-09T00:20:35.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.289+0000 7f55c2e00640 1 -- start start 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.290+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc1f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.290+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc156b00 0x7f55bc0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc13e830 con 0x7f55bc1566f0 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c2e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc0c4920 con 0x7f55bc156b00 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c2e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc13e9b0 con 0x7f55bc0aba00 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42514/0 (socket says 172.21.15.114:42514) 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 -- 172.21.15.114:0/26078575 learned_addr learned my addr 172.21.15.114:0/26078575 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 -- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 msgr2=0x7f55bc1f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1a00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc1f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c2400640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc156b00 0x7f55bc0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc1f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 -- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc156b00 msgr2=0x7f55bc0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc156b00 0x7f55bc0c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c1000640 1 -- 172.21.15.114:0/26078575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc159ef0 con 0x7f55bc1566f0 2024-05-09T00:20:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.291+0000 7f55c2400640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc156b00 0x7f55bc0c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.292+0000 7f55c1000640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc139330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000c00 tx=0x7f55b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.292+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0037040 con 0x7f55bc1566f0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.292+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0042070 con 0x7f55bc1566f0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.292+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc15a1d0 con 0x7f55bc1566f0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.292+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0030b90 con 0x7f55bc1566f0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.292+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc1f17d0 con 0x7f55bc1566f0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.293+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc078430 con 0x7f55bc1566f0 2024-05-09T00:20:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.296+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55b003d440 con 0x7f55bc1566f0 2024-05-09T00:20:35.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.297+0000 7f55b9600640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f559c0762d0 0x7f559c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:35.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.297+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f55b00b9470 con 0x7f55bc1566f0 2024-05-09T00:20:35.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.297+0000 7f55c1a00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f559c0762d0 0x7f559c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:35.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.297+0000 7f55c1a00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f559c0762d0 0x7f559c0787e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f55bc074bf0 tx=0x7f55a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:35.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.300+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55b00826d0 con 0x7f55bc1566f0 2024-05-09T00:20:35.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.501+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55bc0c8fb0 con 0x7f559c0762d0 2024-05-09T00:20:35.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.538+0000 7f55b9600640 1 -- 172.21.15.114:0/26078575 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493754 (secure 0 0 0) 0x7f55a800c4f0 con 0x7f559c0762d0 2024-05-09T00:20:35.546 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:35.550 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:20:35.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f559c0762d0 msgr2=0x7f559c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:35.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f559c0762d0 0x7f559c0787e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f55bc074bf0 tx=0x7f55a8008040 comp rx=0 tx=0).stop 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 msgr2=0x7f55bc139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc139330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000c00 tx=0x7f55b00046c0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 shutdown_connections 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f559c0762d0 0x7f559c0787e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55bc156b00 0x7f55bc0c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55bc1566f0 0x7f55bc139330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 --2- 172.21.15.114:0/26078575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55bc0aba00 0x7f55bc1f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.548+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 >> 172.21.15.114:0/26078575 conn(0x7f55bc0c9730 msgr2=0x7f55bc154310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.549+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 shutdown_connections 2024-05-09T00:20:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:35.549+0000 7f55c2e00640 1 -- 172.21.15.114:0/26078575 wait complete. 2024-05-09T00:20:35.583 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-09T00:20:34.649738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":188582243,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":2536,"num_read_kb":419209,"num_write":6426446,"num_write_kb":81417639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440015,"ondisk_log_size":440015,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4295432,"kb_used_data":371720,"kb_used_omap":12,"kb_used_meta":3923635,"kb_avail":750679288,"statfs":{"total":773094113280,"available":768695590912,"internally_reserved":0,"allocated":380641280,"data_stored":378712902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":4017802800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007397"},"pg_stats":[{"pgid":"5.18","version":"38'3510","reported_seq":3578,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.664943+0000","last_change":"2024-05-09T00:20:22.665014+0000","last_active":"2024-05-09T00:20:22.664943+0000","last_peered":"2024-05-09T00:20:22.664943+0000","last_clean":"2024-05-09T00:20:22.664943+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:20:22.664943+0000","last_undegraded":"2024-05-09T00:20:22.664943+0000","last_fullsized":"2024-05-09T00:20:22.664943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3510","last_scrub_stamp":"2024-05-09T00:20:22.664708+0000","last_deep_scrub":"38'3510","last_deep_scrub_stamp":"2024-05-09T00:20:22.664708+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.664708+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:07.186732+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":51796,"num_write_kb":675575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"38'29","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.893638+0000","last_change":"2024-05-09T00:20:26.893764+0000","last_active":"2024-05-09T00:20:26.893638+0000","last_peered":"2024-05-09T00:20:26.893638+0000","last_clean":"2024-05-09T00:20:26.893638+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:20:26.893638+0000","last_undegraded":"2024-05-09T00:20:26.893638+0000","last_fullsized":"2024-05-09T00:20:26.893638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'29","last_scrub_stamp":"2024-05-09T00:20:26.893404+0000","last_deep_scrub":"38'29","last_deep_scrub_stamp":"2024-05-09T00:20:26.893404+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.893404+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:10.546027+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":12312,"num_write":21,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"38'3268","reported_seq":3327,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.499578+0000","last_change":"2024-05-09T00:20:16.499792+0000","last_active":"2024-05-09T00:20:16.499578+0000","last_peered":"2024-05-09T00:20:16.499578+0000","last_clean":"2024-05-09T00:20:16.499578+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:20:16.499578+0000","last_undegraded":"2024-05-09T00:20:16.499578+0000","last_fullsized":"2024-05-09T00:20:16.499578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3268","last_scrub_stamp":"2024-05-09T00:20:16.499295+0000","last_deep_scrub":"38'3268","last_deep_scrub_stamp":"2024-05-09T00:20:16.499295+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.499295+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:53.464034+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":48401,"num_write_kb":608968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"38'5","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.822385+0000","last_change":"2024-05-09T00:20:22.822452+0000","last_active":"2024-05-09T00:20:22.822385+0000","last_peered":"2024-05-09T00:20:22.822385+0000","last_clean":"2024-05-09T00:20:22.822385+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:20:22.822385+0000","last_undegraded":"2024-05-09T00:20:22.822385+0000","last_fullsized":"2024-05-09T00:20:22.822385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:22.822169+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:22.822169+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.822169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:14.357758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"38'4249","reported_seq":4319,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.894712+0000","last_change":"2024-05-09T00:20:30.894785+0000","last_active":"2024-05-09T00:20:30.894712+0000","last_peered":"2024-05-09T00:20:30.894712+0000","last_clean":"2024-05-09T00:20:30.894712+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:20:30.894712+0000","last_undegraded":"2024-05-09T00:20:30.894712+0000","last_fullsized":"2024-05-09T00:20:30.894712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4249","last_scrub_stamp":"2024-05-09T00:20:30.894461+0000","last_deep_scrub":"38'4249","last_deep_scrub_stamp":"2024-05-09T00:20:30.894461+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.894461+0000","objects_scrubbed":0,"log_size":4249,"log_dups_size":0,"ondisk_log_size":4249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:50.968840+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":63068,"num_write_kb":790226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"38'13","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.501853+0000","last_change":"2024-05-09T00:20:25.501931+0000","last_active":"2024-05-09T00:20:25.501853+0000","last_peered":"2024-05-09T00:20:25.501853+0000","last_clean":"2024-05-09T00:20:25.501853+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:20:25.501853+0000","last_undegraded":"2024-05-09T00:20:25.501853+0000","last_fullsized":"2024-05-09T00:20:25.501853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'13","last_scrub_stamp":"2024-05-09T00:20:25.501599+0000","last_deep_scrub":"38'13","last_deep_scrub_stamp":"2024-05-09T00:20:25.501599+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.501599+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:21.475166+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"38'3802","reported_seq":3870,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.466499+0000","last_change":"2024-05-09T00:20:23.466572+0000","last_active":"2024-05-09T00:20:23.466499+0000","last_peered":"2024-05-09T00:20:23.466499+0000","last_clean":"2024-05-09T00:20:23.466499+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:20:23.466499+0000","last_undegraded":"2024-05-09T00:20:23.466499+0000","last_fullsized":"2024-05-09T00:20:23.466499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3802","last_scrub_stamp":"2024-05-09T00:20:23.466259+0000","last_deep_scrub":"38'3802","last_deep_scrub_stamp":"2024-05-09T00:20:23.466259+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.466259+0000","objects_scrubbed":0,"log_size":3802,"log_dups_size":0,"ondisk_log_size":3802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:43.521215+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":56279,"num_write_kb":712681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"38'36","reported_seq":91,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.402964+0000","last_change":"2024-05-09T00:20:12.403007+0000","last_active":"2024-05-09T00:20:12.402964+0000","last_peered":"2024-05-09T00:20:12.402964+0000","last_clean":"2024-05-09T00:20:12.402964+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:20:12.402964+0000","last_undegraded":"2024-05-09T00:20:12.402964+0000","last_fullsized":"2024-05-09T00:20:12.402964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'36","last_scrub_stamp":"2024-05-09T00:20:12.402841+0000","last_deep_scrub":"38'36","last_deep_scrub_stamp":"2024-05-09T00:20:12.402841+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.402841+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.576003+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":31,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"38'3172","reported_seq":3232,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.686663+0000","last_change":"2024-05-09T00:20:20.686735+0000","last_active":"2024-05-09T00:20:20.686663+0000","last_peered":"2024-05-09T00:20:20.686663+0000","last_clean":"2024-05-09T00:20:20.686663+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:20:20.686663+0000","last_undegraded":"2024-05-09T00:20:20.686663+0000","last_fullsized":"2024-05-09T00:20:20.686663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3172","last_scrub_stamp":"2024-05-09T00:20:20.686398+0000","last_deep_scrub":"38'3172","last_deep_scrub_stamp":"2024-05-09T00:20:20.686398+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.686398+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:35:08.293166+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46816,"num_write_kb":580338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"38'74","reported_seq":151,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.227355+0000","last_change":"2024-05-09T00:20:20.227472+0000","last_active":"2024-05-09T00:20:20.227355+0000","last_peered":"2024-05-09T00:20:20.227355+0000","last_clean":"2024-05-09T00:20:20.227355+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:20:20.227355+0000","last_undegraded":"2024-05-09T00:20:20.227355+0000","last_fullsized":"2024-05-09T00:20:20.227355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-05-09T00:20:20.227129+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-05-09T00:20:20.227129+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.227129+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:30.075354+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":24612,"num_write":55,"num_write_kb":12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2295","reported_seq":2354,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.763049+0000","last_change":"2024-05-09T00:20:14.763183+0000","last_active":"2024-05-09T00:20:14.763049+0000","last_peered":"2024-05-09T00:20:14.763049+0000","last_clean":"2024-05-09T00:20:14.763049+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:20:14.763049+0000","last_undegraded":"2024-05-09T00:20:14.763049+0000","last_fullsized":"2024-05-09T00:20:14.763049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2295","last_scrub_stamp":"2024-05-09T00:20:14.762789+0000","last_deep_scrub":"38'2295","last_deep_scrub_stamp":"2024-05-09T00:20:14.762789+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.762789+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:08.266598+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":33922,"num_write_kb":416723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"38'1160","reported_seq":1215,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.354953+0000","last_change":"2024-05-09T00:20:11.355060+0000","last_active":"2024-05-09T00:20:11.354953+0000","last_peered":"2024-05-09T00:20:11.354953+0000","last_clean":"2024-05-09T00:20:11.354953+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:20:11.354953+0000","last_undegraded":"2024-05-09T00:20:11.354953+0000","last_fullsized":"2024-05-09T00:20:11.354953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1160","last_scrub_stamp":"2024-05-09T00:20:11.354702+0000","last_deep_scrub":"38'1160","last_deep_scrub_stamp":"2024-05-09T00:20:11.354702+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.354702+0000","objects_scrubbed":1,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:33.750337+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1156,"num_write_kb":5131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"38'2810","reported_seq":2874,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.507734+0000","last_change":"2024-05-09T00:20:30.507806+0000","last_active":"2024-05-09T00:20:30.507734+0000","last_peered":"2024-05-09T00:20:30.507734+0000","last_clean":"2024-05-09T00:20:30.507734+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:20:30.507734+0000","last_undegraded":"2024-05-09T00:20:30.507734+0000","last_fullsized":"2024-05-09T00:20:30.507734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2810","last_scrub_stamp":"2024-05-09T00:20:30.507414+0000","last_deep_scrub":"38'2810","last_deep_scrub_stamp":"2024-05-09T00:20:30.507414+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.507414+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:15.150468+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":41711,"num_write_kb":539991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"38'22","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.138618+0000","last_change":"2024-05-09T00:20:18.138748+0000","last_active":"2024-05-09T00:20:18.138618+0000","last_peered":"2024-05-09T00:20:18.138618+0000","last_clean":"2024-05-09T00:20:18.138618+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:20:18.138618+0000","last_undegraded":"2024-05-09T00:20:18.138618+0000","last_fullsized":"2024-05-09T00:20:18.138618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'22","last_scrub_stamp":"2024-05-09T00:20:18.138338+0000","last_deep_scrub":"38'22","last_deep_scrub_stamp":"2024-05-09T00:20:18.138338+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.138338+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.858918+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"38'3819","reported_seq":3882,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.746927+0000","last_change":"2024-05-09T00:20:14.746992+0000","last_active":"2024-05-09T00:20:14.746927+0000","last_peered":"2024-05-09T00:20:14.746927+0000","last_clean":"2024-05-09T00:20:14.746927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:20:14.746927+0000","last_undegraded":"2024-05-09T00:20:14.746927+0000","last_fullsized":"2024-05-09T00:20:14.746927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3819","last_scrub_stamp":"2024-05-09T00:20:14.746747+0000","last_deep_scrub":"38'3819","last_deep_scrub_stamp":"2024-05-09T00:20:14.746747+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.746747+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:57:12.335592+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56698,"num_write_kb":717087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"38'129","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.378901+0000","last_change":"2024-05-09T00:20:17.378974+0000","last_active":"2024-05-09T00:20:17.378901+0000","last_peered":"2024-05-09T00:20:17.378901+0000","last_clean":"2024-05-09T00:20:17.378901+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:20:17.378901+0000","last_undegraded":"2024-05-09T00:20:17.378901+0000","last_fullsized":"2024-05-09T00:20:17.378901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'129","last_scrub_stamp":"2024-05-09T00:20:17.378660+0000","last_deep_scrub":"38'129","last_deep_scrub_stamp":"2024-05-09T00:20:17.378660+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.378660+0000","objects_scrubbed":1,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:27:16.012497+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12967,"num_write":119,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"38'3858","reported_seq":3922,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.022897+0000","last_change":"2024-05-09T00:08:55.207348+0000","last_active":"2024-05-09T00:20:11.022897+0000","last_peered":"2024-05-09T00:20:11.022897+0000","last_clean":"2024-05-09T00:20:11.022897+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:20:11.022897+0000","last_undegraded":"2024-05-09T00:20:11.022897+0000","last_fullsized":"2024-05-09T00:20:11.022897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":57322,"num_write_kb":713128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"38'2905","reported_seq":2967,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.772269+0000","last_change":"2024-05-09T00:20:17.772335+0000","last_active":"2024-05-09T00:20:17.772269+0000","last_peered":"2024-05-09T00:20:17.772269+0000","last_clean":"2024-05-09T00:20:17.772269+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:20:17.772269+0000","last_undegraded":"2024-05-09T00:20:17.772269+0000","last_fullsized":"2024-05-09T00:20:17.772269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2905","last_scrub_stamp":"2024-05-09T00:20:17.772043+0000","last_deep_scrub":"38'2905","last_deep_scrub_stamp":"2024-05-09T00:20:17.772043+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.772043+0000","objects_scrubbed":0,"log_size":2905,"log_dups_size":0,"ondisk_log_size":2905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:39.007030+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":43150,"num_write_kb":535156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"38'443","reported_seq":509,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076903+0000","last_change":"2024-05-09T00:08:44.090744+0000","last_active":"2024-05-09T00:20:04.076903+0000","last_peered":"2024-05-09T00:20:04.076903+0000","last_clean":"2024-05-09T00:20:04.076903+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:20:04.076903+0000","last_undegraded":"2024-05-09T00:20:04.076903+0000","last_fullsized":"2024-05-09T00:20:04.076903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":13833,"num_write":428,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"38'30","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.693876+0000","last_change":"2024-05-09T00:20:24.693954+0000","last_active":"2024-05-09T00:20:24.693876+0000","last_peered":"2024-05-09T00:20:24.693876+0000","last_clean":"2024-05-09T00:20:24.693876+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:20:24.693876+0000","last_undegraded":"2024-05-09T00:20:24.693876+0000","last_fullsized":"2024-05-09T00:20:24.693876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'30","last_scrub_stamp":"2024-05-09T00:20:24.693644+0000","last_deep_scrub":"38'30","last_deep_scrub_stamp":"2024-05-09T00:20:24.693644+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.693644+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:53.927569+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":25,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"38'3696","reported_seq":3763,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.829058+0000","last_change":"2024-05-09T00:20:28.829127+0000","last_active":"2024-05-09T00:20:28.829058+0000","last_peered":"2024-05-09T00:20:28.829058+0000","last_clean":"2024-05-09T00:20:28.829058+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:20:28.829058+0000","last_undegraded":"2024-05-09T00:20:28.829058+0000","last_fullsized":"2024-05-09T00:20:28.829058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3696","last_scrub_stamp":"2024-05-09T00:20:28.828827+0000","last_deep_scrub":"38'3696","last_deep_scrub_stamp":"2024-05-09T00:20:28.828827+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.828827+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:28.178985+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54745,"num_write_kb":690364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"38'2635","reported_seq":2698,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.822824+0000","last_change":"2024-05-09T00:20:17.822893+0000","last_active":"2024-05-09T00:20:17.822824+0000","last_peered":"2024-05-09T00:20:17.822824+0000","last_clean":"2024-05-09T00:20:17.822824+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:20:17.822824+0000","last_undegraded":"2024-05-09T00:20:17.822824+0000","last_fullsized":"2024-05-09T00:20:17.822824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2635","last_scrub_stamp":"2024-05-09T00:20:17.822561+0000","last_deep_scrub":"38'2635","last_deep_scrub_stamp":"2024-05-09T00:20:17.822561+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.822561+0000","objects_scrubbed":0,"log_size":2635,"log_dups_size":0,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:15.972952+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":39020,"num_write_kb":478044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"38'85","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.204867+0000","last_change":"2024-05-09T00:20:22.204944+0000","last_active":"2024-05-09T00:20:22.204867+0000","last_peered":"2024-05-09T00:20:22.204867+0000","last_clean":"2024-05-09T00:20:22.204867+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:20:22.204867+0000","last_undegraded":"2024-05-09T00:20:22.204867+0000","last_fullsized":"2024-05-09T00:20:22.204867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'85","last_scrub_stamp":"2024-05-09T00:20:22.204577+0000","last_deep_scrub":"38'85","last_deep_scrub_stamp":"2024-05-09T00:20:22.204577+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.204577+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:50.327619+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110967,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":1124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"38'3","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.129875+0000","last_change":"2024-05-09T00:20:26.129944+0000","last_active":"2024-05-09T00:20:26.129875+0000","last_peered":"2024-05-09T00:20:26.129875+0000","last_clean":"2024-05-09T00:20:26.129875+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:20:26.129875+0000","last_undegraded":"2024-05-09T00:20:26.129875+0000","last_fullsized":"2024-05-09T00:20:26.129875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:26.129646+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:26.129646+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.129646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:23.685344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"38'3606","reported_seq":3670,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.884067+0000","last_change":"2024-05-09T00:08:55.240211+0000","last_active":"2024-05-09T00:20:10.884067+0000","last_peered":"2024-05-09T00:20:10.884067+0000","last_clean":"2024-05-09T00:20:10.884067+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:20:10.884067+0000","last_undegraded":"2024-05-09T00:20:10.884067+0000","last_fullsized":"2024-05-09T00:20:10.884067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":53395,"num_write_kb":656713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"38'3287","reported_seq":3348,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.880377+0000","last_change":"2024-05-09T00:20:28.880447+0000","last_active":"2024-05-09T00:20:28.880377+0000","last_peered":"2024-05-09T00:20:28.880377+0000","last_clean":"2024-05-09T00:20:28.880377+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:20:28.880377+0000","last_undegraded":"2024-05-09T00:20:28.880377+0000","last_fullsized":"2024-05-09T00:20:28.880377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3287","last_scrub_stamp":"2024-05-09T00:20:28.880148+0000","last_deep_scrub":"38'3287","last_deep_scrub_stamp":"2024-05-09T00:20:28.880148+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.880148+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:28.168577+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48685,"num_write_kb":618917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"38'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.855896+0000","last_change":"2024-05-09T00:20:24.855963+0000","last_active":"2024-05-09T00:20:24.855896+0000","last_peered":"2024-05-09T00:20:24.855896+0000","last_clean":"2024-05-09T00:20:24.855896+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:20:24.855896+0000","last_undegraded":"2024-05-09T00:20:24.855896+0000","last_fullsized":"2024-05-09T00:20:24.855896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:24.855692+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:24.855692+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.855692+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:09.071360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"38'116","reported_seq":175,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.892863+0000","last_change":"2024-05-09T00:20:23.892942+0000","last_active":"2024-05-09T00:20:23.892863+0000","last_peered":"2024-05-09T00:20:23.892863+0000","last_clean":"2024-05-09T00:20:23.892863+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:20:23.892863+0000","last_undegraded":"2024-05-09T00:20:23.892863+0000","last_fullsized":"2024-05-09T00:20:23.892863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'116","last_scrub_stamp":"2024-05-09T00:20:23.892592+0000","last_deep_scrub":"38'116","last_deep_scrub_stamp":"2024-05-09T00:20:23.892592+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.892592+0000","objects_scrubbed":2,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:41.338336+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4101,"num_write":111,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"38'4190","reported_seq":4260,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.703355+0000","last_change":"2024-05-09T00:20:21.703423+0000","last_active":"2024-05-09T00:20:21.703355+0000","last_peered":"2024-05-09T00:20:21.703355+0000","last_clean":"2024-05-09T00:20:21.703355+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:20:21.703355+0000","last_undegraded":"2024-05-09T00:20:21.703355+0000","last_fullsized":"2024-05-09T00:20:21.703355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4190","last_scrub_stamp":"2024-05-09T00:20:21.703116+0000","last_deep_scrub":"38'4190","last_deep_scrub_stamp":"2024-05-09T00:20:21.703116+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.703116+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:47.737108+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":62004,"num_write_kb":783810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"38'2923","reported_seq":2986,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.672197+0000","last_change":"2024-05-09T00:20:27.672264+0000","last_active":"2024-05-09T00:20:27.672197+0000","last_peered":"2024-05-09T00:20:27.672197+0000","last_clean":"2024-05-09T00:20:27.672197+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:20:27.672197+0000","last_undegraded":"2024-05-09T00:20:27.672197+0000","last_fullsized":"2024-05-09T00:20:27.672197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2923","last_scrub_stamp":"2024-05-09T00:20:27.671971+0000","last_deep_scrub":"38'2923","last_deep_scrub_stamp":"2024-05-09T00:20:27.671971+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.671971+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:10.398105+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43377,"num_write_kb":534691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"38'16","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.167853+0000","last_change":"2024-05-09T00:20:19.167927+0000","last_active":"2024-05-09T00:20:19.167853+0000","last_peered":"2024-05-09T00:20:19.167853+0000","last_clean":"2024-05-09T00:20:19.167853+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:20:19.167853+0000","last_undegraded":"2024-05-09T00:20:19.167853+0000","last_fullsized":"2024-05-09T00:20:19.167853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'16","last_scrub_stamp":"2024-05-09T00:20:19.167610+0000","last_deep_scrub":"38'16","last_deep_scrub_stamp":"2024-05-09T00:20:19.167610+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.167610+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:53.069715+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":10,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"38'19","reported_seq":83,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.365293+0000","last_change":"2024-05-09T00:20:10.365293+0000","last_active":"2024-05-09T00:20:10.365293+0000","last_peered":"2024-05-09T00:20:10.365293+0000","last_clean":"2024-05-09T00:20:10.365293+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:20:10.365293+0000","last_undegraded":"2024-05-09T00:20:10.365293+0000","last_fullsized":"2024-05-09T00:20:10.365293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'19","last_scrub_stamp":"2024-05-09T00:20:10.365166+0000","last_deep_scrub":"38'19","last_deep_scrub_stamp":"2024-05-09T00:20:10.365166+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.365166+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:39.230901+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":8222,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"38'3415","reported_seq":3479,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.912295+0000","last_change":"2024-05-09T00:20:20.912362+0000","last_active":"2024-05-09T00:20:20.912295+0000","last_peered":"2024-05-09T00:20:20.912295+0000","last_clean":"2024-05-09T00:20:20.912295+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:20:20.912295+0000","last_undegraded":"2024-05-09T00:20:20.912295+0000","last_fullsized":"2024-05-09T00:20:20.912295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3415","last_scrub_stamp":"2024-05-09T00:20:20.912050+0000","last_deep_scrub":"38'3415","last_deep_scrub_stamp":"2024-05-09T00:20:20.912050+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.912050+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:49.154731+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":50480,"num_write_kb":654641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"38'2737","reported_seq":2799,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.913319+0000","last_change":"2024-05-09T00:20:29.913613+0000","last_active":"2024-05-09T00:20:29.913319+0000","last_peered":"2024-05-09T00:20:29.913319+0000","last_clean":"2024-05-09T00:20:29.913319+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:20:29.913319+0000","last_undegraded":"2024-05-09T00:20:29.913319+0000","last_fullsized":"2024-05-09T00:20:29.913319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2737","last_scrub_stamp":"2024-05-09T00:20:29.913063+0000","last_deep_scrub":"38'2737","last_deep_scrub_stamp":"2024-05-09T00:20:29.913063+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.913063+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:48.696777+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":40218,"num_write_kb":499329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"38'5","reported_seq":69,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.083452+0000","last_change":"2024-05-09T00:08:44.093606+0000","last_active":"2024-05-09T00:20:04.083452+0000","last_peered":"2024-05-09T00:20:04.083452+0000","last_clean":"2024-05-09T00:20:04.083452+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:20:04.083452+0000","last_undegraded":"2024-05-09T00:20:04.083452+0000","last_fullsized":"2024-05-09T00:20:04.083452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'29","reported_seq":111,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.398243+0000","last_change":"2024-05-09T00:20:19.398321+0000","last_active":"2024-05-09T00:20:19.398243+0000","last_peered":"2024-05-09T00:20:19.398243+0000","last_clean":"2024-05-09T00:20:19.398243+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:20:19.398243+0000","last_undegraded":"2024-05-09T00:20:19.398243+0000","last_fullsized":"2024-05-09T00:20:19.398243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'29","last_scrub_stamp":"2024-05-09T00:20:19.398027+0000","last_deep_scrub":"38'29","last_deep_scrub_stamp":"2024-05-09T00:20:19.398027+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.398027+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:45.427521+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":104,"num_write":26,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"38'3402","reported_seq":3462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.578654+0000","last_change":"2024-05-09T00:08:55.217642+0000","last_active":"2024-05-09T00:19:53.578654+0000","last_peered":"2024-05-09T00:19:53.578654+0000","last_clean":"2024-05-09T00:19:53.578654+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:19:53.578654+0000","last_undegraded":"2024-05-09T00:19:53.578654+0000","last_fullsized":"2024-05-09T00:19:53.578654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":50468,"num_write_kb":661545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"38'3255","reported_seq":3316,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.929229+0000","last_change":"2024-05-09T00:20:19.929298+0000","last_active":"2024-05-09T00:20:19.929229+0000","last_peered":"2024-05-09T00:20:19.929229+0000","last_clean":"2024-05-09T00:20:19.929229+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:20:19.929229+0000","last_undegraded":"2024-05-09T00:20:19.929229+0000","last_fullsized":"2024-05-09T00:20:19.929229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3255","last_scrub_stamp":"2024-05-09T00:20:19.929001+0000","last_deep_scrub":"38'3255","last_deep_scrub_stamp":"2024-05-09T00:20:19.929001+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.929001+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:38.914851+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48118,"num_write_kb":593457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"38'287","reported_seq":353,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.842483+0000","last_change":"2024-05-09T00:20:22.842560+0000","last_active":"2024-05-09T00:20:22.842483+0000","last_peered":"2024-05-09T00:20:22.842483+0000","last_clean":"2024-05-09T00:20:22.842483+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:20:22.842483+0000","last_undegraded":"2024-05-09T00:20:22.842483+0000","last_fullsized":"2024-05-09T00:20:22.842483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'287","last_scrub_stamp":"2024-05-09T00:20:22.842262+0000","last_deep_scrub":"38'287","last_deep_scrub_stamp":"2024-05-09T00:20:22.842262+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.842262+0000","objects_scrubbed":1,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:23.385265+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":56,"num_write":605,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"38'127","reported_seq":184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.960049+0000","last_change":"2024-05-09T00:20:12.960196+0000","last_active":"2024-05-09T00:20:12.960049+0000","last_peered":"2024-05-09T00:20:12.960049+0000","last_clean":"2024-05-09T00:20:12.960049+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:20:12.960049+0000","last_undegraded":"2024-05-09T00:20:12.960049+0000","last_fullsized":"2024-05-09T00:20:12.960049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'127","last_scrub_stamp":"2024-05-09T00:20:12.959613+0000","last_deep_scrub":"38'127","last_deep_scrub_stamp":"2024-05-09T00:20:12.959613+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.959613+0000","objects_scrubbed":2,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:25.812928+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":117,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"38'3842","reported_seq":3909,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.205020+0000","last_change":"2024-05-09T00:20:32.205086+0000","last_active":"2024-05-09T00:20:32.205020+0000","last_peered":"2024-05-09T00:20:32.205020+0000","last_clean":"2024-05-09T00:20:32.205020+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:20:32.205020+0000","last_undegraded":"2024-05-09T00:20:32.205020+0000","last_fullsized":"2024-05-09T00:20:32.205020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3842","last_scrub_stamp":"2024-05-09T00:20:32.204789+0000","last_deep_scrub":"38'3842","last_deep_scrub_stamp":"2024-05-09T00:20:32.204789+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.204789+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:28.353089+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":57074,"num_write_kb":711138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"38'3196","reported_seq":3259,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.168330+0000","last_change":"2024-05-09T00:20:25.168397+0000","last_active":"2024-05-09T00:20:25.168330+0000","last_peered":"2024-05-09T00:20:25.168330+0000","last_clean":"2024-05-09T00:20:25.168330+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:20:25.168330+0000","last_undegraded":"2024-05-09T00:20:25.168330+0000","last_fullsized":"2024-05-09T00:20:25.168330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3196","last_scrub_stamp":"2024-05-09T00:20:25.168083+0000","last_deep_scrub":"38'3196","last_deep_scrub_stamp":"2024-05-09T00:20:25.168083+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.168083+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:05.342792+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":47419,"num_write_kb":602470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"38'4","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.075337+0000","last_change":"2024-05-09T00:08:44.092078+0000","last_active":"2024-05-09T00:20:04.075337+0000","last_peered":"2024-05-09T00:20:04.075337+0000","last_clean":"2024-05-09T00:20:04.075337+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:20:04.075337+0000","last_undegraded":"2024-05-09T00:20:04.075337+0000","last_fullsized":"2024-05-09T00:20:04.075337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'1","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.225420+0000","last_change":"2024-05-09T00:20:18.225487+0000","last_active":"2024-05-09T00:20:18.225420+0000","last_peered":"2024-05-09T00:20:18.225420+0000","last_clean":"2024-05-09T00:20:18.225420+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:20:18.225420+0000","last_undegraded":"2024-05-09T00:20:18.225420+0000","last_fullsized":"2024-05-09T00:20:18.225420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-05-09T00:20:18.225168+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-05-09T00:20:18.225168+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.225168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:00.764729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"38'3423","reported_seq":3486,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.635684+0000","last_change":"2024-05-09T00:08:55.234766+0000","last_active":"2024-05-09T00:19:53.635684+0000","last_peered":"2024-05-09T00:19:53.635684+0000","last_clean":"2024-05-09T00:19:53.635684+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:19:53.635684+0000","last_undegraded":"2024-05-09T00:19:53.635684+0000","last_fullsized":"2024-05-09T00:19:53.635684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":50760,"num_write_kb":664501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"38'2723","reported_seq":2786,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.445919+0000","last_change":"2024-05-09T00:20:23.445988+0000","last_active":"2024-05-09T00:20:23.445919+0000","last_peered":"2024-05-09T00:20:23.445919+0000","last_clean":"2024-05-09T00:20:23.445919+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:20:23.445919+0000","last_undegraded":"2024-05-09T00:20:23.445919+0000","last_fullsized":"2024-05-09T00:20:23.445919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2723","last_scrub_stamp":"2024-05-09T00:20:23.445704+0000","last_deep_scrub":"38'2723","last_deep_scrub_stamp":"2024-05-09T00:20:23.445704+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.445704+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:18.254736+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40273,"num_write_kb":520250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"38'5","reported_seq":65,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.434731+0000","last_change":"2024-05-09T00:20:24.434802+0000","last_active":"2024-05-09T00:20:24.434731+0000","last_peered":"2024-05-09T00:20:24.434731+0000","last_clean":"2024-05-09T00:20:24.434731+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:20:24.434731+0000","last_undegraded":"2024-05-09T00:20:24.434731+0000","last_fullsized":"2024-05-09T00:20:24.434731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:24.434459+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:24.434459+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.434459+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:34.505816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'63","reported_seq":121,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.240294+0000","last_change":"2024-05-09T00:20:14.240369+0000","last_active":"2024-05-09T00:20:14.240294+0000","last_peered":"2024-05-09T00:20:14.240294+0000","last_clean":"2024-05-09T00:20:14.240294+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:20:14.240294+0000","last_undegraded":"2024-05-09T00:20:14.240294+0000","last_fullsized":"2024-05-09T00:20:14.240294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'63","last_scrub_stamp":"2024-05-09T00:20:14.240063+0000","last_deep_scrub":"38'63","last_deep_scrub_stamp":"2024-05-09T00:20:14.240063+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.240063+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:37.068404+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18843,"num_write":53,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"38'3161","reported_seq":3227,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.869636+0000","last_change":"2024-05-09T00:20:29.869732+0000","last_active":"2024-05-09T00:20:29.869636+0000","last_peered":"2024-05-09T00:20:29.869636+0000","last_clean":"2024-05-09T00:20:29.869636+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:20:29.869636+0000","last_undegraded":"2024-05-09T00:20:29.869636+0000","last_fullsized":"2024-05-09T00:20:29.869636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3161","last_scrub_stamp":"2024-05-09T00:20:29.869413+0000","last_deep_scrub":"38'3161","last_deep_scrub_stamp":"2024-05-09T00:20:29.869413+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.869413+0000","objects_scrubbed":0,"log_size":3161,"log_dups_size":0,"ondisk_log_size":3161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:55.848627+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":46450,"num_write_kb":620498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"38'2916","reported_seq":2979,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:09.126671+0000","last_change":"2024-05-09T00:20:09.126722+0000","last_active":"2024-05-09T00:20:09.126671+0000","last_peered":"2024-05-09T00:20:09.126671+0000","last_clean":"2024-05-09T00:20:09.126671+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:20:09.126671+0000","last_undegraded":"2024-05-09T00:20:09.126671+0000","last_fullsized":"2024-05-09T00:20:09.126671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2916","last_scrub_stamp":"2024-05-09T00:20:09.126512+0000","last_deep_scrub":"38'2916","last_deep_scrub_stamp":"2024-05-09T00:20:09.126512+0000","last_clean_scrub_stamp":"2024-05-09T00:20:09.126512+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:47.161350+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43303,"num_write_kb":562205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"38'36","reported_seq":100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.735047+0000","last_change":"2024-05-09T00:20:29.735205+0000","last_active":"2024-05-09T00:20:29.735047+0000","last_peered":"2024-05-09T00:20:29.735047+0000","last_clean":"2024-05-09T00:20:29.735047+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:20:29.735047+0000","last_undegraded":"2024-05-09T00:20:29.735047+0000","last_fullsized":"2024-05-09T00:20:29.735047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'36","last_scrub_stamp":"2024-05-09T00:20:29.734791+0000","last_deep_scrub":"38'36","last_deep_scrub_stamp":"2024-05-09T00:20:29.734791+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.734791+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:09.358915+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":25,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"38'5","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.121380+0000","last_change":"2024-05-09T00:20:28.121450+0000","last_active":"2024-05-09T00:20:28.121380+0000","last_peered":"2024-05-09T00:20:28.121380+0000","last_clean":"2024-05-09T00:20:28.121380+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:20:28.121380+0000","last_undegraded":"2024-05-09T00:20:28.121380+0000","last_fullsized":"2024-05-09T00:20:28.121380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:28.121164+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:28.121164+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.121164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:17.004604+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"38'3104","reported_seq":3168,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.858991+0000","last_change":"2024-05-09T00:20:27.859171+0000","last_active":"2024-05-09T00:20:27.858991+0000","last_peered":"2024-05-09T00:20:27.858991+0000","last_clean":"2024-05-09T00:20:27.858991+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:20:27.858991+0000","last_undegraded":"2024-05-09T00:20:27.858991+0000","last_fullsized":"2024-05-09T00:20:27.858991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3104","last_scrub_stamp":"2024-05-09T00:20:27.858721+0000","last_deep_scrub":"38'3104","last_deep_scrub_stamp":"2024-05-09T00:20:27.858721+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.858721+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:31.900183+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45747,"num_write_kb":566089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"38'2907","reported_seq":2973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.518865+0000","last_change":"2024-05-09T00:20:28.518940+0000","last_active":"2024-05-09T00:20:28.518865+0000","last_peered":"2024-05-09T00:20:28.518865+0000","last_clean":"2024-05-09T00:20:28.518865+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:20:28.518865+0000","last_undegraded":"2024-05-09T00:20:28.518865+0000","last_fullsized":"2024-05-09T00:20:28.518865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2907","last_scrub_stamp":"2024-05-09T00:20:28.518578+0000","last_deep_scrub":"38'2907","last_deep_scrub_stamp":"2024-05-09T00:20:28.518578+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.518578+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:34.273392+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42913,"num_write_kb":561201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"38'35","reported_seq":132,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.784249+0000","last_change":"2024-05-09T00:20:14.784321+0000","last_active":"2024-05-09T00:20:14.784249+0000","last_peered":"2024-05-09T00:20:14.784249+0000","last_clean":"2024-05-09T00:20:14.784249+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:20:14.784249+0000","last_undegraded":"2024-05-09T00:20:14.784249+0000","last_fullsized":"2024-05-09T00:20:14.784249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'35","last_scrub_stamp":"2024-05-09T00:20:14.784031+0000","last_deep_scrub":"38'35","last_deep_scrub_stamp":"2024-05-09T00:20:14.784031+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.784031+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:09.644581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":106,"num_write":32,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"38'6","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.185363+0000","last_change":"2024-05-09T00:20:15.185435+0000","last_active":"2024-05-09T00:20:15.185363+0000","last_peered":"2024-05-09T00:20:15.185363+0000","last_clean":"2024-05-09T00:20:15.185363+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:20:15.185363+0000","last_undegraded":"2024-05-09T00:20:15.185363+0000","last_fullsized":"2024-05-09T00:20:15.185363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:15.185133+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:15.185133+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.185133+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:21.653175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"38'3544","reported_seq":3607,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.611148+0000","last_change":"2024-05-09T00:08:55.216133+0000","last_active":"2024-05-09T00:19:53.611148+0000","last_peered":"2024-05-09T00:19:53.611148+0000","last_clean":"2024-05-09T00:19:53.611148+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:19:53.611148+0000","last_undegraded":"2024-05-09T00:19:53.611148+0000","last_fullsized":"2024-05-09T00:19:53.611148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":1,"num_write":52513,"num_write_kb":669201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"38'3009","reported_seq":3072,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.282560+0000","last_change":"2024-05-09T00:20:19.282632+0000","last_active":"2024-05-09T00:20:19.282560+0000","last_peered":"2024-05-09T00:20:19.282560+0000","last_clean":"2024-05-09T00:20:19.282560+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:20:19.282560+0000","last_undegraded":"2024-05-09T00:20:19.282560+0000","last_fullsized":"2024-05-09T00:20:19.282560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3009","last_scrub_stamp":"2024-05-09T00:20:19.282325+0000","last_deep_scrub":"38'3009","last_deep_scrub_stamp":"2024-05-09T00:20:19.282325+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.282325+0000","objects_scrubbed":0,"log_size":3009,"log_dups_size":0,"ondisk_log_size":3009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:12:34.319583+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44755,"num_write_kb":572857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"38'444","reported_seq":503,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.087204+0000","last_change":"2024-05-09T00:08:44.095687+0000","last_active":"2024-05-09T00:20:04.087204+0000","last_peered":"2024-05-09T00:20:04.087204+0000","last_clean":"2024-05-09T00:20:04.087204+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:20:04.087204+0000","last_undegraded":"2024-05-09T00:20:04.087204+0000","last_fullsized":"2024-05-09T00:20:04.087204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14538,"num_write":435,"num_write_kb":8538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"38'273","reported_seq":322,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.087295+0000","last_change":"2024-05-09T00:08:54.224391+0000","last_active":"2024-05-09T00:20:04.087295+0000","last_peered":"2024-05-09T00:20:04.087295+0000","last_clean":"2024-05-09T00:20:04.087295+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:20:04.087295+0000","last_undegraded":"2024-05-09T00:20:04.087295+0000","last_fullsized":"2024-05-09T00:20:04.087295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":46,"num_write":566,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"38'3750","reported_seq":3822,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.176844+0000","last_change":"2024-05-09T00:20:29.176912+0000","last_active":"2024-05-09T00:20:29.176844+0000","last_peered":"2024-05-09T00:20:29.176844+0000","last_clean":"2024-05-09T00:20:29.176844+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:20:29.176844+0000","last_undegraded":"2024-05-09T00:20:29.176844+0000","last_fullsized":"2024-05-09T00:20:29.176844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3750","last_scrub_stamp":"2024-05-09T00:20:29.176603+0000","last_deep_scrub":"38'3750","last_deep_scrub_stamp":"2024-05-09T00:20:29.176603+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.176603+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":0,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.788952+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":55664,"num_write_kb":710441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"38'3179","reported_seq":3241,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.915872+0000","last_change":"2024-05-09T00:20:17.915941+0000","last_active":"2024-05-09T00:20:17.915872+0000","last_peered":"2024-05-09T00:20:17.915872+0000","last_clean":"2024-05-09T00:20:17.915872+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:20:17.915872+0000","last_undegraded":"2024-05-09T00:20:17.915872+0000","last_fullsized":"2024-05-09T00:20:17.915872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3179","last_scrub_stamp":"2024-05-09T00:20:17.915621+0000","last_deep_scrub":"38'3179","last_deep_scrub_stamp":"2024-05-09T00:20:17.915621+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.915621+0000","objects_scrubbed":0,"log_size":3179,"log_dups_size":0,"ondisk_log_size":3179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:02.839395+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":46937,"num_write_kb":587038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:13.889320+0000","last_change":"2024-05-09T00:08:44.094924+0000","last_active":"2024-05-09T00:19:13.889320+0000","last_peered":"2024-05-09T00:19:13.889320+0000","last_clean":"2024-05-09T00:19:13.889320+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:19:13.889320+0000","last_undegraded":"2024-05-09T00:19:13.889320+0000","last_fullsized":"2024-05-09T00:19:13.889320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"38'74","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:09.819397+0000","last_change":"2024-05-09T00:20:09.819526+0000","last_active":"2024-05-09T00:20:09.819397+0000","last_peered":"2024-05-09T00:20:09.819397+0000","last_clean":"2024-05-09T00:20:09.819397+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:20:09.819397+0000","last_undegraded":"2024-05-09T00:20:09.819397+0000","last_fullsized":"2024-05-09T00:20:09.819397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-05-09T00:20:09.819189+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-05-09T00:20:09.819189+0000","last_clean_scrub_stamp":"2024-05-09T00:20:09.819189+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:44.100719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'4","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.657194+0000","last_change":"2024-05-09T00:20:26.657512+0000","last_active":"2024-05-09T00:20:26.657194+0000","last_peered":"2024-05-09T00:20:26.657194+0000","last_clean":"2024-05-09T00:20:26.657194+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:20:26.657194+0000","last_undegraded":"2024-05-09T00:20:26.657194+0000","last_fullsized":"2024-05-09T00:20:26.657194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:26.656736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:26.656736+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.656736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:16.847922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"38'3132","reported_seq":3185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:06.021568+0000","last_change":"2024-05-09T00:08:55.217181+0000","last_active":"2024-05-09T00:20:06.021568+0000","last_peered":"2024-05-09T00:20:06.021568+0000","last_clean":"2024-05-09T00:20:06.021568+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:20:06.021568+0000","last_undegraded":"2024-05-09T00:20:06.021568+0000","last_fullsized":"2024-05-09T00:20:06.021568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3132,"log_dups_size":0,"ondisk_log_size":3132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46383,"num_write_kb":562908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'2979","reported_seq":3045,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.692003+0000","last_change":"2024-05-09T00:20:25.692071+0000","last_active":"2024-05-09T00:20:25.692003+0000","last_peered":"2024-05-09T00:20:25.692003+0000","last_clean":"2024-05-09T00:20:25.692003+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:20:25.692003+0000","last_undegraded":"2024-05-09T00:20:25.692003+0000","last_fullsized":"2024-05-09T00:20:25.692003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2979","last_scrub_stamp":"2024-05-09T00:20:25.691773+0000","last_deep_scrub":"38'2979","last_deep_scrub_stamp":"2024-05-09T00:20:25.691773+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.691773+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:15.593553+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":44170,"num_write_kb":571148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"38'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.211619+0000","last_change":"2024-05-09T00:20:21.211726+0000","last_active":"2024-05-09T00:20:21.211619+0000","last_peered":"2024-05-09T00:20:21.211619+0000","last_clean":"2024-05-09T00:20:21.211619+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:20:21.211619+0000","last_undegraded":"2024-05-09T00:20:21.211619+0000","last_fullsized":"2024-05-09T00:20:21.211619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:21.211382+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:21.211382+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.211382+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:33.761350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"38'177","reported_seq":231,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.349608+0000","last_change":"2024-05-09T00:20:15.349678+0000","last_active":"2024-05-09T00:20:15.349608+0000","last_peered":"2024-05-09T00:20:15.349608+0000","last_clean":"2024-05-09T00:20:15.349608+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:20:15.349608+0000","last_undegraded":"2024-05-09T00:20:15.349608+0000","last_fullsized":"2024-05-09T00:20:15.349608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'177","last_scrub_stamp":"2024-05-09T00:20:15.349363+0000","last_deep_scrub":"38'177","last_deep_scrub_stamp":"2024-05-09T00:20:15.349363+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.349363+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:55.924373+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2152331,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":38,"num_write":171,"num_write_kb":2182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"38'3176","reported_seq":3241,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:54.943231+0000","last_change":"2024-05-09T00:08:55.239558+0000","last_active":"2024-05-09T00:19:54.943231+0000","last_peered":"2024-05-09T00:19:54.943231+0000","last_clean":"2024-05-09T00:19:54.943231+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:19:54.943231+0000","last_undegraded":"2024-05-09T00:19:54.943231+0000","last_fullsized":"2024-05-09T00:19:54.943231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3176,"log_dups_size":0,"ondisk_log_size":3176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":47105,"num_write_kb":619272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"38'3217","reported_seq":3281,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.109658+0000","last_change":"2024-05-09T00:20:11.109724+0000","last_active":"2024-05-09T00:20:11.109658+0000","last_peered":"2024-05-09T00:20:11.109658+0000","last_clean":"2024-05-09T00:20:11.109658+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:20:11.109658+0000","last_undegraded":"2024-05-09T00:20:11.109658+0000","last_fullsized":"2024-05-09T00:20:11.109658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3217","last_scrub_stamp":"2024-05-09T00:20:11.109393+0000","last_deep_scrub":"38'3217","last_deep_scrub_stamp":"2024-05-09T00:20:11.109393+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.109393+0000","objects_scrubbed":0,"log_size":3217,"log_dups_size":0,"ondisk_log_size":3217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:04.651233+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":47564,"num_write_kb":594884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"38'20","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.546197+0000","last_change":"2024-05-09T00:20:26.546289+0000","last_active":"2024-05-09T00:20:26.546197+0000","last_peered":"2024-05-09T00:20:26.546197+0000","last_clean":"2024-05-09T00:20:26.546197+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:20:26.546197+0000","last_undegraded":"2024-05-09T00:20:26.546197+0000","last_fullsized":"2024-05-09T00:20:26.546197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'20","last_scrub_stamp":"2024-05-09T00:20:26.545875+0000","last_deep_scrub":"38'20","last_deep_scrub_stamp":"2024-05-09T00:20:26.545875+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.545875+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:26:42.569600+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"38'248","reported_seq":310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.476814+0000","last_change":"2024-05-09T00:20:20.476892+0000","last_active":"2024-05-09T00:20:20.476814+0000","last_peered":"2024-05-09T00:20:20.476814+0000","last_clean":"2024-05-09T00:20:20.476814+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:20:20.476814+0000","last_undegraded":"2024-05-09T00:20:20.476814+0000","last_fullsized":"2024-05-09T00:20:20.476814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'248","last_scrub_stamp":"2024-05-09T00:20:20.476557+0000","last_deep_scrub":"38'248","last_deep_scrub_stamp":"2024-05-09T00:20:20.476557+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.476557+0000","objects_scrubbed":2,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:16.354477+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":16394,"num_write":232,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"38'3503","reported_seq":3570,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.717087+0000","last_change":"2024-05-09T00:20:19.717153+0000","last_active":"2024-05-09T00:20:19.717087+0000","last_peered":"2024-05-09T00:20:19.717087+0000","last_clean":"2024-05-09T00:20:19.717087+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:20:19.717087+0000","last_undegraded":"2024-05-09T00:20:19.717087+0000","last_fullsized":"2024-05-09T00:20:19.717087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3503","last_scrub_stamp":"2024-05-09T00:20:19.716862+0000","last_deep_scrub":"38'3503","last_deep_scrub_stamp":"2024-05-09T00:20:19.716862+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.716862+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:07.277018+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":51910,"num_write_kb":640187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"38'3580","reported_seq":3643,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.193181+0000","last_change":"2024-05-09T00:20:24.193248+0000","last_active":"2024-05-09T00:20:24.193181+0000","last_peered":"2024-05-09T00:20:24.193181+0000","last_clean":"2024-05-09T00:20:24.193181+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:20:24.193181+0000","last_undegraded":"2024-05-09T00:20:24.193181+0000","last_fullsized":"2024-05-09T00:20:24.193181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3580","last_scrub_stamp":"2024-05-09T00:20:24.192949+0000","last_deep_scrub":"38'3580","last_deep_scrub_stamp":"2024-05-09T00:20:24.192949+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.192949+0000","objects_scrubbed":0,"log_size":3580,"log_dups_size":0,"ondisk_log_size":3580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:25.907668+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":53064,"num_write_kb":670486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"38'22","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.853038+0000","last_change":"2024-05-09T00:20:25.853124+0000","last_active":"2024-05-09T00:20:25.853038+0000","last_peered":"2024-05-09T00:20:25.853038+0000","last_clean":"2024-05-09T00:20:25.853038+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:20:25.853038+0000","last_undegraded":"2024-05-09T00:20:25.853038+0000","last_fullsized":"2024-05-09T00:20:25.853038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'22","last_scrub_stamp":"2024-05-09T00:20:25.852793+0000","last_deep_scrub":"38'22","last_deep_scrub_stamp":"2024-05-09T00:20:25.852793+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.852793+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:46.132508+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":16,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"38'23","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.695712+0000","last_change":"2024-05-09T00:20:22.695785+0000","last_active":"2024-05-09T00:20:22.695712+0000","last_peered":"2024-05-09T00:20:22.695712+0000","last_clean":"2024-05-09T00:20:22.695712+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:20:22.695712+0000","last_undegraded":"2024-05-09T00:20:22.695712+0000","last_fullsized":"2024-05-09T00:20:22.695712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'23","last_scrub_stamp":"2024-05-09T00:20:22.695470+0000","last_deep_scrub":"38'23","last_deep_scrub_stamp":"2024-05-09T00:20:22.695470+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.695470+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:27.135406+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":17,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"38'3625","reported_seq":3684,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.538984+0000","last_change":"2024-05-09T00:08:55.239406+0000","last_active":"2024-05-09T00:19:53.538984+0000","last_peered":"2024-05-09T00:19:53.538984+0000","last_clean":"2024-05-09T00:19:53.538984+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:19:53.538984+0000","last_undegraded":"2024-05-09T00:19:53.538984+0000","last_fullsized":"2024-05-09T00:19:53.538984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53630,"num_write_kb":693205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"38'2900","reported_seq":2965,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.483638+0000","last_change":"2024-05-09T00:20:24.483707+0000","last_active":"2024-05-09T00:20:24.483638+0000","last_peered":"2024-05-09T00:20:24.483638+0000","last_clean":"2024-05-09T00:20:24.483638+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:20:24.483638+0000","last_undegraded":"2024-05-09T00:20:24.483638+0000","last_fullsized":"2024-05-09T00:20:24.483638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2900","last_scrub_stamp":"2024-05-09T00:20:24.483380+0000","last_deep_scrub":"38'2900","last_deep_scrub_stamp":"2024-05-09T00:20:24.483380+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.483380+0000","objects_scrubbed":0,"log_size":2900,"log_dups_size":0,"ondisk_log_size":2900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:38.705170+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42993,"num_write_kb":541677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"38'139","reported_seq":206,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.259287+0000","last_change":"2024-05-09T00:20:22.259363+0000","last_active":"2024-05-09T00:20:22.259287+0000","last_peered":"2024-05-09T00:20:22.259287+0000","last_clean":"2024-05-09T00:20:22.259287+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:20:22.259287+0000","last_undegraded":"2024-05-09T00:20:22.259287+0000","last_fullsized":"2024-05-09T00:20:22.259287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'139","last_scrub_stamp":"2024-05-09T00:20:22.259056+0000","last_deep_scrub":"38'139","last_deep_scrub_stamp":"2024-05-09T00:20:22.259056+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.259056+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:54.566501+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":135,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"38'3","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.712201+0000","last_change":"2024-05-09T00:20:16.712272+0000","last_active":"2024-05-09T00:20:16.712201+0000","last_peered":"2024-05-09T00:20:16.712201+0000","last_clean":"2024-05-09T00:20:16.712201+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:20:16.712201+0000","last_undegraded":"2024-05-09T00:20:16.712201+0000","last_fullsized":"2024-05-09T00:20:16.712201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:16.711981+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:16.711981+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.711981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:10.852015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"38'3203","reported_seq":3258,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.632878+0000","last_change":"2024-05-09T00:08:55.239323+0000","last_active":"2024-05-09T00:19:53.632878+0000","last_peered":"2024-05-09T00:19:53.632878+0000","last_clean":"2024-05-09T00:19:53.632878+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:19:53.632878+0000","last_undegraded":"2024-05-09T00:19:53.632878+0000","last_fullsized":"2024-05-09T00:19:53.632878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47433,"num_write_kb":581618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"38'2989","reported_seq":3054,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.785669+0000","last_change":"2024-05-09T00:20:18.785669+0000","last_active":"2024-05-09T00:20:18.785669+0000","last_peered":"2024-05-09T00:20:18.785669+0000","last_clean":"2024-05-09T00:20:18.785669+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:20:18.785669+0000","last_undegraded":"2024-05-09T00:20:18.785669+0000","last_fullsized":"2024-05-09T00:20:18.785669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2989","last_scrub_stamp":"2024-05-09T00:20:18.785326+0000","last_deep_scrub":"38'2989","last_deep_scrub_stamp":"2024-05-09T00:20:18.785326+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.785326+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:21.241067+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":44159,"num_write_kb":579264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"38'15","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.815671+0000","last_change":"2024-05-09T00:20:23.815756+0000","last_active":"2024-05-09T00:20:23.815671+0000","last_peered":"2024-05-09T00:20:23.815671+0000","last_clean":"2024-05-09T00:20:23.815671+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:20:23.815671+0000","last_undegraded":"2024-05-09T00:20:23.815671+0000","last_fullsized":"2024-05-09T00:20:23.815671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'15","last_scrub_stamp":"2024-05-09T00:20:23.815412+0000","last_deep_scrub":"38'15","last_deep_scrub_stamp":"2024-05-09T00:20:23.815412+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.815412+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:09.479068+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"38'4","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.457816+0000","last_change":"2024-05-09T00:20:22.457888+0000","last_active":"2024-05-09T00:20:22.457816+0000","last_peered":"2024-05-09T00:20:22.457816+0000","last_clean":"2024-05-09T00:20:22.457816+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:20:22.457816+0000","last_undegraded":"2024-05-09T00:20:22.457816+0000","last_fullsized":"2024-05-09T00:20:22.457816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:22.457566+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:22.457566+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.457566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:02.678652+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"38'3658","reported_seq":3724,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.799174+0000","last_change":"2024-05-09T00:20:11.799210+0000","last_active":"2024-05-09T00:20:11.799174+0000","last_peered":"2024-05-09T00:20:11.799174+0000","last_clean":"2024-05-09T00:20:11.799174+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:20:11.799174+0000","last_undegraded":"2024-05-09T00:20:11.799174+0000","last_fullsized":"2024-05-09T00:20:11.799174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3658","last_scrub_stamp":"2024-05-09T00:20:11.799045+0000","last_deep_scrub":"38'3658","last_deep_scrub_stamp":"2024-05-09T00:20:11.799045+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.799045+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:52.741711+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54120,"num_write_kb":669829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"38'3320","reported_seq":3386,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.781352+0000","last_change":"2024-05-09T00:20:11.781352+0000","last_active":"2024-05-09T00:20:11.781352+0000","last_peered":"2024-05-09T00:20:11.781352+0000","last_clean":"2024-05-09T00:20:11.781352+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:20:11.781352+0000","last_undegraded":"2024-05-09T00:20:11.781352+0000","last_fullsized":"2024-05-09T00:20:11.781352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3320","last_scrub_stamp":"2024-05-09T00:20:11.781141+0000","last_deep_scrub":"38'3320","last_deep_scrub_stamp":"2024-05-09T00:20:11.781141+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.781141+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:17.533082+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":48969,"num_write_kb":615876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"38'6","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.197914+0000","last_change":"2024-05-09T00:20:23.197981+0000","last_active":"2024-05-09T00:20:23.197914+0000","last_peered":"2024-05-09T00:20:23.197914+0000","last_clean":"2024-05-09T00:20:23.197914+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:20:23.197914+0000","last_undegraded":"2024-05-09T00:20:23.197914+0000","last_fullsized":"2024-05-09T00:20:23.197914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:23.197693+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:23.197693+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.197693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:09.198489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"38'3","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.427764+0000","last_change":"2024-05-09T00:20:18.427839+0000","last_active":"2024-05-09T00:20:18.427764+0000","last_peered":"2024-05-09T00:20:18.427764+0000","last_clean":"2024-05-09T00:20:18.427764+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:20:18.427764+0000","last_undegraded":"2024-05-09T00:20:18.427764+0000","last_fullsized":"2024-05-09T00:20:18.427764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:18.427378+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:18.427378+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.427378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:39.733226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"38'3403","reported_seq":3463,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.443444+0000","last_change":"2024-05-09T00:08:55.239683+0000","last_active":"2024-05-09T00:19:53.443444+0000","last_peered":"2024-05-09T00:19:53.443444+0000","last_clean":"2024-05-09T00:19:53.443444+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:19:53.443444+0000","last_undegraded":"2024-05-09T00:19:53.443444+0000","last_fullsized":"2024-05-09T00:19:53.443444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":50653,"num_write_kb":630818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'3543","reported_seq":3607,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.773621+0000","last_change":"2024-05-09T00:20:15.773692+0000","last_active":"2024-05-09T00:20:15.773621+0000","last_peered":"2024-05-09T00:20:15.773621+0000","last_clean":"2024-05-09T00:20:15.773621+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:20:15.773621+0000","last_undegraded":"2024-05-09T00:20:15.773621+0000","last_fullsized":"2024-05-09T00:20:15.773621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3543","last_scrub_stamp":"2024-05-09T00:20:15.773377+0000","last_deep_scrub":"38'3543","last_deep_scrub_stamp":"2024-05-09T00:20:15.773377+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.773377+0000","objects_scrubbed":0,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:38.809034+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":52618,"num_write_kb":653340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"38'5","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.883569+0000","last_change":"2024-05-09T00:08:44.092924+0000","last_active":"2024-05-09T00:20:10.883569+0000","last_peered":"2024-05-09T00:20:10.883569+0000","last_clean":"2024-05-09T00:20:10.883569+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:20:10.883569+0000","last_undegraded":"2024-05-09T00:20:10.883569+0000","last_fullsized":"2024-05-09T00:20:10.883569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"38'239","reported_seq":316,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.164953+0000","last_change":"2024-05-09T00:20:16.165037+0000","last_active":"2024-05-09T00:20:16.164953+0000","last_peered":"2024-05-09T00:20:16.164953+0000","last_clean":"2024-05-09T00:20:16.164953+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:20:16.164953+0000","last_undegraded":"2024-05-09T00:20:16.164953+0000","last_fullsized":"2024-05-09T00:20:16.164953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'239","last_scrub_stamp":"2024-05-09T00:20:16.164718+0000","last_deep_scrub":"38'239","last_deep_scrub_stamp":"2024-05-09T00:20:16.164718+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.164718+0000","objects_scrubbed":4,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:40.285377+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":16430,"num_write":227,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"38'4717","reported_seq":4781,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.648895+0000","last_change":"2024-05-09T00:08:55.234270+0000","last_active":"2024-05-09T00:19:53.648895+0000","last_peered":"2024-05-09T00:19:53.648895+0000","last_clean":"2024-05-09T00:19:53.648895+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:19:53.648895+0000","last_undegraded":"2024-05-09T00:19:53.648895+0000","last_fullsized":"2024-05-09T00:19:53.648895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":69946,"num_write_kb":894340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"38'2901","reported_seq":2967,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.145471+0000","last_change":"2024-05-09T00:20:26.145471+0000","last_active":"2024-05-09T00:20:26.145471+0000","last_peered":"2024-05-09T00:20:26.145471+0000","last_clean":"2024-05-09T00:20:26.145471+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:20:26.145471+0000","last_undegraded":"2024-05-09T00:20:26.145471+0000","last_fullsized":"2024-05-09T00:20:26.145471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2901","last_scrub_stamp":"2024-05-09T00:20:26.145175+0000","last_deep_scrub":"38'2901","last_deep_scrub_stamp":"2024-05-09T00:20:26.145175+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.145175+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":0,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:49.563816+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42843,"num_write_kb":549063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"38'203","reported_seq":279,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.853904+0000","last_change":"2024-05-09T00:20:15.853904+0000","last_active":"2024-05-09T00:20:15.853904+0000","last_peered":"2024-05-09T00:20:15.853904+0000","last_clean":"2024-05-09T00:20:15.853904+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:20:15.853904+0000","last_undegraded":"2024-05-09T00:20:15.853904+0000","last_fullsized":"2024-05-09T00:20:15.853904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'203","last_scrub_stamp":"2024-05-09T00:20:15.853570+0000","last_deep_scrub":"38'203","last_deep_scrub_stamp":"2024-05-09T00:20:15.853570+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.853570+0000","objects_scrubbed":4,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.816180+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":12336,"num_write":190,"num_write_kb":8288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"38'21","reported_seq":79,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.203508+0000","last_change":"2024-05-09T00:08:54.216003+0000","last_active":"2024-05-09T00:20:04.203508+0000","last_peered":"2024-05-09T00:20:04.203508+0000","last_clean":"2024-05-09T00:20:04.203508+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:20:04.203508+0000","last_undegraded":"2024-05-09T00:20:04.203508+0000","last_fullsized":"2024-05-09T00:20:04.203508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:53.146320+0000","last_clean_scrub_stamp":"2024-05-09T00:08:53.146320+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"38'4177","reported_seq":4235,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645296+0000","last_change":"2024-05-09T00:08:55.234510+0000","last_active":"2024-05-09T00:19:53.645296+0000","last_peered":"2024-05-09T00:19:53.645296+0000","last_clean":"2024-05-09T00:19:53.645296+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:19:53.645296+0000","last_undegraded":"2024-05-09T00:19:53.645296+0000","last_fullsized":"2024-05-09T00:19:53.645296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":61984,"num_write_kb":766120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"38'2855","reported_seq":2916,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.174412+0000","last_change":"2024-05-09T00:20:25.174578+0000","last_active":"2024-05-09T00:20:25.174412+0000","last_peered":"2024-05-09T00:20:25.174412+0000","last_clean":"2024-05-09T00:20:25.174412+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:20:25.174412+0000","last_undegraded":"2024-05-09T00:20:25.174412+0000","last_fullsized":"2024-05-09T00:20:25.174412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2855","last_scrub_stamp":"2024-05-09T00:20:25.174087+0000","last_deep_scrub":"38'2855","last_deep_scrub_stamp":"2024-05-09T00:20:25.174087+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.174087+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.999562+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":42236,"num_write_kb":541614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"38'243","reported_seq":334,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.434361+0000","last_change":"2024-05-09T00:20:20.434361+0000","last_active":"2024-05-09T00:20:20.434361+0000","last_peered":"2024-05-09T00:20:20.434361+0000","last_clean":"2024-05-09T00:20:20.434361+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:20:20.434361+0000","last_undegraded":"2024-05-09T00:20:20.434361+0000","last_fullsized":"2024-05-09T00:20:20.434361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'243","last_scrub_stamp":"2024-05-09T00:20:20.433935+0000","last_deep_scrub":"38'243","last_deep_scrub_stamp":"2024-05-09T00:20:20.433935+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.433935+0000","objects_scrubbed":4,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:04.054496+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":55,"num_read_kb":20534,"num_write":232,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"38'5","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.911225+0000","last_change":"2024-05-09T00:20:16.911293+0000","last_active":"2024-05-09T00:20:16.911225+0000","last_peered":"2024-05-09T00:20:16.911225+0000","last_clean":"2024-05-09T00:20:16.911225+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:20:16.911225+0000","last_undegraded":"2024-05-09T00:20:16.911225+0000","last_fullsized":"2024-05-09T00:20:16.911225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:16.910976+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:16.910976+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.910976+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:46.575556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"38'3435","reported_seq":3499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.122390+0000","last_change":"2024-05-09T00:20:29.122456+0000","last_active":"2024-05-09T00:20:29.122390+0000","last_peered":"2024-05-09T00:20:29.122390+0000","last_clean":"2024-05-09T00:20:29.122390+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:20:29.122390+0000","last_undegraded":"2024-05-09T00:20:29.122390+0000","last_fullsized":"2024-05-09T00:20:29.122390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3435","last_scrub_stamp":"2024-05-09T00:20:29.122177+0000","last_deep_scrub":"38'3435","last_deep_scrub_stamp":"2024-05-09T00:20:29.122177+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.122177+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:12.845603+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":50796,"num_write_kb":644347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"38'4141","reported_seq":4204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.762613+0000","last_change":"2024-05-09T00:20:20.762720+0000","last_active":"2024-05-09T00:20:20.762613+0000","last_peered":"2024-05-09T00:20:20.762613+0000","last_clean":"2024-05-09T00:20:20.762613+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:20:20.762613+0000","last_undegraded":"2024-05-09T00:20:20.762613+0000","last_fullsized":"2024-05-09T00:20:20.762613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4141","last_scrub_stamp":"2024-05-09T00:20:20.762349+0000","last_deep_scrub":"38'4141","last_deep_scrub_stamp":"2024-05-09T00:20:20.762349+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.762349+0000","objects_scrubbed":0,"log_size":4141,"log_dups_size":0,"ondisk_log_size":4141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:52.250224+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":61445,"num_write_kb":763576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"38'23","reported_seq":100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.779947+0000","last_change":"2024-05-09T00:20:16.780034+0000","last_active":"2024-05-09T00:20:16.779947+0000","last_peered":"2024-05-09T00:20:16.779947+0000","last_clean":"2024-05-09T00:20:16.779947+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:20:16.779947+0000","last_undegraded":"2024-05-09T00:20:16.779947+0000","last_fullsized":"2024-05-09T00:20:16.779947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'23","last_scrub_stamp":"2024-05-09T00:20:16.779548+0000","last_deep_scrub":"38'23","last_deep_scrub_stamp":"2024-05-09T00:20:16.779548+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.779548+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:08.012938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"38'51","reported_seq":117,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.371377+0000","last_change":"2024-05-09T00:20:13.371475+0000","last_active":"2024-05-09T00:20:13.371377+0000","last_peered":"2024-05-09T00:20:13.371377+0000","last_clean":"2024-05-09T00:20:13.371377+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:20:13.371377+0000","last_undegraded":"2024-05-09T00:20:13.371377+0000","last_fullsized":"2024-05-09T00:20:13.371377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'51","last_scrub_stamp":"2024-05-09T00:20:13.371135+0000","last_deep_scrub":"38'51","last_deep_scrub_stamp":"2024-05-09T00:20:13.371135+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.371135+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:12.652663+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20520,"num_write":39,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"38'3630","reported_seq":3696,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.776003+0000","last_change":"2024-05-09T00:20:13.776031+0000","last_active":"2024-05-09T00:20:13.776003+0000","last_peered":"2024-05-09T00:20:13.776003+0000","last_clean":"2024-05-09T00:20:13.776003+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:20:13.776003+0000","last_undegraded":"2024-05-09T00:20:13.776003+0000","last_fullsized":"2024-05-09T00:20:13.776003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3630","last_scrub_stamp":"2024-05-09T00:20:13.775902+0000","last_deep_scrub":"38'3630","last_deep_scrub_stamp":"2024-05-09T00:20:13.775902+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.775902+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:15.765630+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53585,"num_write_kb":685544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"38'2753","reported_seq":2819,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.568708+0000","last_change":"2024-05-09T00:20:13.568778+0000","last_active":"2024-05-09T00:20:13.568708+0000","last_peered":"2024-05-09T00:20:13.568708+0000","last_clean":"2024-05-09T00:20:13.568708+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:20:13.568708+0000","last_undegraded":"2024-05-09T00:20:13.568708+0000","last_fullsized":"2024-05-09T00:20:13.568708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2753","last_scrub_stamp":"2024-05-09T00:20:13.568452+0000","last_deep_scrub":"38'2753","last_deep_scrub_stamp":"2024-05-09T00:20:13.568452+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.568452+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:50.129039+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":40582,"num_write_kb":508970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"38'3","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.176758+0000","last_change":"2024-05-09T00:20:21.176824+0000","last_active":"2024-05-09T00:20:21.176758+0000","last_peered":"2024-05-09T00:20:21.176758+0000","last_clean":"2024-05-09T00:20:21.176758+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:20:21.176758+0000","last_undegraded":"2024-05-09T00:20:21.176758+0000","last_fullsized":"2024-05-09T00:20:21.176758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:21.176525+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:21.176525+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.176525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:39.931140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"38'16","reported_seq":96,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.827028+0000","last_change":"2024-05-09T00:20:20.827028+0000","last_active":"2024-05-09T00:20:20.827028+0000","last_peered":"2024-05-09T00:20:20.827028+0000","last_clean":"2024-05-09T00:20:20.827028+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:20:20.827028+0000","last_undegraded":"2024-05-09T00:20:20.827028+0000","last_fullsized":"2024-05-09T00:20:20.827028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'16","last_scrub_stamp":"2024-05-09T00:20:20.826671+0000","last_deep_scrub":"38'16","last_deep_scrub_stamp":"2024-05-09T00:20:20.826671+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.826671+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:44.726352+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"38'3942","reported_seq":4012,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.345391+0000","last_change":"2024-05-09T00:20:16.345391+0000","last_active":"2024-05-09T00:20:16.345391+0000","last_peered":"2024-05-09T00:20:16.345391+0000","last_clean":"2024-05-09T00:20:16.345391+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:20:16.345391+0000","last_undegraded":"2024-05-09T00:20:16.345391+0000","last_fullsized":"2024-05-09T00:20:16.345391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3942","last_scrub_stamp":"2024-05-09T00:20:16.345100+0000","last_deep_scrub":"38'3942","last_deep_scrub_stamp":"2024-05-09T00:20:16.345100+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.345100+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:18.304869+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":58547,"num_write_kb":727316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"38'3075","reported_seq":3141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.416645+0000","last_change":"2024-05-09T00:20:22.416711+0000","last_active":"2024-05-09T00:20:22.416645+0000","last_peered":"2024-05-09T00:20:22.416645+0000","last_clean":"2024-05-09T00:20:22.416645+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:20:22.416645+0000","last_undegraded":"2024-05-09T00:20:22.416645+0000","last_fullsized":"2024-05-09T00:20:22.416645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3075","last_scrub_stamp":"2024-05-09T00:20:22.416382+0000","last_deep_scrub":"38'3075","last_deep_scrub_stamp":"2024-05-09T00:20:22.416382+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.416382+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:46.523846+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":45259,"num_write_kb":566177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"38'3","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.767654+0000","last_change":"2024-05-09T00:20:10.767719+0000","last_active":"2024-05-09T00:20:10.767654+0000","last_peered":"2024-05-09T00:20:10.767654+0000","last_clean":"2024-05-09T00:20:10.767654+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:20:10.767654+0000","last_undegraded":"2024-05-09T00:20:10.767654+0000","last_fullsized":"2024-05-09T00:20:10.767654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:10.767407+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:10.767407+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.767407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:35.434460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"38'6","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.932054+0000","last_change":"2024-05-09T00:20:13.932054+0000","last_active":"2024-05-09T00:20:13.932054+0000","last_peered":"2024-05-09T00:20:13.932054+0000","last_clean":"2024-05-09T00:20:13.932054+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:20:13.932054+0000","last_undegraded":"2024-05-09T00:20:13.932054+0000","last_fullsized":"2024-05-09T00:20:13.932054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:13.931624+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:13.931624+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.931624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.664006+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4386","reported_seq":4452,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.480852+0000","last_change":"2024-05-09T00:20:28.481003+0000","last_active":"2024-05-09T00:20:28.480852+0000","last_peered":"2024-05-09T00:20:28.480852+0000","last_clean":"2024-05-09T00:20:28.480852+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:20:28.480852+0000","last_undegraded":"2024-05-09T00:20:28.480852+0000","last_fullsized":"2024-05-09T00:20:28.480852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4386","last_scrub_stamp":"2024-05-09T00:20:28.480588+0000","last_deep_scrub":"38'4386","last_deep_scrub_stamp":"2024-05-09T00:20:28.480588+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.480588+0000","objects_scrubbed":0,"log_size":4386,"log_dups_size":0,"ondisk_log_size":4386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:09.816852+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":64971,"num_write_kb":841081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"38'50","reported_seq":105,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.892728+0000","last_change":"2024-05-09T00:20:11.892810+0000","last_active":"2024-05-09T00:20:11.892728+0000","last_peered":"2024-05-09T00:20:11.892728+0000","last_clean":"2024-05-09T00:20:11.892728+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:20:11.892728+0000","last_undegraded":"2024-05-09T00:20:11.892728+0000","last_fullsized":"2024-05-09T00:20:11.892728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'50","last_scrub_stamp":"2024-05-09T00:20:11.892434+0000","last_deep_scrub":"38'50","last_deep_scrub_stamp":"2024-05-09T00:20:11.892434+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.892434+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:35.120535+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":42,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"38'3567","reported_seq":3632,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.916229+0000","last_change":"2024-05-09T00:20:27.916295+0000","last_active":"2024-05-09T00:20:27.916229+0000","last_peered":"2024-05-09T00:20:27.916229+0000","last_clean":"2024-05-09T00:20:27.916229+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:20:27.916229+0000","last_undegraded":"2024-05-09T00:20:27.916229+0000","last_fullsized":"2024-05-09T00:20:27.916229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3567","last_scrub_stamp":"2024-05-09T00:20:27.915998+0000","last_deep_scrub":"38'3567","last_deep_scrub_stamp":"2024-05-09T00:20:27.915998+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.915998+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:31.782513+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":52856,"num_write_kb":662790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"38'41","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.076632+0000","last_change":"2024-05-09T00:08:44.093358+0000","last_active":"2024-05-09T00:20:04.076632+0000","last_peered":"2024-05-09T00:20:04.076632+0000","last_clean":"2024-05-09T00:20:04.076632+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:20:04.076632+0000","last_undegraded":"2024-05-09T00:20:04.076632+0000","last_fullsized":"2024-05-09T00:20:04.076632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":37,"num_write_kb":8217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3892","reported_seq":3954,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.508814+0000","last_change":"2024-05-09T00:08:55.218964+0000","last_active":"2024-05-09T00:19:53.508814+0000","last_peered":"2024-05-09T00:19:53.508814+0000","last_clean":"2024-05-09T00:19:53.508814+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:19:53.508814+0000","last_undegraded":"2024-05-09T00:19:53.508814+0000","last_fullsized":"2024-05-09T00:19:53.508814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":57751,"num_write_kb":734560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"38'37","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.663660+0000","last_change":"2024-05-09T00:20:28.663743+0000","last_active":"2024-05-09T00:20:28.663660+0000","last_peered":"2024-05-09T00:20:28.663660+0000","last_clean":"2024-05-09T00:20:28.663660+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:20:28.663660+0000","last_undegraded":"2024-05-09T00:20:28.663660+0000","last_fullsized":"2024-05-09T00:20:28.663660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'37","last_scrub_stamp":"2024-05-09T00:20:28.663398+0000","last_deep_scrub":"38'37","last_deep_scrub_stamp":"2024-05-09T00:20:28.663398+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.663398+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:20.036427+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":16404,"num_write":31,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2980","reported_seq":3036,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.092811+0000","last_change":"2024-05-09T00:08:45.097180+0000","last_active":"2024-05-09T00:20:04.092811+0000","last_peered":"2024-05-09T00:20:04.092811+0000","last_clean":"2024-05-09T00:20:04.092811+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:20:04.092811+0000","last_undegraded":"2024-05-09T00:20:04.092811+0000","last_fullsized":"2024-05-09T00:20:04.092811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":43962,"num_write_kb":568639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"38'4","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.260172+0000","last_change":"2024-05-09T00:20:20.260243+0000","last_active":"2024-05-09T00:20:20.260172+0000","last_peered":"2024-05-09T00:20:20.260172+0000","last_clean":"2024-05-09T00:20:20.260172+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:20:20.260172+0000","last_undegraded":"2024-05-09T00:20:20.260172+0000","last_fullsized":"2024-05-09T00:20:20.260172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:20.259931+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:20.259931+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.259931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:54.712656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"38'4410","reported_seq":4473,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.640160+0000","last_change":"2024-05-09T00:08:55.237366+0000","last_active":"2024-05-09T00:19:53.640160+0000","last_peered":"2024-05-09T00:19:53.640160+0000","last_clean":"2024-05-09T00:19:53.640160+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:19:53.640160+0000","last_undegraded":"2024-05-09T00:19:53.640160+0000","last_fullsized":"2024-05-09T00:19:53.640160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":65571,"num_write_kb":822347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"38'31","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.073897+0000","last_change":"2024-05-09T00:08:44.097675+0000","last_active":"2024-05-09T00:20:04.073897+0000","last_peered":"2024-05-09T00:20:04.073897+0000","last_clean":"2024-05-09T00:20:04.073897+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:20:04.073897+0000","last_undegraded":"2024-05-09T00:20:04.073897+0000","last_fullsized":"2024-05-09T00:20:04.073897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:43.024615+0000","last_clean_scrub_stamp":"2024-05-09T00:08:43.024615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2411","reported_seq":2470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.938794+0000","last_change":"2024-05-09T00:20:15.938934+0000","last_active":"2024-05-09T00:20:15.938794+0000","last_peered":"2024-05-09T00:20:15.938794+0000","last_clean":"2024-05-09T00:20:15.938794+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:20:15.938794+0000","last_undegraded":"2024-05-09T00:20:15.938794+0000","last_fullsized":"2024-05-09T00:20:15.938794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2411","last_scrub_stamp":"2024-05-09T00:20:15.938500+0000","last_deep_scrub":"38'2411","last_deep_scrub_stamp":"2024-05-09T00:20:15.938500+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.938500+0000","objects_scrubbed":0,"log_size":2411,"log_dups_size":0,"ondisk_log_size":2411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:37.037260+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":35584,"num_write_kb":447799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"38'22","reported_seq":86,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.927300+0000","last_change":"2024-05-09T00:20:14.927376+0000","last_active":"2024-05-09T00:20:14.927300+0000","last_peered":"2024-05-09T00:20:14.927300+0000","last_clean":"2024-05-09T00:20:14.927300+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:20:14.927300+0000","last_undegraded":"2024-05-09T00:20:14.927300+0000","last_fullsized":"2024-05-09T00:20:14.927300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'22","last_scrub_stamp":"2024-05-09T00:20:14.927074+0000","last_deep_scrub":"38'22","last_deep_scrub_stamp":"2024-05-09T00:20:14.927074+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.927074+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:28.478375+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2608","reported_seq":2665,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.648744+0000","last_change":"2024-05-09T00:08:55.242103+0000","last_active":"2024-05-09T00:19:53.648744+0000","last_peered":"2024-05-09T00:19:53.648744+0000","last_clean":"2024-05-09T00:19:53.648744+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:19:53.648744+0000","last_undegraded":"2024-05-09T00:19:53.648744+0000","last_fullsized":"2024-05-09T00:19:53.648744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":2608,"log_dups_size":0,"ondisk_log_size":2608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":38767,"num_write_kb":481995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"38'1148","reported_seq":1212,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.553103+0000","last_change":"2024-05-09T00:20:27.553184+0000","last_active":"2024-05-09T00:20:27.553103+0000","last_peered":"2024-05-09T00:20:27.553103+0000","last_clean":"2024-05-09T00:20:27.553103+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:20:27.553103+0000","last_undegraded":"2024-05-09T00:20:27.553103+0000","last_fullsized":"2024-05-09T00:20:27.553103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1148","last_scrub_stamp":"2024-05-09T00:20:27.552887+0000","last_deep_scrub":"38'1148","last_deep_scrub_stamp":"2024-05-09T00:20:27.552887+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.552887+0000","objects_scrubbed":1,"log_size":1148,"log_dups_size":0,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:35.020953+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1144,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2597","reported_seq":2657,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.747644+0000","last_change":"2024-05-09T00:20:12.747700+0000","last_active":"2024-05-09T00:20:12.747644+0000","last_peered":"2024-05-09T00:20:12.747644+0000","last_clean":"2024-05-09T00:20:12.747644+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:20:12.747644+0000","last_undegraded":"2024-05-09T00:20:12.747644+0000","last_fullsized":"2024-05-09T00:20:12.747644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2597","last_scrub_stamp":"2024-05-09T00:20:12.747484+0000","last_deep_scrub":"38'2597","last_deep_scrub_stamp":"2024-05-09T00:20:12.747484+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.747484+0000","objects_scrubbed":0,"log_size":2597,"log_dups_size":0,"ondisk_log_size":2597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:28.339175+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":38330,"num_write_kb":482954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"38'95","reported_seq":165,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.956333+0000","last_change":"2024-05-09T00:20:21.956415+0000","last_active":"2024-05-09T00:20:21.956333+0000","last_peered":"2024-05-09T00:20:21.956333+0000","last_clean":"2024-05-09T00:20:21.956333+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:20:21.956333+0000","last_undegraded":"2024-05-09T00:20:21.956333+0000","last_fullsized":"2024-05-09T00:20:21.956333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'95","last_scrub_stamp":"2024-05-09T00:20:21.956084+0000","last_deep_scrub":"38'95","last_deep_scrub_stamp":"2024-05-09T00:20:21.956084+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.956084+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:42.244880+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":30171,"num_write":78,"num_write_kb":12339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"38'3350","reported_seq":3398,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.592797+0000","last_change":"2024-05-09T00:09:31.619347+0000","last_active":"2024-05-09T00:20:12.592797+0000","last_peered":"2024-05-09T00:20:12.592797+0000","last_clean":"2024-05-09T00:20:12.592797+0000","last_became_active":"2024-05-09T00:09:31.617773+0000","last_became_peered":"2024-05-09T00:09:31.617773+0000","last_unstale":"2024-05-09T00:20:12.592797+0000","last_undegraded":"2024-05-09T00:20:12.592797+0000","last_fullsized":"2024-05-09T00:20:12.592797+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":49731,"num_write_kb":622162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"38'3807","reported_seq":3871,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.384757+0000","last_change":"2024-05-09T00:20:21.384825+0000","last_active":"2024-05-09T00:20:21.384757+0000","last_peered":"2024-05-09T00:20:21.384757+0000","last_clean":"2024-05-09T00:20:21.384757+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:20:21.384757+0000","last_undegraded":"2024-05-09T00:20:21.384757+0000","last_fullsized":"2024-05-09T00:20:21.384757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3807","last_scrub_stamp":"2024-05-09T00:20:21.384526+0000","last_deep_scrub":"38'3807","last_deep_scrub_stamp":"2024-05-09T00:20:21.384526+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.384526+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:21.210461+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56537,"num_write_kb":719929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"38'4248","reported_seq":4305,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.774392+0000","last_change":"2024-05-09T00:08:55.236231+0000","last_active":"2024-05-09T00:19:56.774392+0000","last_peered":"2024-05-09T00:19:56.774392+0000","last_clean":"2024-05-09T00:19:56.774392+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:19:56.774392+0000","last_undegraded":"2024-05-09T00:19:56.774392+0000","last_fullsized":"2024-05-09T00:19:56.774392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":62726,"num_write_kb":786275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"38'3362","reported_seq":3422,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.850430+0000","last_change":"2024-05-09T00:20:18.850490+0000","last_active":"2024-05-09T00:20:18.850430+0000","last_peered":"2024-05-09T00:20:18.850430+0000","last_clean":"2024-05-09T00:20:18.850430+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:20:18.850430+0000","last_undegraded":"2024-05-09T00:20:18.850430+0000","last_fullsized":"2024-05-09T00:20:18.850430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3362","last_scrub_stamp":"2024-05-09T00:20:18.850284+0000","last_deep_scrub":"38'3362","last_deep_scrub_stamp":"2024-05-09T00:20:18.850284+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.850284+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:40.073477+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":49795,"num_write_kb":622024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"38'3281","reported_seq":3346,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.411245+0000","last_change":"2024-05-09T00:20:18.411314+0000","last_active":"2024-05-09T00:20:18.411245+0000","last_peered":"2024-05-09T00:20:18.411245+0000","last_clean":"2024-05-09T00:20:18.411245+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:20:18.411245+0000","last_undegraded":"2024-05-09T00:20:18.411245+0000","last_fullsized":"2024-05-09T00:20:18.411245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3281","last_scrub_stamp":"2024-05-09T00:20:18.411008+0000","last_deep_scrub":"38'3281","last_deep_scrub_stamp":"2024-05-09T00:20:18.411008+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.411008+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:51.464836+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":48739,"num_write_kb":615858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"38'3810","reported_seq":3872,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.765337+0000","last_change":"2024-05-09T00:20:19.765504+0000","last_active":"2024-05-09T00:20:19.765337+0000","last_peered":"2024-05-09T00:20:19.765337+0000","last_clean":"2024-05-09T00:20:19.765337+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:20:19.765337+0000","last_undegraded":"2024-05-09T00:20:19.765337+0000","last_fullsized":"2024-05-09T00:20:19.765337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3810","last_scrub_stamp":"2024-05-09T00:20:19.765077+0000","last_deep_scrub":"38'3810","last_deep_scrub_stamp":"2024-05-09T00:20:19.765077+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.765077+0000","objects_scrubbed":0,"log_size":3810,"log_dups_size":0,"ondisk_log_size":3810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:53.849417+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":56385,"num_write_kb":712291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"38'3855","reported_seq":3922,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645907+0000","last_change":"2024-05-09T00:08:55.237055+0000","last_active":"2024-05-09T00:19:53.645907+0000","last_peered":"2024-05-09T00:19:53.645907+0000","last_clean":"2024-05-09T00:19:53.645907+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:19:53.645907+0000","last_undegraded":"2024-05-09T00:19:53.645907+0000","last_fullsized":"2024-05-09T00:19:53.645907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":57187,"num_write_kb":738779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"38'2596","reported_seq":2660,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.505439+0000","last_change":"2024-05-09T00:20:30.505512+0000","last_active":"2024-05-09T00:20:30.505439+0000","last_peered":"2024-05-09T00:20:30.505439+0000","last_clean":"2024-05-09T00:20:30.505439+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:20:30.505439+0000","last_undegraded":"2024-05-09T00:20:30.505439+0000","last_fullsized":"2024-05-09T00:20:30.505439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2596","last_scrub_stamp":"2024-05-09T00:20:30.505214+0000","last_deep_scrub":"38'2596","last_deep_scrub_stamp":"2024-05-09T00:20:30.505214+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.505214+0000","objects_scrubbed":0,"log_size":2596,"log_dups_size":0,"ondisk_log_size":2596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:48.426751+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":38426,"num_write_kb":503771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"38'4370","reported_seq":4445,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.215284+0000","last_change":"2024-05-09T00:20:31.215354+0000","last_active":"2024-05-09T00:20:31.215284+0000","last_peered":"2024-05-09T00:20:31.215284+0000","last_clean":"2024-05-09T00:20:31.215284+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:20:31.215284+0000","last_undegraded":"2024-05-09T00:20:31.215284+0000","last_fullsized":"2024-05-09T00:20:31.215284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4370","last_scrub_stamp":"2024-05-09T00:20:31.215046+0000","last_deep_scrub":"38'4370","last_deep_scrub_stamp":"2024-05-09T00:20:31.215046+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.215046+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:47.643877+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":64728,"num_write_kb":825535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"38'2760","reported_seq":2821,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.199180+0000","last_change":"2024-05-09T00:20:17.199248+0000","last_active":"2024-05-09T00:20:17.199180+0000","last_peered":"2024-05-09T00:20:17.199180+0000","last_clean":"2024-05-09T00:20:17.199180+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:20:17.199180+0000","last_undegraded":"2024-05-09T00:20:17.199180+0000","last_fullsized":"2024-05-09T00:20:17.199180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2760","last_scrub_stamp":"2024-05-09T00:20:17.198952+0000","last_deep_scrub":"38'2760","last_deep_scrub_stamp":"2024-05-09T00:20:17.198952+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.198952+0000","objects_scrubbed":0,"log_size":2760,"log_dups_size":0,"ondisk_log_size":2760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:59.115446+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40728,"num_write_kb":512798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"38'3218","reported_seq":3282,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.602967+0000","last_change":"2024-05-09T00:09:31.551214+0000","last_active":"2024-05-09T00:19:53.602967+0000","last_peered":"2024-05-09T00:19:53.602967+0000","last_clean":"2024-05-09T00:19:53.602967+0000","last_became_active":"2024-05-09T00:09:31.550552+0000","last_became_peered":"2024-05-09T00:09:31.550552+0000","last_unstale":"2024-05-09T00:19:53.602967+0000","last_undegraded":"2024-05-09T00:19:53.602967+0000","last_fullsized":"2024-05-09T00:19:53.602967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":47610,"num_write_kb":596071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"38'3281","reported_seq":3341,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.224365+0000","last_change":"2024-05-09T00:20:23.224501+0000","last_active":"2024-05-09T00:20:23.224365+0000","last_peered":"2024-05-09T00:20:23.224365+0000","last_clean":"2024-05-09T00:20:23.224365+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:20:23.224365+0000","last_undegraded":"2024-05-09T00:20:23.224365+0000","last_fullsized":"2024-05-09T00:20:23.224365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3281","last_scrub_stamp":"2024-05-09T00:20:23.224081+0000","last_deep_scrub":"38'3281","last_deep_scrub_stamp":"2024-05-09T00:20:23.224081+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.224081+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:37.209272+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":48628,"num_write_kb":610539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"38'4466","reported_seq":4535,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.803902+0000","last_change":"2024-05-09T00:20:12.803972+0000","last_active":"2024-05-09T00:20:12.803902+0000","last_peered":"2024-05-09T00:20:12.803902+0000","last_clean":"2024-05-09T00:20:12.803902+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:20:12.803902+0000","last_undegraded":"2024-05-09T00:20:12.803902+0000","last_fullsized":"2024-05-09T00:20:12.803902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4466","last_scrub_stamp":"2024-05-09T00:20:12.803616+0000","last_deep_scrub":"38'4466","last_deep_scrub_stamp":"2024-05-09T00:20:12.803616+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.803616+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:13.927769+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":66102,"num_write_kb":855861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"38'2915","reported_seq":2976,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.489244+0000","last_change":"2024-05-09T00:20:27.489310+0000","last_active":"2024-05-09T00:20:27.489244+0000","last_peered":"2024-05-09T00:20:27.489244+0000","last_clean":"2024-05-09T00:20:27.489244+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:20:27.489244+0000","last_undegraded":"2024-05-09T00:20:27.489244+0000","last_fullsized":"2024-05-09T00:20:27.489244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2915","last_scrub_stamp":"2024-05-09T00:20:27.489014+0000","last_deep_scrub":"38'2915","last_deep_scrub_stamp":"2024-05-09T00:20:27.489014+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.489014+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:32.319227+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":43083,"num_write_kb":548362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"38'3894","reported_seq":3954,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.504183+0000","last_change":"2024-05-09T00:08:55.218141+0000","last_active":"2024-05-09T00:19:53.504183+0000","last_peered":"2024-05-09T00:19:53.504183+0000","last_clean":"2024-05-09T00:19:53.504183+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:19:53.504183+0000","last_undegraded":"2024-05-09T00:19:53.504183+0000","last_fullsized":"2024-05-09T00:19:53.504183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":57917,"num_write_kb":734296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"38'3613","reported_seq":3678,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.446836+0000","last_change":"2024-05-09T00:20:21.446908+0000","last_active":"2024-05-09T00:20:21.446836+0000","last_peered":"2024-05-09T00:20:21.446836+0000","last_clean":"2024-05-09T00:20:21.446836+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:20:21.446836+0000","last_undegraded":"2024-05-09T00:20:21.446836+0000","last_fullsized":"2024-05-09T00:20:21.446836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3613","last_scrub_stamp":"2024-05-09T00:20:21.446563+0000","last_deep_scrub":"38'3613","last_deep_scrub_stamp":"2024-05-09T00:20:21.446563+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.446563+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:55.268681+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":53572,"num_write_kb":689167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"38'3075","reported_seq":3139,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.869282+0000","last_change":"2024-05-09T00:20:26.869356+0000","last_active":"2024-05-09T00:20:26.869282+0000","last_peered":"2024-05-09T00:20:26.869282+0000","last_clean":"2024-05-09T00:20:26.869282+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:20:26.869282+0000","last_undegraded":"2024-05-09T00:20:26.869282+0000","last_fullsized":"2024-05-09T00:20:26.869282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3075","last_scrub_stamp":"2024-05-09T00:20:26.869032+0000","last_deep_scrub":"38'3075","last_deep_scrub_stamp":"2024-05-09T00:20:26.869032+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.869032+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:10.304940+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45134,"num_write_kb":543879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"38'2785","reported_seq":2846,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.714158+0000","last_change":"2024-05-09T00:20:21.714225+0000","last_active":"2024-05-09T00:20:21.714158+0000","last_peered":"2024-05-09T00:20:21.714158+0000","last_clean":"2024-05-09T00:20:21.714158+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:20:21.714158+0000","last_undegraded":"2024-05-09T00:20:21.714158+0000","last_fullsized":"2024-05-09T00:20:21.714158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2785","last_scrub_stamp":"2024-05-09T00:20:21.713933+0000","last_deep_scrub":"38'2785","last_deep_scrub_stamp":"2024-05-09T00:20:21.713933+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.713933+0000","objects_scrubbed":0,"log_size":2785,"log_dups_size":0,"ondisk_log_size":2785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:16.638047+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":41154,"num_write_kb":511430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"38'4375","reported_seq":4437,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.541476+0000","last_change":"2024-05-09T00:08:55.221506+0000","last_active":"2024-05-09T00:19:53.541476+0000","last_peered":"2024-05-09T00:19:53.541476+0000","last_clean":"2024-05-09T00:19:53.541476+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:19:53.541476+0000","last_undegraded":"2024-05-09T00:19:53.541476+0000","last_fullsized":"2024-05-09T00:19:53.541476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":64891,"num_write_kb":820909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"38'3014","reported_seq":3077,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.535814+0000","last_change":"2024-05-09T00:20:14.535884+0000","last_active":"2024-05-09T00:20:14.535814+0000","last_peered":"2024-05-09T00:20:14.535814+0000","last_clean":"2024-05-09T00:20:14.535814+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:20:14.535814+0000","last_undegraded":"2024-05-09T00:20:14.535814+0000","last_fullsized":"2024-05-09T00:20:14.535814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3014","last_scrub_stamp":"2024-05-09T00:20:14.535546+0000","last_deep_scrub":"38'3014","last_deep_scrub_stamp":"2024-05-09T00:20:14.535546+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.535546+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:56.457133+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44654,"num_write_kb":570209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"38'3563","reported_seq":3623,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.477129+0000","last_change":"2024-05-09T00:08:55.234969+0000","last_active":"2024-05-09T00:20:13.477129+0000","last_peered":"2024-05-09T00:20:13.477129+0000","last_clean":"2024-05-09T00:20:13.477129+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:20:13.477129+0000","last_undegraded":"2024-05-09T00:20:13.477129+0000","last_fullsized":"2024-05-09T00:20:13.477129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":52470,"num_write_kb":678263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"38'3369","reported_seq":3431,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.782404+0000","last_change":"2024-05-09T00:20:13.782540+0000","last_active":"2024-05-09T00:20:13.782404+0000","last_peered":"2024-05-09T00:20:13.782404+0000","last_clean":"2024-05-09T00:20:13.782404+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:20:13.782404+0000","last_undegraded":"2024-05-09T00:20:13.782404+0000","last_fullsized":"2024-05-09T00:20:13.782404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3369","last_scrub_stamp":"2024-05-09T00:20:13.782116+0000","last_deep_scrub":"38'3369","last_deep_scrub_stamp":"2024-05-09T00:20:13.782116+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.782116+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:18.834535+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":49853,"num_write_kb":630819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"38'3672","reported_seq":3741,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.905174+0000","last_change":"2024-05-09T00:20:25.905241+0000","last_active":"2024-05-09T00:20:25.905174+0000","last_peered":"2024-05-09T00:20:25.905174+0000","last_clean":"2024-05-09T00:20:25.905174+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:20:25.905174+0000","last_undegraded":"2024-05-09T00:20:25.905174+0000","last_fullsized":"2024-05-09T00:20:25.905174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3672","last_scrub_stamp":"2024-05-09T00:20:25.904945+0000","last_deep_scrub":"38'3672","last_deep_scrub_stamp":"2024-05-09T00:20:25.904945+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.904945+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:09.773930+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":54179,"num_write_kb":674825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"38'3222","reported_seq":3290,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.883806+0000","last_change":"2024-05-09T00:20:21.883949+0000","last_active":"2024-05-09T00:20:21.883806+0000","last_peered":"2024-05-09T00:20:21.883806+0000","last_clean":"2024-05-09T00:20:21.883806+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:20:21.883806+0000","last_undegraded":"2024-05-09T00:20:21.883806+0000","last_fullsized":"2024-05-09T00:20:21.883806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3222","last_scrub_stamp":"2024-05-09T00:20:21.883403+0000","last_deep_scrub":"38'3222","last_deep_scrub_stamp":"2024-05-09T00:20:21.883403+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.883403+0000","objects_scrubbed":0,"log_size":3222,"log_dups_size":0,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:15.054311+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":47611,"num_write_kb":602581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"38'3892","reported_seq":3954,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.051273+0000","last_change":"2024-05-09T00:09:31.545900+0000","last_active":"2024-05-09T00:20:10.051273+0000","last_peered":"2024-05-09T00:20:10.051273+0000","last_clean":"2024-05-09T00:20:10.051273+0000","last_became_active":"2024-05-09T00:09:31.545211+0000","last_became_peered":"2024-05-09T00:09:31.545211+0000","last_unstale":"2024-05-09T00:20:10.051273+0000","last_undegraded":"2024-05-09T00:20:10.051273+0000","last_fullsized":"2024-05-09T00:20:10.051273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":57743,"num_write_kb":746959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"38'3008","reported_seq":3069,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.112345+0000","last_change":"2024-05-09T00:20:10.112378+0000","last_active":"2024-05-09T00:20:10.112345+0000","last_peered":"2024-05-09T00:20:10.112345+0000","last_clean":"2024-05-09T00:20:10.112345+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:20:10.112345+0000","last_undegraded":"2024-05-09T00:20:10.112345+0000","last_fullsized":"2024-05-09T00:20:10.112345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3008","last_scrub_stamp":"2024-05-09T00:20:10.112226+0000","last_deep_scrub":"38'3008","last_deep_scrub_stamp":"2024-05-09T00:20:10.112226+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.112226+0000","objects_scrubbed":0,"log_size":3008,"log_dups_size":0,"ondisk_log_size":3008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:04.325861+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":44592,"num_write_kb":561827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"38'3782","reported_seq":3851,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.122510+0000","last_change":"2024-05-09T00:20:27.122579+0000","last_active":"2024-05-09T00:20:27.122510+0000","last_peered":"2024-05-09T00:20:27.122510+0000","last_clean":"2024-05-09T00:20:27.122510+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:20:27.122510+0000","last_undegraded":"2024-05-09T00:20:27.122510+0000","last_fullsized":"2024-05-09T00:20:27.122510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3782","last_scrub_stamp":"2024-05-09T00:20:27.122270+0000","last_deep_scrub":"38'3782","last_deep_scrub_stamp":"2024-05-09T00:20:27.122270+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.122270+0000","objects_scrubbed":0,"log_size":3782,"log_dups_size":0,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:32.797955+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":56061,"num_write_kb":704361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"38'3143","reported_seq":3204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.683494+0000","last_change":"2024-05-09T00:20:23.683566+0000","last_active":"2024-05-09T00:20:23.683494+0000","last_peered":"2024-05-09T00:20:23.683494+0000","last_clean":"2024-05-09T00:20:23.683494+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:20:23.683494+0000","last_undegraded":"2024-05-09T00:20:23.683494+0000","last_fullsized":"2024-05-09T00:20:23.683494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3143","last_scrub_stamp":"2024-05-09T00:20:23.683221+0000","last_deep_scrub":"38'3143","last_deep_scrub_stamp":"2024-05-09T00:20:23.683221+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.683221+0000","objects_scrubbed":0,"log_size":3143,"log_dups_size":0,"ondisk_log_size":3143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:23.490984+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":46620,"num_write_kb":572561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"38'3200","reported_seq":3256,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:56.156143+0000","last_change":"2024-05-09T00:08:55.233494+0000","last_active":"2024-05-09T00:19:56.156143+0000","last_peered":"2024-05-09T00:19:56.156143+0000","last_clean":"2024-05-09T00:19:56.156143+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:19:56.156143+0000","last_undegraded":"2024-05-09T00:19:56.156143+0000","last_fullsized":"2024-05-09T00:19:56.156143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47638,"num_write_kb":598134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"38'2549","reported_seq":2619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.868621+0000","last_change":"2024-05-09T00:20:19.868727+0000","last_active":"2024-05-09T00:20:19.868621+0000","last_peered":"2024-05-09T00:20:19.868621+0000","last_clean":"2024-05-09T00:20:19.868621+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:20:19.868621+0000","last_undegraded":"2024-05-09T00:20:19.868621+0000","last_fullsized":"2024-05-09T00:20:19.868621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2549","last_scrub_stamp":"2024-05-09T00:20:19.868405+0000","last_deep_scrub":"38'2549","last_deep_scrub_stamp":"2024-05-09T00:20:19.868405+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.868405+0000","objects_scrubbed":0,"log_size":2549,"log_dups_size":0,"ondisk_log_size":2549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:34.779534+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":37364,"num_write_kb":466647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"38'3628","reported_seq":3687,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:04.944891+0000","last_change":"2024-05-09T00:08:55.210577+0000","last_active":"2024-05-09T00:20:04.944891+0000","last_peered":"2024-05-09T00:20:04.944891+0000","last_clean":"2024-05-09T00:20:04.944891+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:20:04.944891+0000","last_undegraded":"2024-05-09T00:20:04.944891+0000","last_fullsized":"2024-05-09T00:20:04.944891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53577,"num_write_kb":665989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"38'3771","reported_seq":3829,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.884130+0000","last_change":"2024-05-09T00:09:31.551757+0000","last_active":"2024-05-09T00:20:10.884130+0000","last_peered":"2024-05-09T00:20:10.884130+0000","last_clean":"2024-05-09T00:20:10.884130+0000","last_became_active":"2024-05-09T00:09:31.551042+0000","last_became_peered":"2024-05-09T00:09:31.551042+0000","last_unstale":"2024-05-09T00:20:10.884130+0000","last_undegraded":"2024-05-09T00:20:10.884130+0000","last_fullsized":"2024-05-09T00:20:10.884130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:44.039628+0000","last_clean_scrub_stamp":"2024-05-09T00:08:44.039628+0000","objects_scrubbed":0,"log_size":3771,"log_dups_size":0,"ondisk_log_size":3771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":55729,"num_write_kb":713868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"38'4117","reported_seq":4186,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.928490+0000","last_change":"2024-05-09T00:20:18.928558+0000","last_active":"2024-05-09T00:20:18.928490+0000","last_peered":"2024-05-09T00:20:18.928490+0000","last_clean":"2024-05-09T00:20:18.928490+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:20:18.928490+0000","last_undegraded":"2024-05-09T00:20:18.928490+0000","last_fullsized":"2024-05-09T00:20:18.928490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4117","last_scrub_stamp":"2024-05-09T00:20:18.928249+0000","last_deep_scrub":"38'4117","last_deep_scrub_stamp":"2024-05-09T00:20:18.928249+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.928249+0000","objects_scrubbed":0,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:23.823874+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":60808,"num_write_kb":797910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"38'2692","reported_seq":2753,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.756804+0000","last_change":"2024-05-09T00:20:16.756872+0000","last_active":"2024-05-09T00:20:16.756804+0000","last_peered":"2024-05-09T00:20:16.756804+0000","last_clean":"2024-05-09T00:20:16.756804+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:20:16.756804+0000","last_undegraded":"2024-05-09T00:20:16.756804+0000","last_fullsized":"2024-05-09T00:20:16.756804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2692","last_scrub_stamp":"2024-05-09T00:20:16.756574+0000","last_deep_scrub":"38'2692","last_deep_scrub_stamp":"2024-05-09T00:20:16.756574+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.756574+0000","objects_scrubbed":0,"log_size":2692,"log_dups_size":0,"ondisk_log_size":2692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:06.864332+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":39850,"num_write_kb":524211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"38'4344","reported_seq":4416,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.701161+0000","last_change":"2024-05-09T00:20:23.701228+0000","last_active":"2024-05-09T00:20:23.701161+0000","last_peered":"2024-05-09T00:20:23.701161+0000","last_clean":"2024-05-09T00:20:23.701161+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:20:23.701161+0000","last_undegraded":"2024-05-09T00:20:23.701161+0000","last_fullsized":"2024-05-09T00:20:23.701161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4344","last_scrub_stamp":"2024-05-09T00:20:23.700946+0000","last_deep_scrub":"38'4344","last_deep_scrub_stamp":"2024-05-09T00:20:23.700946+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.700946+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:37:00.348753+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":64402,"num_write_kb":850383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"38'3032","reported_seq":3098,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.494098+0000","last_change":"2024-05-09T00:20:15.494178+0000","last_active":"2024-05-09T00:20:15.494098+0000","last_peered":"2024-05-09T00:20:15.494098+0000","last_clean":"2024-05-09T00:20:15.494098+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:20:15.494098+0000","last_undegraded":"2024-05-09T00:20:15.494098+0000","last_fullsized":"2024-05-09T00:20:15.494098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3032","last_scrub_stamp":"2024-05-09T00:20:15.493865+0000","last_deep_scrub":"38'3032","last_deep_scrub_stamp":"2024-05-09T00:20:15.493865+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.493865+0000","objects_scrubbed":0,"log_size":3032,"log_dups_size":0,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:42.879748+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":44827,"num_write_kb":567733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"38'3034","reported_seq":3100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.736275+0000","last_change":"2024-05-09T00:20:18.736354+0000","last_active":"2024-05-09T00:20:18.736275+0000","last_peered":"2024-05-09T00:20:18.736275+0000","last_clean":"2024-05-09T00:20:18.736275+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:20:18.736275+0000","last_undegraded":"2024-05-09T00:20:18.736275+0000","last_fullsized":"2024-05-09T00:20:18.736275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3034","last_scrub_stamp":"2024-05-09T00:20:18.736057+0000","last_deep_scrub":"38'3034","last_deep_scrub_stamp":"2024-05-09T00:20:18.736057+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.736057+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:40.654257+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":44931,"num_write_kb":564239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"38'2966","reported_seq":3031,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.206091+0000","last_change":"2024-05-09T00:20:24.206164+0000","last_active":"2024-05-09T00:20:24.206091+0000","last_peered":"2024-05-09T00:20:24.206091+0000","last_clean":"2024-05-09T00:20:24.206091+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:20:24.206091+0000","last_undegraded":"2024-05-09T00:20:24.206091+0000","last_fullsized":"2024-05-09T00:20:24.206091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2966","last_scrub_stamp":"2024-05-09T00:20:24.205680+0000","last_deep_scrub":"38'2966","last_deep_scrub_stamp":"2024-05-09T00:20:24.205680+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.205680+0000","objects_scrubbed":0,"log_size":2966,"log_dups_size":0,"ondisk_log_size":2966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:39.694129+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":43736,"num_write_kb":568620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"38'3544","reported_seq":3602,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.475744+0000","last_change":"2024-05-09T00:08:55.243097+0000","last_active":"2024-05-09T00:19:53.475744+0000","last_peered":"2024-05-09T00:19:53.475744+0000","last_clean":"2024-05-09T00:19:53.475744+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:19:53.475744+0000","last_undegraded":"2024-05-09T00:19:53.475744+0000","last_fullsized":"2024-05-09T00:19:53.475744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":52851,"num_write_kb":659445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"38'2755","reported_seq":2822,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.120231+0000","last_change":"2024-05-09T00:20:27.120362+0000","last_active":"2024-05-09T00:20:27.120231+0000","last_peered":"2024-05-09T00:20:27.120231+0000","last_clean":"2024-05-09T00:20:27.120231+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:20:27.120231+0000","last_undegraded":"2024-05-09T00:20:27.120231+0000","last_fullsized":"2024-05-09T00:20:27.120231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2755","last_scrub_stamp":"2024-05-09T00:20:27.119936+0000","last_deep_scrub":"38'2755","last_deep_scrub_stamp":"2024-05-09T00:20:27.119936+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.119936+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:48.882399+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":40873,"num_write_kb":526996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"38'3706","reported_seq":3770,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.644676+0000","last_change":"2024-05-09T00:08:55.234032+0000","last_active":"2024-05-09T00:19:53.644676+0000","last_peered":"2024-05-09T00:19:53.644676+0000","last_clean":"2024-05-09T00:19:53.644676+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:19:53.644676+0000","last_undegraded":"2024-05-09T00:19:53.644676+0000","last_fullsized":"2024-05-09T00:19:53.644676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":54772,"num_write_kb":692736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"38'2556","reported_seq":2619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.138215+0000","last_change":"2024-05-09T00:20:13.138287+0000","last_active":"2024-05-09T00:20:13.138215+0000","last_peered":"2024-05-09T00:20:13.138215+0000","last_clean":"2024-05-09T00:20:13.138215+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:20:13.138215+0000","last_undegraded":"2024-05-09T00:20:13.138215+0000","last_fullsized":"2024-05-09T00:20:13.138215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2556","last_scrub_stamp":"2024-05-09T00:20:13.137981+0000","last_deep_scrub":"38'2556","last_deep_scrub_stamp":"2024-05-09T00:20:13.137981+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.137981+0000","objects_scrubbed":0,"log_size":2556,"log_dups_size":0,"ondisk_log_size":2556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:47.448591+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":37712,"num_write_kb":481655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"38'3255","reported_seq":3316,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.627989+0000","last_change":"2024-05-09T00:08:55.231809+0000","last_active":"2024-05-09T00:19:53.627989+0000","last_peered":"2024-05-09T00:19:53.627989+0000","last_clean":"2024-05-09T00:19:53.627989+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:19:53.627989+0000","last_undegraded":"2024-05-09T00:19:53.627989+0000","last_fullsized":"2024-05-09T00:19:53.627989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":48245,"num_write_kb":626583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"38'2916","reported_seq":2979,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.178846+0000","last_change":"2024-05-09T00:20:14.178891+0000","last_active":"2024-05-09T00:20:14.178846+0000","last_peered":"2024-05-09T00:20:14.178846+0000","last_clean":"2024-05-09T00:20:14.178846+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:20:14.178846+0000","last_undegraded":"2024-05-09T00:20:14.178846+0000","last_fullsized":"2024-05-09T00:20:14.178846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2916","last_scrub_stamp":"2024-05-09T00:20:14.178683+0000","last_deep_scrub":"38'2916","last_deep_scrub_stamp":"2024-05-09T00:20:14.178683+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.178683+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:07.732646+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":43226,"num_write_kb":536465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"38'3196","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.164823+0000","last_change":"2024-05-09T00:20:30.164892+0000","last_active":"2024-05-09T00:20:30.164823+0000","last_peered":"2024-05-09T00:20:30.164823+0000","last_clean":"2024-05-09T00:20:30.164823+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:20:30.164823+0000","last_undegraded":"2024-05-09T00:20:30.164823+0000","last_fullsized":"2024-05-09T00:20:30.164823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3196","last_scrub_stamp":"2024-05-09T00:20:30.164580+0000","last_deep_scrub":"38'3196","last_deep_scrub_stamp":"2024-05-09T00:20:30.164580+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.164580+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:18.969021+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":47414,"num_write_kb":607139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"38'3503","reported_seq":3566,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.107047+0000","last_change":"2024-05-09T00:20:12.107113+0000","last_active":"2024-05-09T00:20:12.107047+0000","last_peered":"2024-05-09T00:20:12.107047+0000","last_clean":"2024-05-09T00:20:12.107047+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:20:12.107047+0000","last_undegraded":"2024-05-09T00:20:12.107047+0000","last_fullsized":"2024-05-09T00:20:12.107047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3503","last_scrub_stamp":"2024-05-09T00:20:12.106895+0000","last_deep_scrub":"38'3503","last_deep_scrub_stamp":"2024-05-09T00:20:12.106895+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.106895+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:44.222985+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":51962,"num_write_kb":660810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"38'3882","reported_seq":3952,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.167802+0000","last_change":"2024-05-09T00:20:28.167872+0000","last_active":"2024-05-09T00:20:28.167802+0000","last_peered":"2024-05-09T00:20:28.167802+0000","last_clean":"2024-05-09T00:20:28.167802+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:20:28.167802+0000","last_undegraded":"2024-05-09T00:20:28.167802+0000","last_fullsized":"2024-05-09T00:20:28.167802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3882","last_scrub_stamp":"2024-05-09T00:20:28.167571+0000","last_deep_scrub":"38'3882","last_deep_scrub_stamp":"2024-05-09T00:20:28.167571+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.167571+0000","objects_scrubbed":0,"log_size":3882,"log_dups_size":0,"ondisk_log_size":3882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:29.295629+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":57695,"num_write_kb":692841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"38'3732","reported_seq":3791,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.791931+0000","last_change":"2024-05-09T00:20:15.791999+0000","last_active":"2024-05-09T00:20:15.791931+0000","last_peered":"2024-05-09T00:20:15.791931+0000","last_clean":"2024-05-09T00:20:15.791931+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:20:15.791931+0000","last_undegraded":"2024-05-09T00:20:15.791931+0000","last_fullsized":"2024-05-09T00:20:15.791931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3732","last_scrub_stamp":"2024-05-09T00:20:15.791705+0000","last_deep_scrub":"38'3732","last_deep_scrub_stamp":"2024-05-09T00:20:15.791705+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.791705+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:01.837637+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":55072,"num_write_kb":708295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"38'4565","reported_seq":4629,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.642597+0000","last_change":"2024-05-09T00:08:55.233942+0000","last_active":"2024-05-09T00:19:53.642597+0000","last_peered":"2024-05-09T00:19:53.642597+0000","last_clean":"2024-05-09T00:19:53.642597+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:19:53.642597+0000","last_undegraded":"2024-05-09T00:19:53.642597+0000","last_fullsized":"2024-05-09T00:19:53.642597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":67870,"num_write_kb":862032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"38'3274","reported_seq":3337,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.471425+0000","last_change":"2024-05-09T00:20:17.471492+0000","last_active":"2024-05-09T00:20:17.471425+0000","last_peered":"2024-05-09T00:20:17.471425+0000","last_clean":"2024-05-09T00:20:17.471425+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:20:17.471425+0000","last_undegraded":"2024-05-09T00:20:17.471425+0000","last_fullsized":"2024-05-09T00:20:17.471425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3274","last_scrub_stamp":"2024-05-09T00:20:17.471199+0000","last_deep_scrub":"38'3274","last_deep_scrub_stamp":"2024-05-09T00:20:17.471199+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.471199+0000","objects_scrubbed":0,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:51.978298+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":48595,"num_write_kb":613070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"38'3191","reported_seq":3249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.647964+0000","last_change":"2024-05-09T00:08:55.237009+0000","last_active":"2024-05-09T00:19:53.647964+0000","last_peered":"2024-05-09T00:19:53.647964+0000","last_clean":"2024-05-09T00:19:53.647964+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:19:53.647964+0000","last_undegraded":"2024-05-09T00:19:53.647964+0000","last_fullsized":"2024-05-09T00:19:53.647964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3191,"log_dups_size":0,"ondisk_log_size":3191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":47307,"num_write_kb":598779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"38'2895","reported_seq":2959,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.214613+0000","last_change":"2024-05-09T00:20:15.214746+0000","last_active":"2024-05-09T00:20:15.214613+0000","last_peered":"2024-05-09T00:20:15.214613+0000","last_clean":"2024-05-09T00:20:15.214613+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:20:15.214613+0000","last_undegraded":"2024-05-09T00:20:15.214613+0000","last_fullsized":"2024-05-09T00:20:15.214613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2895","last_scrub_stamp":"2024-05-09T00:20:15.214335+0000","last_deep_scrub":"38'2895","last_deep_scrub_stamp":"2024-05-09T00:20:15.214335+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.214335+0000","objects_scrubbed":0,"log_size":2895,"log_dups_size":0,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:59:30.039132+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42980,"num_write_kb":536887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"38'3240","reported_seq":3298,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:52.242205+0000","last_change":"2024-05-09T00:09:31.549449+0000","last_active":"2024-05-09T00:19:52.242205+0000","last_peered":"2024-05-09T00:19:52.242205+0000","last_clean":"2024-05-09T00:19:52.242205+0000","last_became_active":"2024-05-09T00:09:31.548548+0000","last_became_peered":"2024-05-09T00:09:31.548548+0000","last_unstale":"2024-05-09T00:19:52.242205+0000","last_undegraded":"2024-05-09T00:19:52.242205+0000","last_fullsized":"2024-05-09T00:19:52.242205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":48187,"num_write_kb":638325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3a","version":"38'2713","reported_seq":2773,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.534691+0000","last_change":"2024-05-09T00:20:26.534760+0000","last_active":"2024-05-09T00:20:26.534691+0000","last_peered":"2024-05-09T00:20:26.534691+0000","last_clean":"2024-05-09T00:20:26.534691+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:20:26.534691+0000","last_undegraded":"2024-05-09T00:20:26.534691+0000","last_fullsized":"2024-05-09T00:20:26.534691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2713","last_scrub_stamp":"2024-05-09T00:20:26.534454+0000","last_deep_scrub":"38'2713","last_deep_scrub_stamp":"2024-05-09T00:20:26.534454+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.534454+0000","objects_scrubbed":0,"log_size":2713,"log_dups_size":0,"ondisk_log_size":2713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:03.665864+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40136,"num_write_kb":502625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"38'3769","reported_seq":3837,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.717261+0000","last_change":"2024-05-09T00:20:17.717328+0000","last_active":"2024-05-09T00:20:17.717261+0000","last_peered":"2024-05-09T00:20:17.717261+0000","last_clean":"2024-05-09T00:20:17.717261+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:20:17.717261+0000","last_undegraded":"2024-05-09T00:20:17.717261+0000","last_fullsized":"2024-05-09T00:20:17.717261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3769","last_scrub_stamp":"2024-05-09T00:20:17.717034+0000","last_deep_scrub":"38'3769","last_deep_scrub_stamp":"2024-05-09T00:20:17.717034+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.717034+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:19.332633+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7,"num_write":55645,"num_write_kb":699546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"38'3742","reported_seq":3810,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.167884+0000","last_change":"2024-05-09T00:20:17.167954+0000","last_active":"2024-05-09T00:20:17.167884+0000","last_peered":"2024-05-09T00:20:17.167884+0000","last_clean":"2024-05-09T00:20:17.167884+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:20:17.167884+0000","last_undegraded":"2024-05-09T00:20:17.167884+0000","last_fullsized":"2024-05-09T00:20:17.167884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3742","last_scrub_stamp":"2024-05-09T00:20:17.167636+0000","last_deep_scrub":"38'3742","last_deep_scrub_stamp":"2024-05-09T00:20:17.167636+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.167636+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:46.018392+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":55258,"num_write_kb":668332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"38'3188","reported_seq":3252,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.915117+0000","last_change":"2024-05-09T00:20:24.915184+0000","last_active":"2024-05-09T00:20:24.915117+0000","last_peered":"2024-05-09T00:20:24.915117+0000","last_clean":"2024-05-09T00:20:24.915117+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:20:24.915117+0000","last_undegraded":"2024-05-09T00:20:24.915117+0000","last_fullsized":"2024-05-09T00:20:24.915117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3188","last_scrub_stamp":"2024-05-09T00:20:24.914892+0000","last_deep_scrub":"38'3188","last_deep_scrub_stamp":"2024-05-09T00:20:24.914892+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.914892+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:10.307312+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":47104,"num_write_kb":589873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"38'2889","reported_seq":2950,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.487331+0000","last_change":"2024-05-09T00:20:25.487400+0000","last_active":"2024-05-09T00:20:25.487331+0000","last_peered":"2024-05-09T00:20:25.487331+0000","last_clean":"2024-05-09T00:20:25.487331+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:20:25.487331+0000","last_undegraded":"2024-05-09T00:20:25.487331+0000","last_fullsized":"2024-05-09T00:20:25.487331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2889","last_scrub_stamp":"2024-05-09T00:20:25.487106+0000","last_deep_scrub":"38'2889","last_deep_scrub_stamp":"2024-05-09T00:20:25.487106+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.487106+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:58:47.722081+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":42948,"num_write_kb":549753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"38'4368","reported_seq":4427,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:19:53.645931+0000","last_change":"2024-05-09T00:08:55.209818+0000","last_active":"2024-05-09T00:19:53.645931+0000","last_peered":"2024-05-09T00:19:53.645931+0000","last_clean":"2024-05-09T00:19:53.645931+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:19:53.645931+0000","last_undegraded":"2024-05-09T00:19:53.645931+0000","last_fullsized":"2024-05-09T00:19:53.645931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:08:54.162289+0000","last_clean_scrub_stamp":"2024-05-09T00:08:54.162289+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":64699,"num_write_kb":791644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"38'3241","reported_seq":3302,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.531883+0000","last_change":"2024-05-09T00:20:29.531954+0000","last_active":"2024-05-09T00:20:29.531883+0000","last_peered":"2024-05-09T00:20:29.531883+0000","last_clean":"2024-05-09T00:20:29.531883+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:20:29.531883+0000","last_undegraded":"2024-05-09T00:20:29.531883+0000","last_fullsized":"2024-05-09T00:20:29.531883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3241","last_scrub_stamp":"2024-05-09T00:20:29.531616+0000","last_deep_scrub":"38'3241","last_deep_scrub_stamp":"2024-05-09T00:20:29.531616+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.531616+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.306789+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":47841,"num_write_kb":582702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"38'3908","reported_seq":3982,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.365539+0000","last_change":"2024-05-09T00:20:14.365575+0000","last_active":"2024-05-09T00:20:14.365539+0000","last_peered":"2024-05-09T00:20:14.365539+0000","last_clean":"2024-05-09T00:20:14.365539+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:20:14.365539+0000","last_undegraded":"2024-05-09T00:20:14.365539+0000","last_fullsized":"2024-05-09T00:20:14.365539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3908","last_scrub_stamp":"2024-05-09T00:20:14.365386+0000","last_deep_scrub":"38'3908","last_deep_scrub_stamp":"2024-05-09T00:20:14.365386+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.365386+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:50.598170+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":58133,"num_write_kb":728914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"38'3816","reported_seq":3880,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.430771+0000","last_change":"2024-05-09T00:20:19.430842+0000","last_active":"2024-05-09T00:20:19.430771+0000","last_peered":"2024-05-09T00:20:19.430771+0000","last_clean":"2024-05-09T00:20:19.430771+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:20:19.430771+0000","last_undegraded":"2024-05-09T00:20:19.430771+0000","last_fullsized":"2024-05-09T00:20:19.430771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3816","last_scrub_stamp":"2024-05-09T00:20:19.430509+0000","last_deep_scrub":"38'3816","last_deep_scrub_stamp":"2024-05-09T00:20:19.430509+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.430509+0000","objects_scrubbed":0,"log_size":3816,"log_dups_size":0,"ondisk_log_size":3816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:18.387130+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56666,"num_write_kb":741300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"38'3575","reported_seq":3634,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.463989+0000","last_change":"2024-05-09T00:20:29.464055+0000","last_active":"2024-05-09T00:20:29.463989+0000","last_peered":"2024-05-09T00:20:29.463989+0000","last_clean":"2024-05-09T00:20:29.463989+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:20:29.463989+0000","last_undegraded":"2024-05-09T00:20:29.463989+0000","last_fullsized":"2024-05-09T00:20:29.463989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3575","last_scrub_stamp":"2024-05-09T00:20:29.463758+0000","last_deep_scrub":"38'3575","last_deep_scrub_stamp":"2024-05-09T00:20:29.463758+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.463758+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:40:12.601299+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":52889,"num_write_kb":664811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"38'2753","reported_seq":2816,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.175735+0000","last_change":"2024-05-09T00:20:16.175790+0000","last_active":"2024-05-09T00:20:16.175735+0000","last_peered":"2024-05-09T00:20:16.175735+0000","last_clean":"2024-05-09T00:20:16.175735+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:20:16.175735+0000","last_undegraded":"2024-05-09T00:20:16.175735+0000","last_fullsized":"2024-05-09T00:20:16.175735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2753","last_scrub_stamp":"2024-05-09T00:20:16.175517+0000","last_deep_scrub":"38'2753","last_deep_scrub_stamp":"2024-05-09T00:20:16.175517+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.175517+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:12.764267+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40609,"num_write_kb":513099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1156,"num_read_kb":11,"num_write":3472550,"num_write_kb":43957042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234380,"ondisk_log_size":234380,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":94516670,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":449,"num_read_kb":234536,"num_write":3119,"num_write_kb":94508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":189095936,"data_stored":189033340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3006,"ondisk_log_size":3006,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":0,"num_write":2947124,"num_write_kb":37270707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199144,"ondisk_log_size":199144,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93475205,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":515,"num_read_kb":184607,"num_write":3552,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187015168,"data_stored":186950410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3411,"ondisk_log_size":3411,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509585,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407236,"kb_used_data":29180,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93964604,"statfs":{"total":96636764160,"available":96219754496,"internally_reserved":0,"allocated":29880320,"data_stored":29641906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":387119562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509582,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":512232,"kb_used_data":34272,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93859608,"statfs":{"total":96636764160,"available":96112238592,"internally_reserved":0,"allocated":35094528,"data_stored":34859623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":489421254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509584,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533384,"kb_used_data":55424,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93838456,"statfs":{"total":96636764160,"available":96090578944,"internally_reserved":0,"allocated":56754176,"data_stored":56509593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509580,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":576580,"kb_used_data":72252,"kb_used_omap":1,"kb_used_meta":504318,"kb_avail":93795260,"statfs":{"total":96636764160,"available":96046346240,"internally_reserved":0,"allocated":73986048,"data_stored":73738590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":516422087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509577,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":611836,"kb_used_data":43572,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93760004,"statfs":{"total":96636764160,"available":96010244096,"internally_reserved":0,"allocated":44617728,"data_stored":44377810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509584,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":482412,"kb_used_data":50148,"kb_used_omap":1,"kb_used_meta":432254,"kb_avail":93889428,"statfs":{"total":96636764160,"available":96142774272,"internally_reserved":0,"allocated":51351552,"data_stored":51115708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":442628549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581804,"kb_used_data":37284,"kb_used_omap":1,"kb_used_meta":544510,"kb_avail":93790036,"statfs":{"total":96636764160,"available":96040996864,"internally_reserved":0,"allocated":38178816,"data_stored":37942434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":557578693},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542286,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589948,"kb_used_data":49588,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":93781892,"statfs":{"total":96636764160,"available":96032657408,"internally_reserved":0,"allocated":50778112,"data_stored":50527238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37748792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12583584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37749318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30572544,"data_stored":30559267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13693879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12671116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31608832,"data_stored":31600674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35815424,"data_stored":35795720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25166406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:20:35.591 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.592 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.592 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.592 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.592 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.592 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.592 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.593 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.593 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.593 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.593 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.593 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.593 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T00:08:53.146320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.594 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.595 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.595 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.595 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.595 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.595 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-09T00:08:43.024615+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.595 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.596 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T00:08:44.039628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.597 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.598 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.598 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.598 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.598 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-05-09T00:08:54.162289+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=8, tm_sec=54, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=0, tm_min=20, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T00:20:35.598 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T00:20:48.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:20:48.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:20:55.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:20:55.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.886+0000 7f44ce000640 1 Processor -- start 2024-05-09T00:20:55.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.886+0000 7f44ce000640 1 -- start start 2024-05-09T00:20:55.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.888+0000 7f44ce000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8072720 0x7f44c80c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:55.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.888+0000 7f44ce000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44c81585c0 0x7f44c81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:55.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.888+0000 7f44ce000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8074040 con 0x7f44c8073800 2024-05-09T00:20:55.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.888+0000 7f44ce000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f44c8073df0 con 0x7f44c81585c0 2024-05-09T00:20:55.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.888+0000 7f44ce000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f44c80c5f40 con 0x7f44c8072720 2024-05-09T00:20:55.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.889+0000 7f44c6a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8072720 0x7f44c80c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:55.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.889+0000 7f44c7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44c81585c0 0x7f44c81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:55.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.889+0000 7f44c7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44c81585c0 0x7f44c81589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:55492/0 (socket says 172.21.15.114:55492) 2024-05-09T00:20:55.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.889+0000 7f44c7e00640 1 -- 172.21.15.114:0/4022497830 learned_addr learned my addr 172.21.15.114:0/4022497830 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:55.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.890+0000 7f44c7e00640 1 -- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8072720 msgr2=0x7f44c80c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:55.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.890+0000 7f44c7e00640 1 --2- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8072720 0x7f44c80c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:55.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.890+0000 7f44c7e00640 1 -- 172.21.15.114:0/4022497830 >> v1:172.21.15.153:6789/0 conn(0x7f44c8073800 legacy=0x7f44c80c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:55.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.890+0000 7f44c7e00640 1 -- 172.21.15.114:0/4022497830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80c58f0 con 0x7f44c81585c0 2024-05-09T00:20:55.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.891+0000 7f44c7e00640 1 --2- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c81589d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009e50 tx=0x7f44c002a700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc30f267723c4d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:55.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.891+0000 7f44c6000640 1 -- 172.21.15.114:0/4022497830 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0036070 con 0x7f44c81585c0 2024-05-09T00:20:55.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.891+0000 7f44c6000640 1 -- 172.21.15.114:0/4022497830 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0031600 con 0x7f44c81585c0 2024-05-09T00:20:55.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.891+0000 7f44c6000640 1 -- 172.21.15.114:0/4022497830 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c00319d0 con 0x7f44c81585c0 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 -- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 msgr2=0x7f44c81589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 --2- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c81589d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009e50 tx=0x7f44c002a700 comp rx=0 tx=0).stop 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 -- 172.21.15.114:0/4022497830 shutdown_connections 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 --2- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c81589d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 --2- 172.21.15.114:0/4022497830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8072720 0x7f44c80c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 -- 172.21.15.114:0/4022497830 >> 172.21.15.114:0/4022497830 conn(0x7f44c806c680 msgr2=0x7f44c806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 -- 172.21.15.114:0/4022497830 shutdown_connections 2024-05-09T00:20:55.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.892+0000 7f44ce000640 1 -- 172.21.15.114:0/4022497830 wait complete. 2024-05-09T00:20:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.895+0000 7f44ce000640 1 Processor -- start 2024-05-09T00:20:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.895+0000 7f44ce000640 1 -- start start 2024-05-09T00:20:55.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44ce000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 0x7f44c81453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44ce000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8073800 0x7f44c80ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44ce000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c80c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44ce000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8074320 con 0x7f44c8072720 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44ce000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8072b30 con 0x7f44c81585c0 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44ce000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f44c814fc40 con 0x7f44c8073800 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44c7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 0x7f44c81453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44c7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 0x7f44c81453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38370/0 (socket says 172.21.15.114:38370) 2024-05-09T00:20:55.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.896+0000 7f44c7400640 1 -- 172.21.15.114:0/3814546940 learned_addr learned my addr 172.21.15.114:0/3814546940 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:55.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c6a00640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8073800 0x7f44c80ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:55.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7e00640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c80c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:55.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7400640 1 -- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8073800 msgr2=0x7f44c80ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:55.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7400640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8073800 0x7f44c80ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:55.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7400640 1 -- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 msgr2=0x7f44c80c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:55.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7400640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c80c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7400640 1 -- 172.21.15.114:0/3814546940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c814fa30 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44c7400640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 0x7f44c81453f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c3a0 tx=0x7f44b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8017070 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.897+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b80052d0 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.898+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c81e2e80 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.898+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8003830 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.898+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81eeb70 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.899+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c8077430 con 0x7f44c8072720 2024-05-09T00:20:55.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.900+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f44b801a070 con 0x7f44c8072720 2024-05-09T00:20:55.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.901+0000 7f44bf400640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f44a80762d0 0x7f44a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:55.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.901+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f44b8097180 con 0x7f44c8072720 2024-05-09T00:20:55.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.901+0000 7f44c6a00640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f44a80762d0 0x7f44a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:55.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.902+0000 7f44c6a00640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f44a80762d0 0x7f44a80787e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f44c8152aa0 tx=0x7f44b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:55.906+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f44b80602d0 con 0x7f44c8072720 2024-05-09T00:20:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.107+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 --> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44c81561a0 con 0x7f44a80762d0 2024-05-09T00:20:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.143+0000 7f44bf400640 1 -- 172.21.15.114:0/3814546940 <== mgr.4104 v2:172.21.15.114:6832/991477833 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495623 (secure 0 0 0) 0x7f44c81561a0 con 0x7f44a80762d0 2024-05-09T00:20:56.150 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:56.153 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-05-09T00:20:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f44a80762d0 msgr2=0x7f44a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f44a80762d0 0x7f44a80787e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f44c8152aa0 tx=0x7f44b4008040 comp rx=0 tx=0).stop 2024-05-09T00:20:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 msgr2=0x7f44c81453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 0x7f44c81453f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c3a0 tx=0x7f44b800c860 comp rx=0 tx=0).stop 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 shutdown_connections 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f44a80762d0 0x7f44a80787e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44c81585c0 0x7f44c80c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44c8073800 0x7f44c80ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 --2- 172.21.15.114:0/3814546940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44c8072720 0x7f44c81453f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.153+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 >> 172.21.15.114:0/3814546940 conn(0x7f44c806c680 msgr2=0x7f44c80c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.154+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 shutdown_connections 2024-05-09T00:20:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.154+0000 7f44ce000640 1 -- 172.21.15.114:0/3814546940 wait complete. 2024-05-09T00:20:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-05-09T00:20:54.660887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":188582243,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":2536,"num_read_kb":419209,"num_write":6426446,"num_write_kb":81417639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440025,"ondisk_log_size":440025,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4295432,"kb_used_data":371720,"kb_used_omap":12,"kb_used_meta":3923635,"kb_avail":750679288,"statfs":{"total":773094113280,"available":768695590912,"internally_reserved":0,"allocated":380641280,"data_stored":378712902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":4017802800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006875"},"pg_stats":[{"pgid":"5.18","version":"38'3510","reported_seq":3578,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.664943+0000","last_change":"2024-05-09T00:20:22.665014+0000","last_active":"2024-05-09T00:20:22.664943+0000","last_peered":"2024-05-09T00:20:22.664943+0000","last_clean":"2024-05-09T00:20:22.664943+0000","last_became_active":"2024-05-09T00:08:55.239769+0000","last_became_peered":"2024-05-09T00:08:55.239769+0000","last_unstale":"2024-05-09T00:20:22.664943+0000","last_undegraded":"2024-05-09T00:20:22.664943+0000","last_fullsized":"2024-05-09T00:20:22.664943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3510","last_scrub_stamp":"2024-05-09T00:20:22.664708+0000","last_deep_scrub":"38'3510","last_deep_scrub_stamp":"2024-05-09T00:20:22.664708+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.664708+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:07.186732+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":51796,"num_write_kb":675575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"38'29","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.893638+0000","last_change":"2024-05-09T00:20:26.893764+0000","last_active":"2024-05-09T00:20:26.893638+0000","last_peered":"2024-05-09T00:20:26.893638+0000","last_clean":"2024-05-09T00:20:26.893638+0000","last_became_active":"2024-05-09T00:08:44.102423+0000","last_became_peered":"2024-05-09T00:08:44.102423+0000","last_unstale":"2024-05-09T00:20:26.893638+0000","last_undegraded":"2024-05-09T00:20:26.893638+0000","last_fullsized":"2024-05-09T00:20:26.893638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'29","last_scrub_stamp":"2024-05-09T00:20:26.893404+0000","last_deep_scrub":"38'29","last_deep_scrub_stamp":"2024-05-09T00:20:26.893404+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.893404+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:10.546027+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":12312,"num_write":21,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"38'3268","reported_seq":3327,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.499578+0000","last_change":"2024-05-09T00:20:16.499792+0000","last_active":"2024-05-09T00:20:16.499578+0000","last_peered":"2024-05-09T00:20:16.499578+0000","last_clean":"2024-05-09T00:20:16.499578+0000","last_became_active":"2024-05-09T00:08:45.115734+0000","last_became_peered":"2024-05-09T00:08:45.115734+0000","last_unstale":"2024-05-09T00:20:16.499578+0000","last_undegraded":"2024-05-09T00:20:16.499578+0000","last_fullsized":"2024-05-09T00:20:16.499578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3268","last_scrub_stamp":"2024-05-09T00:20:16.499295+0000","last_deep_scrub":"38'3268","last_deep_scrub_stamp":"2024-05-09T00:20:16.499295+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.499295+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:53.464034+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":48401,"num_write_kb":608968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"38'5","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.822385+0000","last_change":"2024-05-09T00:20:22.822452+0000","last_active":"2024-05-09T00:20:22.822385+0000","last_peered":"2024-05-09T00:20:22.822385+0000","last_clean":"2024-05-09T00:20:22.822385+0000","last_became_active":"2024-05-09T00:08:54.226571+0000","last_became_peered":"2024-05-09T00:08:54.226571+0000","last_unstale":"2024-05-09T00:20:22.822385+0000","last_undegraded":"2024-05-09T00:20:22.822385+0000","last_fullsized":"2024-05-09T00:20:22.822385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:22.822169+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:22.822169+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.822169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:14.357758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"38'4249","reported_seq":4319,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.894712+0000","last_change":"2024-05-09T00:20:30.894785+0000","last_active":"2024-05-09T00:20:30.894712+0000","last_peered":"2024-05-09T00:20:30.894712+0000","last_clean":"2024-05-09T00:20:30.894712+0000","last_became_active":"2024-05-09T00:08:55.226785+0000","last_became_peered":"2024-05-09T00:08:55.226785+0000","last_unstale":"2024-05-09T00:20:30.894712+0000","last_undegraded":"2024-05-09T00:20:30.894712+0000","last_fullsized":"2024-05-09T00:20:30.894712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4249","last_scrub_stamp":"2024-05-09T00:20:30.894461+0000","last_deep_scrub":"38'4249","last_deep_scrub_stamp":"2024-05-09T00:20:30.894461+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.894461+0000","objects_scrubbed":0,"log_size":4249,"log_dups_size":0,"ondisk_log_size":4249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:50.968840+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":63068,"num_write_kb":790226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"38'13","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.501853+0000","last_change":"2024-05-09T00:20:25.501931+0000","last_active":"2024-05-09T00:20:25.501853+0000","last_peered":"2024-05-09T00:20:25.501853+0000","last_clean":"2024-05-09T00:20:25.501853+0000","last_became_active":"2024-05-09T00:08:44.100779+0000","last_became_peered":"2024-05-09T00:08:44.100779+0000","last_unstale":"2024-05-09T00:20:25.501853+0000","last_undegraded":"2024-05-09T00:20:25.501853+0000","last_fullsized":"2024-05-09T00:20:25.501853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'13","last_scrub_stamp":"2024-05-09T00:20:25.501599+0000","last_deep_scrub":"38'13","last_deep_scrub_stamp":"2024-05-09T00:20:25.501599+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.501599+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:21.475166+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"38'3802","reported_seq":3870,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.466499+0000","last_change":"2024-05-09T00:20:23.466572+0000","last_active":"2024-05-09T00:20:23.466499+0000","last_peered":"2024-05-09T00:20:23.466499+0000","last_clean":"2024-05-09T00:20:23.466499+0000","last_became_active":"2024-05-09T00:08:45.097470+0000","last_became_peered":"2024-05-09T00:08:45.097470+0000","last_unstale":"2024-05-09T00:20:23.466499+0000","last_undegraded":"2024-05-09T00:20:23.466499+0000","last_fullsized":"2024-05-09T00:20:23.466499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3802","last_scrub_stamp":"2024-05-09T00:20:23.466259+0000","last_deep_scrub":"38'3802","last_deep_scrub_stamp":"2024-05-09T00:20:23.466259+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.466259+0000","objects_scrubbed":0,"log_size":3802,"log_dups_size":0,"ondisk_log_size":3802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:43.521215+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":56279,"num_write_kb":712681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"38'36","reported_seq":91,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.402964+0000","last_change":"2024-05-09T00:20:12.403007+0000","last_active":"2024-05-09T00:20:12.402964+0000","last_peered":"2024-05-09T00:20:12.402964+0000","last_clean":"2024-05-09T00:20:12.402964+0000","last_became_active":"2024-05-09T00:08:54.225630+0000","last_became_peered":"2024-05-09T00:08:54.225630+0000","last_unstale":"2024-05-09T00:20:12.402964+0000","last_undegraded":"2024-05-09T00:20:12.402964+0000","last_fullsized":"2024-05-09T00:20:12.402964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'36","last_scrub_stamp":"2024-05-09T00:20:12.402841+0000","last_deep_scrub":"38'36","last_deep_scrub_stamp":"2024-05-09T00:20:12.402841+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.402841+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.576003+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":31,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"38'3172","reported_seq":3232,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.686663+0000","last_change":"2024-05-09T00:20:20.686735+0000","last_active":"2024-05-09T00:20:20.686663+0000","last_peered":"2024-05-09T00:20:20.686663+0000","last_clean":"2024-05-09T00:20:20.686663+0000","last_became_active":"2024-05-09T00:08:55.232546+0000","last_became_peered":"2024-05-09T00:08:55.232546+0000","last_unstale":"2024-05-09T00:20:20.686663+0000","last_undegraded":"2024-05-09T00:20:20.686663+0000","last_fullsized":"2024-05-09T00:20:20.686663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3172","last_scrub_stamp":"2024-05-09T00:20:20.686398+0000","last_deep_scrub":"38'3172","last_deep_scrub_stamp":"2024-05-09T00:20:20.686398+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.686398+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:35:08.293166+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46816,"num_write_kb":580338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"38'74","reported_seq":151,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.227355+0000","last_change":"2024-05-09T00:20:20.227472+0000","last_active":"2024-05-09T00:20:20.227355+0000","last_peered":"2024-05-09T00:20:20.227355+0000","last_clean":"2024-05-09T00:20:20.227355+0000","last_became_active":"2024-05-09T00:08:44.095349+0000","last_became_peered":"2024-05-09T00:08:44.095349+0000","last_unstale":"2024-05-09T00:20:20.227355+0000","last_undegraded":"2024-05-09T00:20:20.227355+0000","last_fullsized":"2024-05-09T00:20:20.227355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-05-09T00:20:20.227129+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-05-09T00:20:20.227129+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.227129+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:30.075354+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":24612,"num_write":55,"num_write_kb":12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2295","reported_seq":2354,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.763049+0000","last_change":"2024-05-09T00:20:14.763183+0000","last_active":"2024-05-09T00:20:14.763049+0000","last_peered":"2024-05-09T00:20:14.763049+0000","last_clean":"2024-05-09T00:20:14.763049+0000","last_became_active":"2024-05-09T00:08:45.097879+0000","last_became_peered":"2024-05-09T00:08:45.097879+0000","last_unstale":"2024-05-09T00:20:14.763049+0000","last_undegraded":"2024-05-09T00:20:14.763049+0000","last_fullsized":"2024-05-09T00:20:14.763049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2295","last_scrub_stamp":"2024-05-09T00:20:14.762789+0000","last_deep_scrub":"38'2295","last_deep_scrub_stamp":"2024-05-09T00:20:14.762789+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.762789+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:08.266598+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":33922,"num_write_kb":416723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"38'1160","reported_seq":1215,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.354953+0000","last_change":"2024-05-09T00:20:11.355060+0000","last_active":"2024-05-09T00:20:11.354953+0000","last_peered":"2024-05-09T00:20:11.354953+0000","last_clean":"2024-05-09T00:20:11.354953+0000","last_became_active":"2024-05-09T00:08:54.217848+0000","last_became_peered":"2024-05-09T00:08:54.217848+0000","last_unstale":"2024-05-09T00:20:11.354953+0000","last_undegraded":"2024-05-09T00:20:11.354953+0000","last_fullsized":"2024-05-09T00:20:11.354953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1160","last_scrub_stamp":"2024-05-09T00:20:11.354702+0000","last_deep_scrub":"38'1160","last_deep_scrub_stamp":"2024-05-09T00:20:11.354702+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.354702+0000","objects_scrubbed":1,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:33.750337+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1156,"num_write_kb":5131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"38'2810","reported_seq":2874,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.507734+0000","last_change":"2024-05-09T00:20:30.507806+0000","last_active":"2024-05-09T00:20:30.507734+0000","last_peered":"2024-05-09T00:20:30.507734+0000","last_clean":"2024-05-09T00:20:30.507734+0000","last_became_active":"2024-05-09T00:08:55.216641+0000","last_became_peered":"2024-05-09T00:08:55.216641+0000","last_unstale":"2024-05-09T00:20:30.507734+0000","last_undegraded":"2024-05-09T00:20:30.507734+0000","last_fullsized":"2024-05-09T00:20:30.507734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2810","last_scrub_stamp":"2024-05-09T00:20:30.507414+0000","last_deep_scrub":"38'2810","last_deep_scrub_stamp":"2024-05-09T00:20:30.507414+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.507414+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:15.150468+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":41711,"num_write_kb":539991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"38'22","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.138618+0000","last_change":"2024-05-09T00:20:18.138748+0000","last_active":"2024-05-09T00:20:18.138618+0000","last_peered":"2024-05-09T00:20:18.138618+0000","last_clean":"2024-05-09T00:20:18.138618+0000","last_became_active":"2024-05-09T00:08:44.087715+0000","last_became_peered":"2024-05-09T00:08:44.087715+0000","last_unstale":"2024-05-09T00:20:18.138618+0000","last_undegraded":"2024-05-09T00:20:18.138618+0000","last_fullsized":"2024-05-09T00:20:18.138618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'22","last_scrub_stamp":"2024-05-09T00:20:18.138338+0000","last_deep_scrub":"38'22","last_deep_scrub_stamp":"2024-05-09T00:20:18.138338+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.138338+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.858918+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"38'3819","reported_seq":3882,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.746927+0000","last_change":"2024-05-09T00:20:14.746992+0000","last_active":"2024-05-09T00:20:14.746927+0000","last_peered":"2024-05-09T00:20:14.746927+0000","last_clean":"2024-05-09T00:20:14.746927+0000","last_became_active":"2024-05-09T00:08:45.111019+0000","last_became_peered":"2024-05-09T00:08:45.111019+0000","last_unstale":"2024-05-09T00:20:14.746927+0000","last_undegraded":"2024-05-09T00:20:14.746927+0000","last_fullsized":"2024-05-09T00:20:14.746927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3819","last_scrub_stamp":"2024-05-09T00:20:14.746747+0000","last_deep_scrub":"38'3819","last_deep_scrub_stamp":"2024-05-09T00:20:14.746747+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.746747+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:57:12.335592+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56698,"num_write_kb":717087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"38'129","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.378901+0000","last_change":"2024-05-09T00:20:17.378974+0000","last_active":"2024-05-09T00:20:17.378901+0000","last_peered":"2024-05-09T00:20:17.378901+0000","last_clean":"2024-05-09T00:20:17.378901+0000","last_became_active":"2024-05-09T00:08:54.216733+0000","last_became_peered":"2024-05-09T00:08:54.216733+0000","last_unstale":"2024-05-09T00:20:17.378901+0000","last_undegraded":"2024-05-09T00:20:17.378901+0000","last_fullsized":"2024-05-09T00:20:17.378901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'129","last_scrub_stamp":"2024-05-09T00:20:17.378660+0000","last_deep_scrub":"38'129","last_deep_scrub_stamp":"2024-05-09T00:20:17.378660+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.378660+0000","objects_scrubbed":1,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:27:16.012497+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12967,"num_write":119,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"38'3858","reported_seq":3930,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:33.524863+0000","last_change":"2024-05-09T00:20:33.524932+0000","last_active":"2024-05-09T00:20:33.524863+0000","last_peered":"2024-05-09T00:20:33.524863+0000","last_clean":"2024-05-09T00:20:33.524863+0000","last_became_active":"2024-05-09T00:08:55.206985+0000","last_became_peered":"2024-05-09T00:08:55.206985+0000","last_unstale":"2024-05-09T00:20:33.524863+0000","last_undegraded":"2024-05-09T00:20:33.524863+0000","last_fullsized":"2024-05-09T00:20:33.524863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3858","last_scrub_stamp":"2024-05-09T00:20:33.524618+0000","last_deep_scrub":"38'3858","last_deep_scrub_stamp":"2024-05-09T00:20:33.524618+0000","last_clean_scrub_stamp":"2024-05-09T00:20:33.524618+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:36.256393+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":57322,"num_write_kb":713128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"38'2905","reported_seq":2967,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.772269+0000","last_change":"2024-05-09T00:20:17.772335+0000","last_active":"2024-05-09T00:20:17.772269+0000","last_peered":"2024-05-09T00:20:17.772269+0000","last_clean":"2024-05-09T00:20:17.772269+0000","last_became_active":"2024-05-09T00:08:45.096279+0000","last_became_peered":"2024-05-09T00:08:45.096279+0000","last_unstale":"2024-05-09T00:20:17.772269+0000","last_undegraded":"2024-05-09T00:20:17.772269+0000","last_fullsized":"2024-05-09T00:20:17.772269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2905","last_scrub_stamp":"2024-05-09T00:20:17.772043+0000","last_deep_scrub":"38'2905","last_deep_scrub_stamp":"2024-05-09T00:20:17.772043+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.772043+0000","objects_scrubbed":0,"log_size":2905,"log_dups_size":0,"ondisk_log_size":2905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:39.007030+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":43150,"num_write_kb":535156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"38'445","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.752054+0000","last_change":"2024-05-09T00:20:30.752136+0000","last_active":"2024-05-09T00:20:30.752054+0000","last_peered":"2024-05-09T00:20:30.752054+0000","last_clean":"2024-05-09T00:20:30.752054+0000","last_became_active":"2024-05-09T00:08:44.090195+0000","last_became_peered":"2024-05-09T00:08:44.090195+0000","last_unstale":"2024-05-09T00:20:30.752054+0000","last_undegraded":"2024-05-09T00:20:30.752054+0000","last_fullsized":"2024-05-09T00:20:30.752054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'445","last_scrub_stamp":"2024-05-09T00:20:30.751829+0000","last_deep_scrub":"38'445","last_deep_scrub_stamp":"2024-05-09T00:20:30.751829+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.751829+0000","objects_scrubbed":2,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:29.368271+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":13833,"num_write":428,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"38'30","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.693876+0000","last_change":"2024-05-09T00:20:24.693954+0000","last_active":"2024-05-09T00:20:24.693876+0000","last_peered":"2024-05-09T00:20:24.693876+0000","last_clean":"2024-05-09T00:20:24.693876+0000","last_became_active":"2024-05-09T00:08:54.209874+0000","last_became_peered":"2024-05-09T00:08:54.209874+0000","last_unstale":"2024-05-09T00:20:24.693876+0000","last_undegraded":"2024-05-09T00:20:24.693876+0000","last_fullsized":"2024-05-09T00:20:24.693876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'30","last_scrub_stamp":"2024-05-09T00:20:24.693644+0000","last_deep_scrub":"38'30","last_deep_scrub_stamp":"2024-05-09T00:20:24.693644+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.693644+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:53.927569+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":25,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"38'3696","reported_seq":3763,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.829058+0000","last_change":"2024-05-09T00:20:28.829127+0000","last_active":"2024-05-09T00:20:28.829058+0000","last_peered":"2024-05-09T00:20:28.829058+0000","last_clean":"2024-05-09T00:20:28.829058+0000","last_became_active":"2024-05-09T00:08:55.239317+0000","last_became_peered":"2024-05-09T00:08:55.239317+0000","last_unstale":"2024-05-09T00:20:28.829058+0000","last_undegraded":"2024-05-09T00:20:28.829058+0000","last_fullsized":"2024-05-09T00:20:28.829058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3696","last_scrub_stamp":"2024-05-09T00:20:28.828827+0000","last_deep_scrub":"38'3696","last_deep_scrub_stamp":"2024-05-09T00:20:28.828827+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.828827+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:28.178985+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54745,"num_write_kb":690364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"38'2635","reported_seq":2698,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.822824+0000","last_change":"2024-05-09T00:20:17.822893+0000","last_active":"2024-05-09T00:20:17.822824+0000","last_peered":"2024-05-09T00:20:17.822824+0000","last_clean":"2024-05-09T00:20:17.822824+0000","last_became_active":"2024-05-09T00:08:45.103214+0000","last_became_peered":"2024-05-09T00:08:45.103214+0000","last_unstale":"2024-05-09T00:20:17.822824+0000","last_undegraded":"2024-05-09T00:20:17.822824+0000","last_fullsized":"2024-05-09T00:20:17.822824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2635","last_scrub_stamp":"2024-05-09T00:20:17.822561+0000","last_deep_scrub":"38'2635","last_deep_scrub_stamp":"2024-05-09T00:20:17.822561+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.822561+0000","objects_scrubbed":0,"log_size":2635,"log_dups_size":0,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:15.972952+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":39020,"num_write_kb":478044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"38'85","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.204867+0000","last_change":"2024-05-09T00:20:22.204944+0000","last_active":"2024-05-09T00:20:22.204867+0000","last_peered":"2024-05-09T00:20:22.204867+0000","last_clean":"2024-05-09T00:20:22.204867+0000","last_became_active":"2024-05-09T00:08:44.105121+0000","last_became_peered":"2024-05-09T00:08:44.105121+0000","last_unstale":"2024-05-09T00:20:22.204867+0000","last_undegraded":"2024-05-09T00:20:22.204867+0000","last_fullsized":"2024-05-09T00:20:22.204867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'85","last_scrub_stamp":"2024-05-09T00:20:22.204577+0000","last_deep_scrub":"38'85","last_deep_scrub_stamp":"2024-05-09T00:20:22.204577+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.204577+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:50.327619+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110967,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":1124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"38'3","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.129875+0000","last_change":"2024-05-09T00:20:26.129944+0000","last_active":"2024-05-09T00:20:26.129875+0000","last_peered":"2024-05-09T00:20:26.129875+0000","last_clean":"2024-05-09T00:20:26.129875+0000","last_became_active":"2024-05-09T00:08:54.217068+0000","last_became_peered":"2024-05-09T00:08:54.217068+0000","last_unstale":"2024-05-09T00:20:26.129875+0000","last_undegraded":"2024-05-09T00:20:26.129875+0000","last_fullsized":"2024-05-09T00:20:26.129875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:26.129646+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:26.129646+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.129646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:23.685344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"38'3606","reported_seq":3678,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:43.732862+0000","last_change":"2024-05-09T00:20:43.732930+0000","last_active":"2024-05-09T00:20:43.732862+0000","last_peered":"2024-05-09T00:20:43.732862+0000","last_clean":"2024-05-09T00:20:43.732862+0000","last_became_active":"2024-05-09T00:08:55.238789+0000","last_became_peered":"2024-05-09T00:08:55.238789+0000","last_unstale":"2024-05-09T00:20:43.732862+0000","last_undegraded":"2024-05-09T00:20:43.732862+0000","last_fullsized":"2024-05-09T00:20:43.732862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3606","last_scrub_stamp":"2024-05-09T00:20:43.732387+0000","last_deep_scrub":"38'3606","last_deep_scrub_stamp":"2024-05-09T00:20:43.732387+0000","last_clean_scrub_stamp":"2024-05-09T00:20:43.732387+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:56.596546+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":53395,"num_write_kb":656713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"38'3287","reported_seq":3348,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.880377+0000","last_change":"2024-05-09T00:20:28.880447+0000","last_active":"2024-05-09T00:20:28.880377+0000","last_peered":"2024-05-09T00:20:28.880377+0000","last_clean":"2024-05-09T00:20:28.880377+0000","last_became_active":"2024-05-09T00:08:45.091750+0000","last_became_peered":"2024-05-09T00:08:45.091750+0000","last_unstale":"2024-05-09T00:20:28.880377+0000","last_undegraded":"2024-05-09T00:20:28.880377+0000","last_fullsized":"2024-05-09T00:20:28.880377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3287","last_scrub_stamp":"2024-05-09T00:20:28.880148+0000","last_deep_scrub":"38'3287","last_deep_scrub_stamp":"2024-05-09T00:20:28.880148+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.880148+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:28.168577+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48685,"num_write_kb":618917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"38'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.855896+0000","last_change":"2024-05-09T00:20:24.855963+0000","last_active":"2024-05-09T00:20:24.855896+0000","last_peered":"2024-05-09T00:20:24.855896+0000","last_clean":"2024-05-09T00:20:24.855896+0000","last_became_active":"2024-05-09T00:08:44.096296+0000","last_became_peered":"2024-05-09T00:08:44.096296+0000","last_unstale":"2024-05-09T00:20:24.855896+0000","last_undegraded":"2024-05-09T00:20:24.855896+0000","last_fullsized":"2024-05-09T00:20:24.855896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:24.855692+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:24.855692+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.855692+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:09.071360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"38'116","reported_seq":175,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.892863+0000","last_change":"2024-05-09T00:20:23.892942+0000","last_active":"2024-05-09T00:20:23.892863+0000","last_peered":"2024-05-09T00:20:23.892863+0000","last_clean":"2024-05-09T00:20:23.892863+0000","last_became_active":"2024-05-09T00:08:54.227373+0000","last_became_peered":"2024-05-09T00:08:54.227373+0000","last_unstale":"2024-05-09T00:20:23.892863+0000","last_undegraded":"2024-05-09T00:20:23.892863+0000","last_fullsized":"2024-05-09T00:20:23.892863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'116","last_scrub_stamp":"2024-05-09T00:20:23.892592+0000","last_deep_scrub":"38'116","last_deep_scrub_stamp":"2024-05-09T00:20:23.892592+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.892592+0000","objects_scrubbed":2,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:41.338336+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4101,"num_write":111,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"38'4190","reported_seq":4260,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.703355+0000","last_change":"2024-05-09T00:20:21.703423+0000","last_active":"2024-05-09T00:20:21.703355+0000","last_peered":"2024-05-09T00:20:21.703355+0000","last_clean":"2024-05-09T00:20:21.703355+0000","last_became_active":"2024-05-09T00:08:55.234684+0000","last_became_peered":"2024-05-09T00:08:55.234684+0000","last_unstale":"2024-05-09T00:20:21.703355+0000","last_undegraded":"2024-05-09T00:20:21.703355+0000","last_fullsized":"2024-05-09T00:20:21.703355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4190","last_scrub_stamp":"2024-05-09T00:20:21.703116+0000","last_deep_scrub":"38'4190","last_deep_scrub_stamp":"2024-05-09T00:20:21.703116+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.703116+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:47.737108+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":62004,"num_write_kb":783810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"38'2923","reported_seq":2986,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.672197+0000","last_change":"2024-05-09T00:20:27.672264+0000","last_active":"2024-05-09T00:20:27.672197+0000","last_peered":"2024-05-09T00:20:27.672197+0000","last_clean":"2024-05-09T00:20:27.672197+0000","last_became_active":"2024-05-09T00:08:45.095424+0000","last_became_peered":"2024-05-09T00:08:45.095424+0000","last_unstale":"2024-05-09T00:20:27.672197+0000","last_undegraded":"2024-05-09T00:20:27.672197+0000","last_fullsized":"2024-05-09T00:20:27.672197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2923","last_scrub_stamp":"2024-05-09T00:20:27.671971+0000","last_deep_scrub":"38'2923","last_deep_scrub_stamp":"2024-05-09T00:20:27.671971+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.671971+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:10.398105+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43377,"num_write_kb":534691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"38'16","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.167853+0000","last_change":"2024-05-09T00:20:19.167927+0000","last_active":"2024-05-09T00:20:19.167853+0000","last_peered":"2024-05-09T00:20:19.167853+0000","last_clean":"2024-05-09T00:20:19.167853+0000","last_became_active":"2024-05-09T00:08:44.092043+0000","last_became_peered":"2024-05-09T00:08:44.092043+0000","last_unstale":"2024-05-09T00:20:19.167853+0000","last_undegraded":"2024-05-09T00:20:19.167853+0000","last_fullsized":"2024-05-09T00:20:19.167853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'16","last_scrub_stamp":"2024-05-09T00:20:19.167610+0000","last_deep_scrub":"38'16","last_deep_scrub_stamp":"2024-05-09T00:20:19.167610+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.167610+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:53.069715+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":10,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"38'19","reported_seq":83,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.365293+0000","last_change":"2024-05-09T00:20:10.365293+0000","last_active":"2024-05-09T00:20:10.365293+0000","last_peered":"2024-05-09T00:20:10.365293+0000","last_clean":"2024-05-09T00:20:10.365293+0000","last_became_active":"2024-05-09T00:08:54.219930+0000","last_became_peered":"2024-05-09T00:08:54.219930+0000","last_unstale":"2024-05-09T00:20:10.365293+0000","last_undegraded":"2024-05-09T00:20:10.365293+0000","last_fullsized":"2024-05-09T00:20:10.365293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'19","last_scrub_stamp":"2024-05-09T00:20:10.365166+0000","last_deep_scrub":"38'19","last_deep_scrub_stamp":"2024-05-09T00:20:10.365166+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.365166+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:39.230901+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":8222,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"38'3415","reported_seq":3479,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.912295+0000","last_change":"2024-05-09T00:20:20.912362+0000","last_active":"2024-05-09T00:20:20.912295+0000","last_peered":"2024-05-09T00:20:20.912295+0000","last_clean":"2024-05-09T00:20:20.912295+0000","last_became_active":"2024-05-09T00:08:55.230679+0000","last_became_peered":"2024-05-09T00:08:55.230679+0000","last_unstale":"2024-05-09T00:20:20.912295+0000","last_undegraded":"2024-05-09T00:20:20.912295+0000","last_fullsized":"2024-05-09T00:20:20.912295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3415","last_scrub_stamp":"2024-05-09T00:20:20.912050+0000","last_deep_scrub":"38'3415","last_deep_scrub_stamp":"2024-05-09T00:20:20.912050+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.912050+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:49.154731+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":50480,"num_write_kb":654641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"38'2737","reported_seq":2799,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.913319+0000","last_change":"2024-05-09T00:20:29.913613+0000","last_active":"2024-05-09T00:20:29.913319+0000","last_peered":"2024-05-09T00:20:29.913319+0000","last_clean":"2024-05-09T00:20:29.913319+0000","last_became_active":"2024-05-09T00:08:45.096204+0000","last_became_peered":"2024-05-09T00:08:45.096204+0000","last_unstale":"2024-05-09T00:20:29.913319+0000","last_undegraded":"2024-05-09T00:20:29.913319+0000","last_fullsized":"2024-05-09T00:20:29.913319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2737","last_scrub_stamp":"2024-05-09T00:20:29.913063+0000","last_deep_scrub":"38'2737","last_deep_scrub_stamp":"2024-05-09T00:20:29.913063+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.913063+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:48.696777+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":40218,"num_write_kb":499329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"38'6","reported_seq":78,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:34.696131+0000","last_change":"2024-05-09T00:20:34.696297+0000","last_active":"2024-05-09T00:20:34.696131+0000","last_peered":"2024-05-09T00:20:34.696131+0000","last_clean":"2024-05-09T00:20:34.696131+0000","last_became_active":"2024-05-09T00:08:44.093205+0000","last_became_peered":"2024-05-09T00:08:44.093205+0000","last_unstale":"2024-05-09T00:20:34.696131+0000","last_undegraded":"2024-05-09T00:20:34.696131+0000","last_fullsized":"2024-05-09T00:20:34.696131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:34.695856+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:34.695856+0000","last_clean_scrub_stamp":"2024-05-09T00:20:34.695856+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:29.677849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'29","reported_seq":111,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.398243+0000","last_change":"2024-05-09T00:20:19.398321+0000","last_active":"2024-05-09T00:20:19.398243+0000","last_peered":"2024-05-09T00:20:19.398243+0000","last_clean":"2024-05-09T00:20:19.398243+0000","last_became_active":"2024-05-09T00:08:54.213173+0000","last_became_peered":"2024-05-09T00:08:54.213173+0000","last_unstale":"2024-05-09T00:20:19.398243+0000","last_undegraded":"2024-05-09T00:20:19.398243+0000","last_fullsized":"2024-05-09T00:20:19.398243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'29","last_scrub_stamp":"2024-05-09T00:20:19.398027+0000","last_deep_scrub":"38'29","last_deep_scrub_stamp":"2024-05-09T00:20:19.398027+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.398027+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:45.427521+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":104,"num_write":26,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"38'3402","reported_seq":3470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:40.778958+0000","last_change":"2024-05-09T00:20:40.779026+0000","last_active":"2024-05-09T00:20:40.778958+0000","last_peered":"2024-05-09T00:20:40.778958+0000","last_clean":"2024-05-09T00:20:40.778958+0000","last_became_active":"2024-05-09T00:08:55.217295+0000","last_became_peered":"2024-05-09T00:08:55.217295+0000","last_unstale":"2024-05-09T00:20:40.778958+0000","last_undegraded":"2024-05-09T00:20:40.778958+0000","last_fullsized":"2024-05-09T00:20:40.778958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3402","last_scrub_stamp":"2024-05-09T00:20:40.778722+0000","last_deep_scrub":"38'3402","last_deep_scrub_stamp":"2024-05-09T00:20:40.778722+0000","last_clean_scrub_stamp":"2024-05-09T00:20:40.778722+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:07.412807+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":50468,"num_write_kb":661545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"38'3255","reported_seq":3316,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.929229+0000","last_change":"2024-05-09T00:20:19.929298+0000","last_active":"2024-05-09T00:20:19.929229+0000","last_peered":"2024-05-09T00:20:19.929229+0000","last_clean":"2024-05-09T00:20:19.929229+0000","last_became_active":"2024-05-09T00:08:45.102408+0000","last_became_peered":"2024-05-09T00:08:45.102408+0000","last_unstale":"2024-05-09T00:20:19.929229+0000","last_undegraded":"2024-05-09T00:20:19.929229+0000","last_fullsized":"2024-05-09T00:20:19.929229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3255","last_scrub_stamp":"2024-05-09T00:20:19.929001+0000","last_deep_scrub":"38'3255","last_deep_scrub_stamp":"2024-05-09T00:20:19.929001+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.929001+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:38.914851+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":48118,"num_write_kb":593457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"38'287","reported_seq":353,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.842483+0000","last_change":"2024-05-09T00:20:22.842560+0000","last_active":"2024-05-09T00:20:22.842483+0000","last_peered":"2024-05-09T00:20:22.842483+0000","last_clean":"2024-05-09T00:20:22.842483+0000","last_became_active":"2024-05-09T00:08:44.086205+0000","last_became_peered":"2024-05-09T00:08:44.086205+0000","last_unstale":"2024-05-09T00:20:22.842483+0000","last_undegraded":"2024-05-09T00:20:22.842483+0000","last_fullsized":"2024-05-09T00:20:22.842483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'287","last_scrub_stamp":"2024-05-09T00:20:22.842262+0000","last_deep_scrub":"38'287","last_deep_scrub_stamp":"2024-05-09T00:20:22.842262+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.842262+0000","objects_scrubbed":1,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:23.385265+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":56,"num_write":605,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"38'127","reported_seq":184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.960049+0000","last_change":"2024-05-09T00:20:12.960196+0000","last_active":"2024-05-09T00:20:12.960049+0000","last_peered":"2024-05-09T00:20:12.960049+0000","last_clean":"2024-05-09T00:20:12.960049+0000","last_became_active":"2024-05-09T00:08:54.220452+0000","last_became_peered":"2024-05-09T00:08:54.220452+0000","last_unstale":"2024-05-09T00:20:12.960049+0000","last_undegraded":"2024-05-09T00:20:12.960049+0000","last_fullsized":"2024-05-09T00:20:12.960049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'127","last_scrub_stamp":"2024-05-09T00:20:12.959613+0000","last_deep_scrub":"38'127","last_deep_scrub_stamp":"2024-05-09T00:20:12.959613+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.959613+0000","objects_scrubbed":2,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:25.812928+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":117,"num_write_kb":8248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"38'3842","reported_seq":3909,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.205020+0000","last_change":"2024-05-09T00:20:32.205086+0000","last_active":"2024-05-09T00:20:32.205020+0000","last_peered":"2024-05-09T00:20:32.205020+0000","last_clean":"2024-05-09T00:20:32.205020+0000","last_became_active":"2024-05-09T00:08:55.236171+0000","last_became_peered":"2024-05-09T00:08:55.236171+0000","last_unstale":"2024-05-09T00:20:32.205020+0000","last_undegraded":"2024-05-09T00:20:32.205020+0000","last_fullsized":"2024-05-09T00:20:32.205020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3842","last_scrub_stamp":"2024-05-09T00:20:32.204789+0000","last_deep_scrub":"38'3842","last_deep_scrub_stamp":"2024-05-09T00:20:32.204789+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.204789+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:28.353089+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":57074,"num_write_kb":711138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"38'3196","reported_seq":3259,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.168330+0000","last_change":"2024-05-09T00:20:25.168397+0000","last_active":"2024-05-09T00:20:25.168330+0000","last_peered":"2024-05-09T00:20:25.168330+0000","last_clean":"2024-05-09T00:20:25.168330+0000","last_became_active":"2024-05-09T00:08:45.108740+0000","last_became_peered":"2024-05-09T00:08:45.108740+0000","last_unstale":"2024-05-09T00:20:25.168330+0000","last_undegraded":"2024-05-09T00:20:25.168330+0000","last_fullsized":"2024-05-09T00:20:25.168330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3196","last_scrub_stamp":"2024-05-09T00:20:25.168083+0000","last_deep_scrub":"38'3196","last_deep_scrub_stamp":"2024-05-09T00:20:25.168083+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.168083+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:05.342792+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":47419,"num_write_kb":602470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"38'4","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.721043+0000","last_change":"2024-05-09T00:20:31.721111+0000","last_active":"2024-05-09T00:20:31.721043+0000","last_peered":"2024-05-09T00:20:31.721043+0000","last_clean":"2024-05-09T00:20:31.721043+0000","last_became_active":"2024-05-09T00:08:44.091608+0000","last_became_peered":"2024-05-09T00:08:44.091608+0000","last_unstale":"2024-05-09T00:20:31.721043+0000","last_undegraded":"2024-05-09T00:20:31.721043+0000","last_fullsized":"2024-05-09T00:20:31.721043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:31.720810+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:31.720810+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.720810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:34.103907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'1","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.225420+0000","last_change":"2024-05-09T00:20:18.225487+0000","last_active":"2024-05-09T00:20:18.225420+0000","last_peered":"2024-05-09T00:20:18.225420+0000","last_clean":"2024-05-09T00:20:18.225420+0000","last_became_active":"2024-05-09T00:08:54.213022+0000","last_became_peered":"2024-05-09T00:08:54.213022+0000","last_unstale":"2024-05-09T00:20:18.225420+0000","last_undegraded":"2024-05-09T00:20:18.225420+0000","last_fullsized":"2024-05-09T00:20:18.225420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-05-09T00:20:18.225168+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-05-09T00:20:18.225168+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.225168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:00.764729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"38'3423","reported_seq":3494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:34.815312+0000","last_change":"2024-05-09T00:20:34.815382+0000","last_active":"2024-05-09T00:20:34.815312+0000","last_peered":"2024-05-09T00:20:34.815312+0000","last_clean":"2024-05-09T00:20:34.815312+0000","last_became_active":"2024-05-09T00:08:55.233175+0000","last_became_peered":"2024-05-09T00:08:55.233175+0000","last_unstale":"2024-05-09T00:20:34.815312+0000","last_undegraded":"2024-05-09T00:20:34.815312+0000","last_fullsized":"2024-05-09T00:20:34.815312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3423","last_scrub_stamp":"2024-05-09T00:20:34.815086+0000","last_deep_scrub":"38'3423","last_deep_scrub_stamp":"2024-05-09T00:20:34.815086+0000","last_clean_scrub_stamp":"2024-05-09T00:20:34.815086+0000","objects_scrubbed":0,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:19.760432+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":50760,"num_write_kb":664501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"38'2723","reported_seq":2786,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.445919+0000","last_change":"2024-05-09T00:20:23.445988+0000","last_active":"2024-05-09T00:20:23.445919+0000","last_peered":"2024-05-09T00:20:23.445919+0000","last_clean":"2024-05-09T00:20:23.445919+0000","last_became_active":"2024-05-09T00:08:45.110935+0000","last_became_peered":"2024-05-09T00:08:45.110935+0000","last_unstale":"2024-05-09T00:20:23.445919+0000","last_undegraded":"2024-05-09T00:20:23.445919+0000","last_fullsized":"2024-05-09T00:20:23.445919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2723","last_scrub_stamp":"2024-05-09T00:20:23.445704+0000","last_deep_scrub":"38'2723","last_deep_scrub_stamp":"2024-05-09T00:20:23.445704+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.445704+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:18.254736+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40273,"num_write_kb":520250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"38'5","reported_seq":65,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.434731+0000","last_change":"2024-05-09T00:20:24.434802+0000","last_active":"2024-05-09T00:20:24.434731+0000","last_peered":"2024-05-09T00:20:24.434731+0000","last_clean":"2024-05-09T00:20:24.434731+0000","last_became_active":"2024-05-09T00:08:44.096474+0000","last_became_peered":"2024-05-09T00:08:44.096474+0000","last_unstale":"2024-05-09T00:20:24.434731+0000","last_undegraded":"2024-05-09T00:20:24.434731+0000","last_fullsized":"2024-05-09T00:20:24.434731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:24.434459+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:24.434459+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.434459+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:34.505816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'63","reported_seq":121,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.240294+0000","last_change":"2024-05-09T00:20:14.240369+0000","last_active":"2024-05-09T00:20:14.240294+0000","last_peered":"2024-05-09T00:20:14.240294+0000","last_clean":"2024-05-09T00:20:14.240294+0000","last_became_active":"2024-05-09T00:08:54.213060+0000","last_became_peered":"2024-05-09T00:08:54.213060+0000","last_unstale":"2024-05-09T00:20:14.240294+0000","last_undegraded":"2024-05-09T00:20:14.240294+0000","last_fullsized":"2024-05-09T00:20:14.240294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'63","last_scrub_stamp":"2024-05-09T00:20:14.240063+0000","last_deep_scrub":"38'63","last_deep_scrub_stamp":"2024-05-09T00:20:14.240063+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.240063+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:37.068404+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18843,"num_write":53,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"38'3161","reported_seq":3227,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.869636+0000","last_change":"2024-05-09T00:20:29.869732+0000","last_active":"2024-05-09T00:20:29.869636+0000","last_peered":"2024-05-09T00:20:29.869636+0000","last_clean":"2024-05-09T00:20:29.869636+0000","last_became_active":"2024-05-09T00:08:55.242891+0000","last_became_peered":"2024-05-09T00:08:55.242891+0000","last_unstale":"2024-05-09T00:20:29.869636+0000","last_undegraded":"2024-05-09T00:20:29.869636+0000","last_fullsized":"2024-05-09T00:20:29.869636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3161","last_scrub_stamp":"2024-05-09T00:20:29.869413+0000","last_deep_scrub":"38'3161","last_deep_scrub_stamp":"2024-05-09T00:20:29.869413+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.869413+0000","objects_scrubbed":0,"log_size":3161,"log_dups_size":0,"ondisk_log_size":3161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:55.848627+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":46450,"num_write_kb":620498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"38'2916","reported_seq":2979,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:09.126671+0000","last_change":"2024-05-09T00:20:09.126722+0000","last_active":"2024-05-09T00:20:09.126671+0000","last_peered":"2024-05-09T00:20:09.126671+0000","last_clean":"2024-05-09T00:20:09.126671+0000","last_became_active":"2024-05-09T00:08:45.110932+0000","last_became_peered":"2024-05-09T00:08:45.110932+0000","last_unstale":"2024-05-09T00:20:09.126671+0000","last_undegraded":"2024-05-09T00:20:09.126671+0000","last_fullsized":"2024-05-09T00:20:09.126671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2916","last_scrub_stamp":"2024-05-09T00:20:09.126512+0000","last_deep_scrub":"38'2916","last_deep_scrub_stamp":"2024-05-09T00:20:09.126512+0000","last_clean_scrub_stamp":"2024-05-09T00:20:09.126512+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:47.161350+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":43303,"num_write_kb":562205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"38'36","reported_seq":100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.735047+0000","last_change":"2024-05-09T00:20:29.735205+0000","last_active":"2024-05-09T00:20:29.735047+0000","last_peered":"2024-05-09T00:20:29.735047+0000","last_clean":"2024-05-09T00:20:29.735047+0000","last_became_active":"2024-05-09T00:08:44.106231+0000","last_became_peered":"2024-05-09T00:08:44.106231+0000","last_unstale":"2024-05-09T00:20:29.735047+0000","last_undegraded":"2024-05-09T00:20:29.735047+0000","last_fullsized":"2024-05-09T00:20:29.735047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'36","last_scrub_stamp":"2024-05-09T00:20:29.734791+0000","last_deep_scrub":"38'36","last_deep_scrub_stamp":"2024-05-09T00:20:29.734791+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.734791+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:09.358915+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":25,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"38'5","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.121380+0000","last_change":"2024-05-09T00:20:28.121450+0000","last_active":"2024-05-09T00:20:28.121380+0000","last_peered":"2024-05-09T00:20:28.121380+0000","last_clean":"2024-05-09T00:20:28.121380+0000","last_became_active":"2024-05-09T00:08:54.221864+0000","last_became_peered":"2024-05-09T00:08:54.221864+0000","last_unstale":"2024-05-09T00:20:28.121380+0000","last_undegraded":"2024-05-09T00:20:28.121380+0000","last_fullsized":"2024-05-09T00:20:28.121380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:28.121164+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:28.121164+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.121164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:17.004604+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"38'3104","reported_seq":3168,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.858991+0000","last_change":"2024-05-09T00:20:27.859171+0000","last_active":"2024-05-09T00:20:27.858991+0000","last_peered":"2024-05-09T00:20:27.858991+0000","last_clean":"2024-05-09T00:20:27.858991+0000","last_became_active":"2024-05-09T00:08:55.233770+0000","last_became_peered":"2024-05-09T00:08:55.233770+0000","last_unstale":"2024-05-09T00:20:27.858991+0000","last_undegraded":"2024-05-09T00:20:27.858991+0000","last_fullsized":"2024-05-09T00:20:27.858991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3104","last_scrub_stamp":"2024-05-09T00:20:27.858721+0000","last_deep_scrub":"38'3104","last_deep_scrub_stamp":"2024-05-09T00:20:27.858721+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.858721+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:31.900183+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45747,"num_write_kb":566089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"38'2907","reported_seq":2973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.518865+0000","last_change":"2024-05-09T00:20:28.518940+0000","last_active":"2024-05-09T00:20:28.518865+0000","last_peered":"2024-05-09T00:20:28.518865+0000","last_clean":"2024-05-09T00:20:28.518865+0000","last_became_active":"2024-05-09T00:08:45.092589+0000","last_became_peered":"2024-05-09T00:08:45.092589+0000","last_unstale":"2024-05-09T00:20:28.518865+0000","last_undegraded":"2024-05-09T00:20:28.518865+0000","last_fullsized":"2024-05-09T00:20:28.518865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2907","last_scrub_stamp":"2024-05-09T00:20:28.518578+0000","last_deep_scrub":"38'2907","last_deep_scrub_stamp":"2024-05-09T00:20:28.518578+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.518578+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:34.273392+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42913,"num_write_kb":561201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"38'35","reported_seq":132,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.784249+0000","last_change":"2024-05-09T00:20:14.784321+0000","last_active":"2024-05-09T00:20:14.784249+0000","last_peered":"2024-05-09T00:20:14.784249+0000","last_clean":"2024-05-09T00:20:14.784249+0000","last_became_active":"2024-05-09T00:08:44.092780+0000","last_became_peered":"2024-05-09T00:08:44.092780+0000","last_unstale":"2024-05-09T00:20:14.784249+0000","last_undegraded":"2024-05-09T00:20:14.784249+0000","last_fullsized":"2024-05-09T00:20:14.784249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'35","last_scrub_stamp":"2024-05-09T00:20:14.784031+0000","last_deep_scrub":"38'35","last_deep_scrub_stamp":"2024-05-09T00:20:14.784031+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.784031+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:09.644581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":106,"num_write":32,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"38'6","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.185363+0000","last_change":"2024-05-09T00:20:15.185435+0000","last_active":"2024-05-09T00:20:15.185363+0000","last_peered":"2024-05-09T00:20:15.185363+0000","last_clean":"2024-05-09T00:20:15.185363+0000","last_became_active":"2024-05-09T00:08:54.208909+0000","last_became_peered":"2024-05-09T00:08:54.208909+0000","last_unstale":"2024-05-09T00:20:15.185363+0000","last_undegraded":"2024-05-09T00:20:15.185363+0000","last_fullsized":"2024-05-09T00:20:15.185363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:15.185133+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:15.185133+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.185133+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:21.653175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"38'3544","reported_seq":3615,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:39.751079+0000","last_change":"2024-05-09T00:20:39.751147+0000","last_active":"2024-05-09T00:20:39.751079+0000","last_peered":"2024-05-09T00:20:39.751079+0000","last_clean":"2024-05-09T00:20:39.751079+0000","last_became_active":"2024-05-09T00:08:55.215802+0000","last_became_peered":"2024-05-09T00:08:55.215802+0000","last_unstale":"2024-05-09T00:20:39.751079+0000","last_undegraded":"2024-05-09T00:20:39.751079+0000","last_fullsized":"2024-05-09T00:20:39.751079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3544","last_scrub_stamp":"2024-05-09T00:20:39.750848+0000","last_deep_scrub":"38'3544","last_deep_scrub_stamp":"2024-05-09T00:20:39.750848+0000","last_clean_scrub_stamp":"2024-05-09T00:20:39.750848+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:19.971346+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":1,"num_write":52513,"num_write_kb":669201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"38'3009","reported_seq":3072,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.282560+0000","last_change":"2024-05-09T00:20:19.282632+0000","last_active":"2024-05-09T00:20:19.282560+0000","last_peered":"2024-05-09T00:20:19.282560+0000","last_clean":"2024-05-09T00:20:19.282560+0000","last_became_active":"2024-05-09T00:08:45.112994+0000","last_became_peered":"2024-05-09T00:08:45.112994+0000","last_unstale":"2024-05-09T00:20:19.282560+0000","last_undegraded":"2024-05-09T00:20:19.282560+0000","last_fullsized":"2024-05-09T00:20:19.282560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3009","last_scrub_stamp":"2024-05-09T00:20:19.282325+0000","last_deep_scrub":"38'3009","last_deep_scrub_stamp":"2024-05-09T00:20:19.282325+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.282325+0000","objects_scrubbed":0,"log_size":3009,"log_dups_size":0,"ondisk_log_size":3009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:12:34.319583+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44755,"num_write_kb":572857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"38'446","reported_seq":513,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:36.747928+0000","last_change":"2024-05-09T00:20:36.748028+0000","last_active":"2024-05-09T00:20:36.747928+0000","last_peered":"2024-05-09T00:20:36.747928+0000","last_clean":"2024-05-09T00:20:36.747928+0000","last_became_active":"2024-05-09T00:08:44.095331+0000","last_became_peered":"2024-05-09T00:08:44.095331+0000","last_unstale":"2024-05-09T00:20:36.747928+0000","last_undegraded":"2024-05-09T00:20:36.747928+0000","last_fullsized":"2024-05-09T00:20:36.747928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'446","last_scrub_stamp":"2024-05-09T00:20:36.747625+0000","last_deep_scrub":"38'446","last_deep_scrub_stamp":"2024-05-09T00:20:36.747625+0000","last_clean_scrub_stamp":"2024-05-09T00:20:36.747625+0000","objects_scrubbed":2,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:12.261755+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14538,"num_write":435,"num_write_kb":8538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"38'273","reported_seq":330,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.500534+0000","last_change":"2024-05-09T00:20:32.500605+0000","last_active":"2024-05-09T00:20:32.500534+0000","last_peered":"2024-05-09T00:20:32.500534+0000","last_clean":"2024-05-09T00:20:32.500534+0000","last_became_active":"2024-05-09T00:08:54.223933+0000","last_became_peered":"2024-05-09T00:08:54.223933+0000","last_unstale":"2024-05-09T00:20:32.500534+0000","last_undegraded":"2024-05-09T00:20:32.500534+0000","last_fullsized":"2024-05-09T00:20:32.500534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'273","last_scrub_stamp":"2024-05-09T00:20:32.500310+0000","last_deep_scrub":"38'273","last_deep_scrub_stamp":"2024-05-09T00:20:32.500310+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.500310+0000","objects_scrubbed":1,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:39.386666+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":46,"num_write":566,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"38'3750","reported_seq":3822,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.176844+0000","last_change":"2024-05-09T00:20:29.176912+0000","last_active":"2024-05-09T00:20:29.176844+0000","last_peered":"2024-05-09T00:20:29.176844+0000","last_clean":"2024-05-09T00:20:29.176844+0000","last_became_active":"2024-05-09T00:08:55.233226+0000","last_became_peered":"2024-05-09T00:08:55.233226+0000","last_unstale":"2024-05-09T00:20:29.176844+0000","last_undegraded":"2024-05-09T00:20:29.176844+0000","last_fullsized":"2024-05-09T00:20:29.176844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3750","last_scrub_stamp":"2024-05-09T00:20:29.176603+0000","last_deep_scrub":"38'3750","last_deep_scrub_stamp":"2024-05-09T00:20:29.176603+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.176603+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":0,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.788952+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":55664,"num_write_kb":710441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"38'3179","reported_seq":3241,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.915872+0000","last_change":"2024-05-09T00:20:17.915941+0000","last_active":"2024-05-09T00:20:17.915872+0000","last_peered":"2024-05-09T00:20:17.915872+0000","last_clean":"2024-05-09T00:20:17.915872+0000","last_became_active":"2024-05-09T00:08:45.102571+0000","last_became_peered":"2024-05-09T00:08:45.102571+0000","last_unstale":"2024-05-09T00:20:17.915872+0000","last_undegraded":"2024-05-09T00:20:17.915872+0000","last_fullsized":"2024-05-09T00:20:17.915872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3179","last_scrub_stamp":"2024-05-09T00:20:17.915621+0000","last_deep_scrub":"38'3179","last_deep_scrub_stamp":"2024-05-09T00:20:17.915621+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.915621+0000","objects_scrubbed":0,"log_size":3179,"log_dups_size":0,"ondisk_log_size":3179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:02.839395+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":46937,"num_write_kb":587038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:35.735380+0000","last_change":"2024-05-09T00:20:35.735491+0000","last_active":"2024-05-09T00:20:35.735380+0000","last_peered":"2024-05-09T00:20:35.735380+0000","last_clean":"2024-05-09T00:20:35.735380+0000","last_became_active":"2024-05-09T00:08:44.094597+0000","last_became_peered":"2024-05-09T00:08:44.094597+0000","last_unstale":"2024-05-09T00:20:35.735380+0000","last_undegraded":"2024-05-09T00:20:35.735380+0000","last_fullsized":"2024-05-09T00:20:35.735380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-05-09T00:20:35.735039+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-05-09T00:20:35.735039+0000","last_clean_scrub_stamp":"2024-05-09T00:20:35.735039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:12.939535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"38'74","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:09.819526+0000","last_change":"2024-05-09T00:20:09.819526+0000","last_active":"2024-05-09T00:20:09.819526+0000","last_peered":"2024-05-09T00:20:09.819526+0000","last_clean":"2024-05-09T00:20:09.819526+0000","last_became_active":"2024-05-09T00:08:40.005023+0000","last_became_peered":"2024-05-09T00:08:40.005023+0000","last_unstale":"2024-05-09T00:20:09.819526+0000","last_undegraded":"2024-05-09T00:20:09.819526+0000","last_fullsized":"2024-05-09T00:20:09.819526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-05-09T00:20:09.819189+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-05-09T00:20:09.819189+0000","last_clean_scrub_stamp":"2024-05-09T00:20:09.819189+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:44.100719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'4","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.657194+0000","last_change":"2024-05-09T00:20:26.657512+0000","last_active":"2024-05-09T00:20:26.657194+0000","last_peered":"2024-05-09T00:20:26.657194+0000","last_clean":"2024-05-09T00:20:26.657194+0000","last_became_active":"2024-05-09T00:08:54.210737+0000","last_became_peered":"2024-05-09T00:08:54.210737+0000","last_unstale":"2024-05-09T00:20:26.657194+0000","last_undegraded":"2024-05-09T00:20:26.657194+0000","last_fullsized":"2024-05-09T00:20:26.657194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:26.656736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:26.656736+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.656736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:16.847922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"38'3132","reported_seq":3193,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:35.506167+0000","last_change":"2024-05-09T00:20:35.506238+0000","last_active":"2024-05-09T00:20:35.506167+0000","last_peered":"2024-05-09T00:20:35.506167+0000","last_clean":"2024-05-09T00:20:35.506167+0000","last_became_active":"2024-05-09T00:08:55.216773+0000","last_became_peered":"2024-05-09T00:08:55.216773+0000","last_unstale":"2024-05-09T00:20:35.506167+0000","last_undegraded":"2024-05-09T00:20:35.506167+0000","last_fullsized":"2024-05-09T00:20:35.506167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3132","last_scrub_stamp":"2024-05-09T00:20:35.505931+0000","last_deep_scrub":"38'3132","last_deep_scrub_stamp":"2024-05-09T00:20:35.505931+0000","last_clean_scrub_stamp":"2024-05-09T00:20:35.505931+0000","objects_scrubbed":0,"log_size":3132,"log_dups_size":0,"ondisk_log_size":3132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:55.179890+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":46383,"num_write_kb":562908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'2979","reported_seq":3045,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.692003+0000","last_change":"2024-05-09T00:20:25.692071+0000","last_active":"2024-05-09T00:20:25.692003+0000","last_peered":"2024-05-09T00:20:25.692003+0000","last_clean":"2024-05-09T00:20:25.692003+0000","last_became_active":"2024-05-09T00:08:45.097722+0000","last_became_peered":"2024-05-09T00:08:45.097722+0000","last_unstale":"2024-05-09T00:20:25.692003+0000","last_undegraded":"2024-05-09T00:20:25.692003+0000","last_fullsized":"2024-05-09T00:20:25.692003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2979","last_scrub_stamp":"2024-05-09T00:20:25.691773+0000","last_deep_scrub":"38'2979","last_deep_scrub_stamp":"2024-05-09T00:20:25.691773+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.691773+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:15.593553+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":44170,"num_write_kb":571148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"38'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.211619+0000","last_change":"2024-05-09T00:20:21.211726+0000","last_active":"2024-05-09T00:20:21.211619+0000","last_peered":"2024-05-09T00:20:21.211619+0000","last_clean":"2024-05-09T00:20:21.211619+0000","last_became_active":"2024-05-09T00:08:44.100871+0000","last_became_peered":"2024-05-09T00:08:44.100871+0000","last_unstale":"2024-05-09T00:20:21.211619+0000","last_undegraded":"2024-05-09T00:20:21.211619+0000","last_fullsized":"2024-05-09T00:20:21.211619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:21.211382+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:21.211382+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.211382+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:33.761350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"38'177","reported_seq":231,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.349608+0000","last_change":"2024-05-09T00:20:15.349678+0000","last_active":"2024-05-09T00:20:15.349608+0000","last_peered":"2024-05-09T00:20:15.349608+0000","last_clean":"2024-05-09T00:20:15.349608+0000","last_became_active":"2024-05-09T00:08:54.217170+0000","last_became_peered":"2024-05-09T00:08:54.217170+0000","last_unstale":"2024-05-09T00:20:15.349608+0000","last_undegraded":"2024-05-09T00:20:15.349608+0000","last_fullsized":"2024-05-09T00:20:15.349608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'177","last_scrub_stamp":"2024-05-09T00:20:15.349363+0000","last_deep_scrub":"38'177","last_deep_scrub_stamp":"2024-05-09T00:20:15.349363+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.349363+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:55.924373+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2152331,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":38,"num_write":171,"num_write_kb":2182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"38'3176","reported_seq":3249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:35.126742+0000","last_change":"2024-05-09T00:20:35.126814+0000","last_active":"2024-05-09T00:20:35.126742+0000","last_peered":"2024-05-09T00:20:35.126742+0000","last_clean":"2024-05-09T00:20:35.126742+0000","last_became_active":"2024-05-09T00:08:55.239090+0000","last_became_peered":"2024-05-09T00:08:55.239090+0000","last_unstale":"2024-05-09T00:20:35.126742+0000","last_undegraded":"2024-05-09T00:20:35.126742+0000","last_fullsized":"2024-05-09T00:20:35.126742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3176","last_scrub_stamp":"2024-05-09T00:20:35.126467+0000","last_deep_scrub":"38'3176","last_deep_scrub_stamp":"2024-05-09T00:20:35.126467+0000","last_clean_scrub_stamp":"2024-05-09T00:20:35.126467+0000","objects_scrubbed":0,"log_size":3176,"log_dups_size":0,"ondisk_log_size":3176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:00.675828+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":47105,"num_write_kb":619272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"38'3217","reported_seq":3281,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.109658+0000","last_change":"2024-05-09T00:20:11.109724+0000","last_active":"2024-05-09T00:20:11.109658+0000","last_peered":"2024-05-09T00:20:11.109658+0000","last_clean":"2024-05-09T00:20:11.109658+0000","last_became_active":"2024-05-09T00:08:45.108967+0000","last_became_peered":"2024-05-09T00:08:45.108967+0000","last_unstale":"2024-05-09T00:20:11.109658+0000","last_undegraded":"2024-05-09T00:20:11.109658+0000","last_fullsized":"2024-05-09T00:20:11.109658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3217","last_scrub_stamp":"2024-05-09T00:20:11.109393+0000","last_deep_scrub":"38'3217","last_deep_scrub_stamp":"2024-05-09T00:20:11.109393+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.109393+0000","objects_scrubbed":0,"log_size":3217,"log_dups_size":0,"ondisk_log_size":3217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:04.651233+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":47564,"num_write_kb":594884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"38'20","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.546197+0000","last_change":"2024-05-09T00:20:26.546289+0000","last_active":"2024-05-09T00:20:26.546197+0000","last_peered":"2024-05-09T00:20:26.546197+0000","last_clean":"2024-05-09T00:20:26.546197+0000","last_became_active":"2024-05-09T00:08:44.103100+0000","last_became_peered":"2024-05-09T00:08:44.103100+0000","last_unstale":"2024-05-09T00:20:26.546197+0000","last_undegraded":"2024-05-09T00:20:26.546197+0000","last_fullsized":"2024-05-09T00:20:26.546197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'20","last_scrub_stamp":"2024-05-09T00:20:26.545875+0000","last_deep_scrub":"38'20","last_deep_scrub_stamp":"2024-05-09T00:20:26.545875+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.545875+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:26:42.569600+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"38'248","reported_seq":310,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.476814+0000","last_change":"2024-05-09T00:20:20.476892+0000","last_active":"2024-05-09T00:20:20.476814+0000","last_peered":"2024-05-09T00:20:20.476814+0000","last_clean":"2024-05-09T00:20:20.476814+0000","last_became_active":"2024-05-09T00:08:54.221142+0000","last_became_peered":"2024-05-09T00:08:54.221142+0000","last_unstale":"2024-05-09T00:20:20.476814+0000","last_undegraded":"2024-05-09T00:20:20.476814+0000","last_fullsized":"2024-05-09T00:20:20.476814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'248","last_scrub_stamp":"2024-05-09T00:20:20.476557+0000","last_deep_scrub":"38'248","last_deep_scrub_stamp":"2024-05-09T00:20:20.476557+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.476557+0000","objects_scrubbed":2,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:16.354477+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":16394,"num_write":232,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"38'3503","reported_seq":3570,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.717087+0000","last_change":"2024-05-09T00:20:19.717153+0000","last_active":"2024-05-09T00:20:19.717087+0000","last_peered":"2024-05-09T00:20:19.717087+0000","last_clean":"2024-05-09T00:20:19.717087+0000","last_became_active":"2024-05-09T00:08:55.231547+0000","last_became_peered":"2024-05-09T00:08:55.231547+0000","last_unstale":"2024-05-09T00:20:19.717087+0000","last_undegraded":"2024-05-09T00:20:19.717087+0000","last_fullsized":"2024-05-09T00:20:19.717087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3503","last_scrub_stamp":"2024-05-09T00:20:19.716862+0000","last_deep_scrub":"38'3503","last_deep_scrub_stamp":"2024-05-09T00:20:19.716862+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.716862+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:07.277018+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":51910,"num_write_kb":640187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"38'3580","reported_seq":3643,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.193181+0000","last_change":"2024-05-09T00:20:24.193248+0000","last_active":"2024-05-09T00:20:24.193181+0000","last_peered":"2024-05-09T00:20:24.193181+0000","last_clean":"2024-05-09T00:20:24.193181+0000","last_became_active":"2024-05-09T00:08:45.100397+0000","last_became_peered":"2024-05-09T00:08:45.100397+0000","last_unstale":"2024-05-09T00:20:24.193181+0000","last_undegraded":"2024-05-09T00:20:24.193181+0000","last_fullsized":"2024-05-09T00:20:24.193181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3580","last_scrub_stamp":"2024-05-09T00:20:24.192949+0000","last_deep_scrub":"38'3580","last_deep_scrub_stamp":"2024-05-09T00:20:24.192949+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.192949+0000","objects_scrubbed":0,"log_size":3580,"log_dups_size":0,"ondisk_log_size":3580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:25.907668+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":53064,"num_write_kb":670486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"38'22","reported_seq":95,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.853038+0000","last_change":"2024-05-09T00:20:25.853124+0000","last_active":"2024-05-09T00:20:25.853038+0000","last_peered":"2024-05-09T00:20:25.853038+0000","last_clean":"2024-05-09T00:20:25.853038+0000","last_became_active":"2024-05-09T00:08:44.099395+0000","last_became_peered":"2024-05-09T00:08:44.099395+0000","last_unstale":"2024-05-09T00:20:25.853038+0000","last_undegraded":"2024-05-09T00:20:25.853038+0000","last_fullsized":"2024-05-09T00:20:25.853038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'22","last_scrub_stamp":"2024-05-09T00:20:25.852793+0000","last_deep_scrub":"38'22","last_deep_scrub_stamp":"2024-05-09T00:20:25.852793+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.852793+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:46.132508+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":16,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"38'23","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.695712+0000","last_change":"2024-05-09T00:20:22.695785+0000","last_active":"2024-05-09T00:20:22.695712+0000","last_peered":"2024-05-09T00:20:22.695712+0000","last_clean":"2024-05-09T00:20:22.695712+0000","last_became_active":"2024-05-09T00:08:54.206885+0000","last_became_peered":"2024-05-09T00:08:54.206885+0000","last_unstale":"2024-05-09T00:20:22.695712+0000","last_undegraded":"2024-05-09T00:20:22.695712+0000","last_fullsized":"2024-05-09T00:20:22.695712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'23","last_scrub_stamp":"2024-05-09T00:20:22.695470+0000","last_deep_scrub":"38'23","last_deep_scrub_stamp":"2024-05-09T00:20:22.695470+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.695470+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:27.135406+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":17,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"38'3625","reported_seq":3692,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:34.151377+0000","last_change":"2024-05-09T00:20:34.151443+0000","last_active":"2024-05-09T00:20:34.151377+0000","last_peered":"2024-05-09T00:20:34.151377+0000","last_clean":"2024-05-09T00:20:34.151377+0000","last_became_active":"2024-05-09T00:08:55.239056+0000","last_became_peered":"2024-05-09T00:08:55.239056+0000","last_unstale":"2024-05-09T00:20:34.151377+0000","last_undegraded":"2024-05-09T00:20:34.151377+0000","last_fullsized":"2024-05-09T00:20:34.151377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3625","last_scrub_stamp":"2024-05-09T00:20:34.151149+0000","last_deep_scrub":"38'3625","last_deep_scrub_stamp":"2024-05-09T00:20:34.151149+0000","last_clean_scrub_stamp":"2024-05-09T00:20:34.151149+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:07.040608+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53630,"num_write_kb":693205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"38'2900","reported_seq":2965,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.483638+0000","last_change":"2024-05-09T00:20:24.483707+0000","last_active":"2024-05-09T00:20:24.483638+0000","last_peered":"2024-05-09T00:20:24.483638+0000","last_clean":"2024-05-09T00:20:24.483638+0000","last_became_active":"2024-05-09T00:08:45.111230+0000","last_became_peered":"2024-05-09T00:08:45.111230+0000","last_unstale":"2024-05-09T00:20:24.483638+0000","last_undegraded":"2024-05-09T00:20:24.483638+0000","last_fullsized":"2024-05-09T00:20:24.483638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2900","last_scrub_stamp":"2024-05-09T00:20:24.483380+0000","last_deep_scrub":"38'2900","last_deep_scrub_stamp":"2024-05-09T00:20:24.483380+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.483380+0000","objects_scrubbed":0,"log_size":2900,"log_dups_size":0,"ondisk_log_size":2900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:38.705170+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42993,"num_write_kb":541677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"38'139","reported_seq":206,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.259287+0000","last_change":"2024-05-09T00:20:22.259363+0000","last_active":"2024-05-09T00:20:22.259287+0000","last_peered":"2024-05-09T00:20:22.259287+0000","last_clean":"2024-05-09T00:20:22.259287+0000","last_became_active":"2024-05-09T00:08:44.096665+0000","last_became_peered":"2024-05-09T00:08:44.096665+0000","last_unstale":"2024-05-09T00:20:22.259287+0000","last_undegraded":"2024-05-09T00:20:22.259287+0000","last_fullsized":"2024-05-09T00:20:22.259287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'139","last_scrub_stamp":"2024-05-09T00:20:22.259056+0000","last_deep_scrub":"38'139","last_deep_scrub_stamp":"2024-05-09T00:20:22.259056+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.259056+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:54.566501+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":135,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"38'3","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.712201+0000","last_change":"2024-05-09T00:20:16.712272+0000","last_active":"2024-05-09T00:20:16.712201+0000","last_peered":"2024-05-09T00:20:16.712201+0000","last_clean":"2024-05-09T00:20:16.712201+0000","last_became_active":"2024-05-09T00:08:54.213840+0000","last_became_peered":"2024-05-09T00:08:54.213840+0000","last_unstale":"2024-05-09T00:20:16.712201+0000","last_undegraded":"2024-05-09T00:20:16.712201+0000","last_fullsized":"2024-05-09T00:20:16.712201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:16.711981+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:16.711981+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.711981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:10.852015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"38'3203","reported_seq":3267,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:36.799117+0000","last_change":"2024-05-09T00:20:36.799185+0000","last_active":"2024-05-09T00:20:36.799117+0000","last_peered":"2024-05-09T00:20:36.799117+0000","last_clean":"2024-05-09T00:20:36.799117+0000","last_became_active":"2024-05-09T00:08:55.239042+0000","last_became_peered":"2024-05-09T00:08:55.239042+0000","last_unstale":"2024-05-09T00:20:36.799117+0000","last_undegraded":"2024-05-09T00:20:36.799117+0000","last_fullsized":"2024-05-09T00:20:36.799117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3203","last_scrub_stamp":"2024-05-09T00:20:36.798915+0000","last_deep_scrub":"38'3203","last_deep_scrub_stamp":"2024-05-09T00:20:36.798915+0000","last_clean_scrub_stamp":"2024-05-09T00:20:36.798915+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:59.965859+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47433,"num_write_kb":581618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"38'2989","reported_seq":3054,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.785669+0000","last_change":"2024-05-09T00:20:18.785669+0000","last_active":"2024-05-09T00:20:18.785669+0000","last_peered":"2024-05-09T00:20:18.785669+0000","last_clean":"2024-05-09T00:20:18.785669+0000","last_became_active":"2024-05-09T00:08:45.116152+0000","last_became_peered":"2024-05-09T00:08:45.116152+0000","last_unstale":"2024-05-09T00:20:18.785669+0000","last_undegraded":"2024-05-09T00:20:18.785669+0000","last_fullsized":"2024-05-09T00:20:18.785669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2989","last_scrub_stamp":"2024-05-09T00:20:18.785326+0000","last_deep_scrub":"38'2989","last_deep_scrub_stamp":"2024-05-09T00:20:18.785326+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.785326+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:21.241067+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":44159,"num_write_kb":579264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"38'15","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.815671+0000","last_change":"2024-05-09T00:20:23.815756+0000","last_active":"2024-05-09T00:20:23.815671+0000","last_peered":"2024-05-09T00:20:23.815671+0000","last_clean":"2024-05-09T00:20:23.815671+0000","last_became_active":"2024-05-09T00:08:44.092928+0000","last_became_peered":"2024-05-09T00:08:44.092928+0000","last_unstale":"2024-05-09T00:20:23.815671+0000","last_undegraded":"2024-05-09T00:20:23.815671+0000","last_fullsized":"2024-05-09T00:20:23.815671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'15","last_scrub_stamp":"2024-05-09T00:20:23.815412+0000","last_deep_scrub":"38'15","last_deep_scrub_stamp":"2024-05-09T00:20:23.815412+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.815412+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:09.479068+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"38'4","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.457816+0000","last_change":"2024-05-09T00:20:22.457888+0000","last_active":"2024-05-09T00:20:22.457816+0000","last_peered":"2024-05-09T00:20:22.457816+0000","last_clean":"2024-05-09T00:20:22.457816+0000","last_became_active":"2024-05-09T00:08:54.221720+0000","last_became_peered":"2024-05-09T00:08:54.221720+0000","last_unstale":"2024-05-09T00:20:22.457816+0000","last_undegraded":"2024-05-09T00:20:22.457816+0000","last_fullsized":"2024-05-09T00:20:22.457816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:22.457566+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:22.457566+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.457566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:02.678652+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"38'3658","reported_seq":3724,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.799174+0000","last_change":"2024-05-09T00:20:11.799210+0000","last_active":"2024-05-09T00:20:11.799174+0000","last_peered":"2024-05-09T00:20:11.799174+0000","last_clean":"2024-05-09T00:20:11.799174+0000","last_became_active":"2024-05-09T00:08:55.214540+0000","last_became_peered":"2024-05-09T00:08:55.214540+0000","last_unstale":"2024-05-09T00:20:11.799174+0000","last_undegraded":"2024-05-09T00:20:11.799174+0000","last_fullsized":"2024-05-09T00:20:11.799174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3658","last_scrub_stamp":"2024-05-09T00:20:11.799045+0000","last_deep_scrub":"38'3658","last_deep_scrub_stamp":"2024-05-09T00:20:11.799045+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.799045+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:52.741711+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":54120,"num_write_kb":669829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"38'3320","reported_seq":3386,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.781352+0000","last_change":"2024-05-09T00:20:11.781352+0000","last_active":"2024-05-09T00:20:11.781352+0000","last_peered":"2024-05-09T00:20:11.781352+0000","last_clean":"2024-05-09T00:20:11.781352+0000","last_became_active":"2024-05-09T00:08:45.091879+0000","last_became_peered":"2024-05-09T00:08:45.091879+0000","last_unstale":"2024-05-09T00:20:11.781352+0000","last_undegraded":"2024-05-09T00:20:11.781352+0000","last_fullsized":"2024-05-09T00:20:11.781352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3320","last_scrub_stamp":"2024-05-09T00:20:11.781141+0000","last_deep_scrub":"38'3320","last_deep_scrub_stamp":"2024-05-09T00:20:11.781141+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.781141+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:17.533082+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":48969,"num_write_kb":615876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"38'6","reported_seq":66,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.197914+0000","last_change":"2024-05-09T00:20:23.197981+0000","last_active":"2024-05-09T00:20:23.197914+0000","last_peered":"2024-05-09T00:20:23.197914+0000","last_clean":"2024-05-09T00:20:23.197914+0000","last_became_active":"2024-05-09T00:08:44.102247+0000","last_became_peered":"2024-05-09T00:08:44.102247+0000","last_unstale":"2024-05-09T00:20:23.197914+0000","last_undegraded":"2024-05-09T00:20:23.197914+0000","last_fullsized":"2024-05-09T00:20:23.197914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:23.197693+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:23.197693+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.197693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:09.198489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"38'3","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.427764+0000","last_change":"2024-05-09T00:20:18.427839+0000","last_active":"2024-05-09T00:20:18.427764+0000","last_peered":"2024-05-09T00:20:18.427764+0000","last_clean":"2024-05-09T00:20:18.427764+0000","last_became_active":"2024-05-09T00:08:54.212834+0000","last_became_peered":"2024-05-09T00:08:54.212834+0000","last_unstale":"2024-05-09T00:20:18.427764+0000","last_undegraded":"2024-05-09T00:20:18.427764+0000","last_fullsized":"2024-05-09T00:20:18.427764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:18.427378+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:18.427378+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.427378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:39.733226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"38'3403","reported_seq":3471,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:42.763754+0000","last_change":"2024-05-09T00:20:42.763893+0000","last_active":"2024-05-09T00:20:42.763754+0000","last_peered":"2024-05-09T00:20:42.763754+0000","last_clean":"2024-05-09T00:20:42.763754+0000","last_became_active":"2024-05-09T00:08:55.239292+0000","last_became_peered":"2024-05-09T00:08:55.239292+0000","last_unstale":"2024-05-09T00:20:42.763754+0000","last_undegraded":"2024-05-09T00:20:42.763754+0000","last_fullsized":"2024-05-09T00:20:42.763754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3403","last_scrub_stamp":"2024-05-09T00:20:42.763479+0000","last_deep_scrub":"38'3403","last_deep_scrub_stamp":"2024-05-09T00:20:42.763479+0000","last_clean_scrub_stamp":"2024-05-09T00:20:42.763479+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:02.730867+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":50653,"num_write_kb":630818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'3543","reported_seq":3608,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.773692+0000","last_change":"2024-05-09T00:20:15.773692+0000","last_active":"2024-05-09T00:20:15.773692+0000","last_peered":"2024-05-09T00:20:15.773692+0000","last_clean":"2024-05-09T00:20:15.773692+0000","last_became_active":"2024-05-09T00:08:45.109768+0000","last_became_peered":"2024-05-09T00:08:45.109768+0000","last_unstale":"2024-05-09T00:20:15.773692+0000","last_undegraded":"2024-05-09T00:20:15.773692+0000","last_fullsized":"2024-05-09T00:20:15.773692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3543","last_scrub_stamp":"2024-05-09T00:20:15.773377+0000","last_deep_scrub":"38'3543","last_deep_scrub_stamp":"2024-05-09T00:20:15.773377+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.773377+0000","objects_scrubbed":0,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:38.809034+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":52618,"num_write_kb":653340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"38'5","reported_seq":65,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.694008+0000","last_change":"2024-05-09T00:20:32.694078+0000","last_active":"2024-05-09T00:20:32.694008+0000","last_peered":"2024-05-09T00:20:32.694008+0000","last_clean":"2024-05-09T00:20:32.694008+0000","last_became_active":"2024-05-09T00:08:44.092489+0000","last_became_peered":"2024-05-09T00:08:44.092489+0000","last_unstale":"2024-05-09T00:20:32.694008+0000","last_undegraded":"2024-05-09T00:20:32.694008+0000","last_fullsized":"2024-05-09T00:20:32.694008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:32.693773+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:32.693773+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.693773+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:48:50.147847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"38'239","reported_seq":317,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.165037+0000","last_change":"2024-05-09T00:20:16.165037+0000","last_active":"2024-05-09T00:20:16.165037+0000","last_peered":"2024-05-09T00:20:16.165037+0000","last_clean":"2024-05-09T00:20:16.165037+0000","last_became_active":"2024-05-09T00:08:54.214905+0000","last_became_peered":"2024-05-09T00:08:54.214905+0000","last_unstale":"2024-05-09T00:20:16.165037+0000","last_undegraded":"2024-05-09T00:20:16.165037+0000","last_fullsized":"2024-05-09T00:20:16.165037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'239","last_scrub_stamp":"2024-05-09T00:20:16.164718+0000","last_deep_scrub":"38'239","last_deep_scrub_stamp":"2024-05-09T00:20:16.164718+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.164718+0000","objects_scrubbed":4,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:40.285377+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":16430,"num_write":227,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"38'4717","reported_seq":4790,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.885404+0000","last_change":"2024-05-09T00:20:32.885404+0000","last_active":"2024-05-09T00:20:32.885404+0000","last_peered":"2024-05-09T00:20:32.885404+0000","last_clean":"2024-05-09T00:20:32.885404+0000","last_became_active":"2024-05-09T00:08:55.232008+0000","last_became_peered":"2024-05-09T00:08:55.232008+0000","last_unstale":"2024-05-09T00:20:32.885404+0000","last_undegraded":"2024-05-09T00:20:32.885404+0000","last_fullsized":"2024-05-09T00:20:32.885404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4717","last_scrub_stamp":"2024-05-09T00:20:32.885120+0000","last_deep_scrub":"38'4717","last_deep_scrub_stamp":"2024-05-09T00:20:32.885120+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.885120+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:51.922635+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":69946,"num_write_kb":894340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"38'2901","reported_seq":2967,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.145471+0000","last_change":"2024-05-09T00:20:26.145471+0000","last_active":"2024-05-09T00:20:26.145471+0000","last_peered":"2024-05-09T00:20:26.145471+0000","last_clean":"2024-05-09T00:20:26.145471+0000","last_became_active":"2024-05-09T00:08:45.108628+0000","last_became_peered":"2024-05-09T00:08:45.108628+0000","last_unstale":"2024-05-09T00:20:26.145471+0000","last_undegraded":"2024-05-09T00:20:26.145471+0000","last_fullsized":"2024-05-09T00:20:26.145471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2901","last_scrub_stamp":"2024-05-09T00:20:26.145175+0000","last_deep_scrub":"38'2901","last_deep_scrub_stamp":"2024-05-09T00:20:26.145175+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.145175+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":0,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:49.563816+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":42843,"num_write_kb":549063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"38'203","reported_seq":279,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.853904+0000","last_change":"2024-05-09T00:20:15.853904+0000","last_active":"2024-05-09T00:20:15.853904+0000","last_peered":"2024-05-09T00:20:15.853904+0000","last_clean":"2024-05-09T00:20:15.853904+0000","last_became_active":"2024-05-09T00:08:44.097304+0000","last_became_peered":"2024-05-09T00:08:44.097304+0000","last_unstale":"2024-05-09T00:20:15.853904+0000","last_undegraded":"2024-05-09T00:20:15.853904+0000","last_fullsized":"2024-05-09T00:20:15.853904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'203","last_scrub_stamp":"2024-05-09T00:20:15.853570+0000","last_deep_scrub":"38'203","last_deep_scrub_stamp":"2024-05-09T00:20:15.853570+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.853570+0000","objects_scrubbed":4,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.816180+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":12336,"num_write":190,"num_write_kb":8288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"38'23","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:38.707948+0000","last_change":"2024-05-09T00:20:38.708021+0000","last_active":"2024-05-09T00:20:38.707948+0000","last_peered":"2024-05-09T00:20:38.707948+0000","last_clean":"2024-05-09T00:20:38.707948+0000","last_became_active":"2024-05-09T00:08:54.215621+0000","last_became_peered":"2024-05-09T00:08:54.215621+0000","last_unstale":"2024-05-09T00:20:38.707948+0000","last_undegraded":"2024-05-09T00:20:38.707948+0000","last_fullsized":"2024-05-09T00:20:38.707948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'23","last_scrub_stamp":"2024-05-09T00:20:38.707721+0000","last_deep_scrub":"38'23","last_deep_scrub_stamp":"2024-05-09T00:20:38.707721+0000","last_clean_scrub_stamp":"2024-05-09T00:20:38.707721+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:11.163126+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"38'4177","reported_seq":4244,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:33.831509+0000","last_change":"2024-05-09T00:20:33.831509+0000","last_active":"2024-05-09T00:20:33.831509+0000","last_peered":"2024-05-09T00:20:33.831509+0000","last_clean":"2024-05-09T00:20:33.831509+0000","last_became_active":"2024-05-09T00:08:55.232855+0000","last_became_peered":"2024-05-09T00:08:55.232855+0000","last_unstale":"2024-05-09T00:20:33.831509+0000","last_undegraded":"2024-05-09T00:20:33.831509+0000","last_fullsized":"2024-05-09T00:20:33.831509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4177","last_scrub_stamp":"2024-05-09T00:20:33.831194+0000","last_deep_scrub":"38'4177","last_deep_scrub_stamp":"2024-05-09T00:20:33.831194+0000","last_clean_scrub_stamp":"2024-05-09T00:20:33.831194+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:40.663346+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":61984,"num_write_kb":766120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"38'2855","reported_seq":2917,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.174578+0000","last_change":"2024-05-09T00:20:25.174578+0000","last_active":"2024-05-09T00:20:25.174578+0000","last_peered":"2024-05-09T00:20:25.174578+0000","last_clean":"2024-05-09T00:20:25.174578+0000","last_became_active":"2024-05-09T00:08:45.102396+0000","last_became_peered":"2024-05-09T00:08:45.102396+0000","last_unstale":"2024-05-09T00:20:25.174578+0000","last_undegraded":"2024-05-09T00:20:25.174578+0000","last_fullsized":"2024-05-09T00:20:25.174578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2855","last_scrub_stamp":"2024-05-09T00:20:25.174087+0000","last_deep_scrub":"38'2855","last_deep_scrub_stamp":"2024-05-09T00:20:25.174087+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.174087+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:52:10.999562+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":42236,"num_write_kb":541614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"38'243","reported_seq":334,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.434361+0000","last_change":"2024-05-09T00:20:20.434361+0000","last_active":"2024-05-09T00:20:20.434361+0000","last_peered":"2024-05-09T00:20:20.434361+0000","last_clean":"2024-05-09T00:20:20.434361+0000","last_became_active":"2024-05-09T00:08:44.101053+0000","last_became_peered":"2024-05-09T00:08:44.101053+0000","last_unstale":"2024-05-09T00:20:20.434361+0000","last_undegraded":"2024-05-09T00:20:20.434361+0000","last_fullsized":"2024-05-09T00:20:20.434361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'243","last_scrub_stamp":"2024-05-09T00:20:20.433935+0000","last_deep_scrub":"38'243","last_deep_scrub_stamp":"2024-05-09T00:20:20.433935+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.433935+0000","objects_scrubbed":4,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:04.054496+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":55,"num_read_kb":20534,"num_write":232,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"38'5","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.911293+0000","last_change":"2024-05-09T00:20:16.911293+0000","last_active":"2024-05-09T00:20:16.911293+0000","last_peered":"2024-05-09T00:20:16.911293+0000","last_clean":"2024-05-09T00:20:16.911293+0000","last_became_active":"2024-05-09T00:08:54.221527+0000","last_became_peered":"2024-05-09T00:08:54.221527+0000","last_unstale":"2024-05-09T00:20:16.911293+0000","last_undegraded":"2024-05-09T00:20:16.911293+0000","last_fullsized":"2024-05-09T00:20:16.911293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'5","last_scrub_stamp":"2024-05-09T00:20:16.910976+0000","last_deep_scrub":"38'5","last_deep_scrub_stamp":"2024-05-09T00:20:16.910976+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.910976+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:46.575556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"38'3435","reported_seq":3500,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.122456+0000","last_change":"2024-05-09T00:20:29.122456+0000","last_active":"2024-05-09T00:20:29.122456+0000","last_peered":"2024-05-09T00:20:29.122456+0000","last_clean":"2024-05-09T00:20:29.122456+0000","last_became_active":"2024-05-09T00:08:55.208224+0000","last_became_peered":"2024-05-09T00:08:55.208224+0000","last_unstale":"2024-05-09T00:20:29.122456+0000","last_undegraded":"2024-05-09T00:20:29.122456+0000","last_fullsized":"2024-05-09T00:20:29.122456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3435","last_scrub_stamp":"2024-05-09T00:20:29.122177+0000","last_deep_scrub":"38'3435","last_deep_scrub_stamp":"2024-05-09T00:20:29.122177+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.122177+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:12.845603+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":50796,"num_write_kb":644347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"38'4141","reported_seq":4205,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.762720+0000","last_change":"2024-05-09T00:20:20.762720+0000","last_active":"2024-05-09T00:20:20.762720+0000","last_peered":"2024-05-09T00:20:20.762720+0000","last_clean":"2024-05-09T00:20:20.762720+0000","last_became_active":"2024-05-09T00:08:45.118948+0000","last_became_peered":"2024-05-09T00:08:45.118948+0000","last_unstale":"2024-05-09T00:20:20.762720+0000","last_undegraded":"2024-05-09T00:20:20.762720+0000","last_fullsized":"2024-05-09T00:20:20.762720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4141","last_scrub_stamp":"2024-05-09T00:20:20.762349+0000","last_deep_scrub":"38'4141","last_deep_scrub_stamp":"2024-05-09T00:20:20.762349+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.762349+0000","objects_scrubbed":0,"log_size":4141,"log_dups_size":0,"ondisk_log_size":4141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:52.250224+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":61445,"num_write_kb":763576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"38'23","reported_seq":101,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.780034+0000","last_change":"2024-05-09T00:20:16.780034+0000","last_active":"2024-05-09T00:20:16.780034+0000","last_peered":"2024-05-09T00:20:16.780034+0000","last_clean":"2024-05-09T00:20:16.780034+0000","last_became_active":"2024-05-09T00:08:44.102674+0000","last_became_peered":"2024-05-09T00:08:44.102674+0000","last_unstale":"2024-05-09T00:20:16.780034+0000","last_undegraded":"2024-05-09T00:20:16.780034+0000","last_fullsized":"2024-05-09T00:20:16.780034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'23","last_scrub_stamp":"2024-05-09T00:20:16.779548+0000","last_deep_scrub":"38'23","last_deep_scrub_stamp":"2024-05-09T00:20:16.779548+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.779548+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:08.012938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"38'51","reported_seq":118,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.371475+0000","last_change":"2024-05-09T00:20:13.371475+0000","last_active":"2024-05-09T00:20:13.371475+0000","last_peered":"2024-05-09T00:20:13.371475+0000","last_clean":"2024-05-09T00:20:13.371475+0000","last_became_active":"2024-05-09T00:08:54.217459+0000","last_became_peered":"2024-05-09T00:08:54.217459+0000","last_unstale":"2024-05-09T00:20:13.371475+0000","last_undegraded":"2024-05-09T00:20:13.371475+0000","last_fullsized":"2024-05-09T00:20:13.371475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'51","last_scrub_stamp":"2024-05-09T00:20:13.371135+0000","last_deep_scrub":"38'51","last_deep_scrub_stamp":"2024-05-09T00:20:13.371135+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.371135+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:12.652663+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20520,"num_write":39,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"38'3630","reported_seq":3697,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.776031+0000","last_change":"2024-05-09T00:20:13.776031+0000","last_active":"2024-05-09T00:20:13.776031+0000","last_peered":"2024-05-09T00:20:13.776031+0000","last_clean":"2024-05-09T00:20:13.776031+0000","last_became_active":"2024-05-09T00:08:55.212524+0000","last_became_peered":"2024-05-09T00:08:55.212524+0000","last_unstale":"2024-05-09T00:20:13.776031+0000","last_undegraded":"2024-05-09T00:20:13.776031+0000","last_fullsized":"2024-05-09T00:20:13.776031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3630","last_scrub_stamp":"2024-05-09T00:20:13.775902+0000","last_deep_scrub":"38'3630","last_deep_scrub_stamp":"2024-05-09T00:20:13.775902+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.775902+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:15.765630+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53585,"num_write_kb":685544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"38'2753","reported_seq":2819,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.568708+0000","last_change":"2024-05-09T00:20:13.568778+0000","last_active":"2024-05-09T00:20:13.568708+0000","last_peered":"2024-05-09T00:20:13.568708+0000","last_clean":"2024-05-09T00:20:13.568708+0000","last_became_active":"2024-05-09T00:08:45.107187+0000","last_became_peered":"2024-05-09T00:08:45.107187+0000","last_unstale":"2024-05-09T00:20:13.568708+0000","last_undegraded":"2024-05-09T00:20:13.568708+0000","last_fullsized":"2024-05-09T00:20:13.568708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2753","last_scrub_stamp":"2024-05-09T00:20:13.568452+0000","last_deep_scrub":"38'2753","last_deep_scrub_stamp":"2024-05-09T00:20:13.568452+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.568452+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:50.129039+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":40582,"num_write_kb":508970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"38'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.176824+0000","last_change":"2024-05-09T00:20:21.176824+0000","last_active":"2024-05-09T00:20:21.176824+0000","last_peered":"2024-05-09T00:20:21.176824+0000","last_clean":"2024-05-09T00:20:21.176824+0000","last_became_active":"2024-05-09T00:08:44.095727+0000","last_became_peered":"2024-05-09T00:08:44.095727+0000","last_unstale":"2024-05-09T00:20:21.176824+0000","last_undegraded":"2024-05-09T00:20:21.176824+0000","last_fullsized":"2024-05-09T00:20:21.176824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:21.176525+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:21.176525+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.176525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:39.931140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"38'16","reported_seq":96,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.827028+0000","last_change":"2024-05-09T00:20:20.827028+0000","last_active":"2024-05-09T00:20:20.827028+0000","last_peered":"2024-05-09T00:20:20.827028+0000","last_clean":"2024-05-09T00:20:20.827028+0000","last_became_active":"2024-05-09T00:08:54.222601+0000","last_became_peered":"2024-05-09T00:08:54.222601+0000","last_unstale":"2024-05-09T00:20:20.827028+0000","last_undegraded":"2024-05-09T00:20:20.827028+0000","last_fullsized":"2024-05-09T00:20:20.827028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'16","last_scrub_stamp":"2024-05-09T00:20:20.826671+0000","last_deep_scrub":"38'16","last_deep_scrub_stamp":"2024-05-09T00:20:20.826671+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.826671+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:44.726352+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"38'3942","reported_seq":4012,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.345391+0000","last_change":"2024-05-09T00:20:16.345391+0000","last_active":"2024-05-09T00:20:16.345391+0000","last_peered":"2024-05-09T00:20:16.345391+0000","last_clean":"2024-05-09T00:20:16.345391+0000","last_became_active":"2024-05-09T00:08:55.207177+0000","last_became_peered":"2024-05-09T00:08:55.207177+0000","last_unstale":"2024-05-09T00:20:16.345391+0000","last_undegraded":"2024-05-09T00:20:16.345391+0000","last_fullsized":"2024-05-09T00:20:16.345391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3942","last_scrub_stamp":"2024-05-09T00:20:16.345100+0000","last_deep_scrub":"38'3942","last_deep_scrub_stamp":"2024-05-09T00:20:16.345100+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.345100+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:18.304869+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":58547,"num_write_kb":727316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"38'3075","reported_seq":3142,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:22.416711+0000","last_change":"2024-05-09T00:20:22.416711+0000","last_active":"2024-05-09T00:20:22.416711+0000","last_peered":"2024-05-09T00:20:22.416711+0000","last_clean":"2024-05-09T00:20:22.416711+0000","last_became_active":"2024-05-09T00:08:45.110644+0000","last_became_peered":"2024-05-09T00:08:45.110644+0000","last_unstale":"2024-05-09T00:20:22.416711+0000","last_undegraded":"2024-05-09T00:20:22.416711+0000","last_fullsized":"2024-05-09T00:20:22.416711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3075","last_scrub_stamp":"2024-05-09T00:20:22.416382+0000","last_deep_scrub":"38'3075","last_deep_scrub_stamp":"2024-05-09T00:20:22.416382+0000","last_clean_scrub_stamp":"2024-05-09T00:20:22.416382+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:46.523846+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":45259,"num_write_kb":566177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"38'3","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.767719+0000","last_change":"2024-05-09T00:20:10.767719+0000","last_active":"2024-05-09T00:20:10.767719+0000","last_peered":"2024-05-09T00:20:10.767719+0000","last_clean":"2024-05-09T00:20:10.767719+0000","last_became_active":"2024-05-09T00:08:44.099325+0000","last_became_peered":"2024-05-09T00:08:44.099325+0000","last_unstale":"2024-05-09T00:20:10.767719+0000","last_undegraded":"2024-05-09T00:20:10.767719+0000","last_fullsized":"2024-05-09T00:20:10.767719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-05-09T00:20:10.767407+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-05-09T00:20:10.767407+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.767407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:35.434460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"38'6","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.932054+0000","last_change":"2024-05-09T00:20:13.932054+0000","last_active":"2024-05-09T00:20:13.932054+0000","last_peered":"2024-05-09T00:20:13.932054+0000","last_clean":"2024-05-09T00:20:13.932054+0000","last_became_active":"2024-05-09T00:08:54.216890+0000","last_became_peered":"2024-05-09T00:08:54.216890+0000","last_unstale":"2024-05-09T00:20:13.932054+0000","last_undegraded":"2024-05-09T00:20:13.932054+0000","last_fullsized":"2024-05-09T00:20:13.932054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-05-09T00:20:13.931624+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-05-09T00:20:13.931624+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.931624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:44.664006+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4386","reported_seq":4452,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.480852+0000","last_change":"2024-05-09T00:20:28.481003+0000","last_active":"2024-05-09T00:20:28.480852+0000","last_peered":"2024-05-09T00:20:28.480852+0000","last_clean":"2024-05-09T00:20:28.480852+0000","last_became_active":"2024-05-09T00:08:55.213146+0000","last_became_peered":"2024-05-09T00:08:55.213146+0000","last_unstale":"2024-05-09T00:20:28.480852+0000","last_undegraded":"2024-05-09T00:20:28.480852+0000","last_fullsized":"2024-05-09T00:20:28.480852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4386","last_scrub_stamp":"2024-05-09T00:20:28.480588+0000","last_deep_scrub":"38'4386","last_deep_scrub_stamp":"2024-05-09T00:20:28.480588+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.480588+0000","objects_scrubbed":0,"log_size":4386,"log_dups_size":0,"ondisk_log_size":4386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:09.816852+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":64971,"num_write_kb":841081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"38'50","reported_seq":105,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:11.892728+0000","last_change":"2024-05-09T00:20:11.892810+0000","last_active":"2024-05-09T00:20:11.892728+0000","last_peered":"2024-05-09T00:20:11.892728+0000","last_clean":"2024-05-09T00:20:11.892728+0000","last_became_active":"2024-05-09T00:08:54.220078+0000","last_became_peered":"2024-05-09T00:08:54.220078+0000","last_unstale":"2024-05-09T00:20:11.892728+0000","last_undegraded":"2024-05-09T00:20:11.892728+0000","last_fullsized":"2024-05-09T00:20:11.892728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'50","last_scrub_stamp":"2024-05-09T00:20:11.892434+0000","last_deep_scrub":"38'50","last_deep_scrub_stamp":"2024-05-09T00:20:11.892434+0000","last_clean_scrub_stamp":"2024-05-09T00:20:11.892434+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:35.120535+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":42,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"38'3567","reported_seq":3632,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.916229+0000","last_change":"2024-05-09T00:20:27.916295+0000","last_active":"2024-05-09T00:20:27.916229+0000","last_peered":"2024-05-09T00:20:27.916229+0000","last_clean":"2024-05-09T00:20:27.916229+0000","last_became_active":"2024-05-09T00:08:45.087809+0000","last_became_peered":"2024-05-09T00:08:45.087809+0000","last_unstale":"2024-05-09T00:20:27.916229+0000","last_undegraded":"2024-05-09T00:20:27.916229+0000","last_fullsized":"2024-05-09T00:20:27.916229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3567","last_scrub_stamp":"2024-05-09T00:20:27.915998+0000","last_deep_scrub":"38'3567","last_deep_scrub_stamp":"2024-05-09T00:20:27.915998+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.915998+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:31.782513+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":52856,"num_write_kb":662790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"38'43","reported_seq":105,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:33.768075+0000","last_change":"2024-05-09T00:20:33.768259+0000","last_active":"2024-05-09T00:20:33.768075+0000","last_peered":"2024-05-09T00:20:33.768075+0000","last_clean":"2024-05-09T00:20:33.768075+0000","last_became_active":"2024-05-09T00:08:44.092998+0000","last_became_peered":"2024-05-09T00:08:44.092998+0000","last_unstale":"2024-05-09T00:20:33.768075+0000","last_undegraded":"2024-05-09T00:20:33.768075+0000","last_fullsized":"2024-05-09T00:20:33.768075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'43","last_scrub_stamp":"2024-05-09T00:20:33.767822+0000","last_deep_scrub":"38'43","last_deep_scrub_stamp":"2024-05-09T00:20:33.767822+0000","last_clean_scrub_stamp":"2024-05-09T00:20:33.767822+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:46.997445+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":37,"num_write_kb":8217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3892","reported_seq":3962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.139433+0000","last_change":"2024-05-09T00:20:31.139504+0000","last_active":"2024-05-09T00:20:31.139433+0000","last_peered":"2024-05-09T00:20:31.139433+0000","last_clean":"2024-05-09T00:20:31.139433+0000","last_became_active":"2024-05-09T00:08:55.216542+0000","last_became_peered":"2024-05-09T00:08:55.216542+0000","last_unstale":"2024-05-09T00:20:31.139433+0000","last_undegraded":"2024-05-09T00:20:31.139433+0000","last_fullsized":"2024-05-09T00:20:31.139433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3892","last_scrub_stamp":"2024-05-09T00:20:31.139026+0000","last_deep_scrub":"38'3892","last_deep_scrub_stamp":"2024-05-09T00:20:31.139026+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.139026+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:46.549805+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":57751,"num_write_kb":734560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"38'37","reported_seq":104,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.663660+0000","last_change":"2024-05-09T00:20:28.663743+0000","last_active":"2024-05-09T00:20:28.663660+0000","last_peered":"2024-05-09T00:20:28.663660+0000","last_clean":"2024-05-09T00:20:28.663660+0000","last_became_active":"2024-05-09T00:08:54.213019+0000","last_became_peered":"2024-05-09T00:08:54.213019+0000","last_unstale":"2024-05-09T00:20:28.663660+0000","last_undegraded":"2024-05-09T00:20:28.663660+0000","last_fullsized":"2024-05-09T00:20:28.663660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'37","last_scrub_stamp":"2024-05-09T00:20:28.663398+0000","last_deep_scrub":"38'37","last_deep_scrub_stamp":"2024-05-09T00:20:28.663398+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.663398+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:20.036427+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":16404,"num_write":31,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2980","reported_seq":3044,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.557852+0000","last_change":"2024-05-09T00:20:31.557995+0000","last_active":"2024-05-09T00:20:31.557852+0000","last_peered":"2024-05-09T00:20:31.557852+0000","last_clean":"2024-05-09T00:20:31.557852+0000","last_became_active":"2024-05-09T00:08:45.096369+0000","last_became_peered":"2024-05-09T00:08:45.096369+0000","last_unstale":"2024-05-09T00:20:31.557852+0000","last_undegraded":"2024-05-09T00:20:31.557852+0000","last_fullsized":"2024-05-09T00:20:31.557852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2980","last_scrub_stamp":"2024-05-09T00:20:31.557501+0000","last_deep_scrub":"38'2980","last_deep_scrub_stamp":"2024-05-09T00:20:31.557501+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.557501+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:45.285593+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":43962,"num_write_kb":568639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"38'4","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:20.260172+0000","last_change":"2024-05-09T00:20:20.260243+0000","last_active":"2024-05-09T00:20:20.260172+0000","last_peered":"2024-05-09T00:20:20.260172+0000","last_clean":"2024-05-09T00:20:20.260172+0000","last_became_active":"2024-05-09T00:08:44.097941+0000","last_became_peered":"2024-05-09T00:08:44.097941+0000","last_unstale":"2024-05-09T00:20:20.260172+0000","last_undegraded":"2024-05-09T00:20:20.260172+0000","last_fullsized":"2024-05-09T00:20:20.260172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-05-09T00:20:20.259931+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-05-09T00:20:20.259931+0000","last_clean_scrub_stamp":"2024-05-09T00:20:20.259931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:54.712656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"38'4410","reported_seq":4481,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:35.855016+0000","last_change":"2024-05-09T00:20:35.855085+0000","last_active":"2024-05-09T00:20:35.855016+0000","last_peered":"2024-05-09T00:20:35.855016+0000","last_clean":"2024-05-09T00:20:35.855016+0000","last_became_active":"2024-05-09T00:08:55.231699+0000","last_became_peered":"2024-05-09T00:08:55.231699+0000","last_unstale":"2024-05-09T00:20:35.855016+0000","last_undegraded":"2024-05-09T00:20:35.855016+0000","last_fullsized":"2024-05-09T00:20:35.855016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4410","last_scrub_stamp":"2024-05-09T00:20:35.854776+0000","last_deep_scrub":"38'4410","last_deep_scrub_stamp":"2024-05-09T00:20:35.854776+0000","last_clean_scrub_stamp":"2024-05-09T00:20:35.854776+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:51.165109+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":65571,"num_write_kb":822347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"38'32","reported_seq":94,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:37.736489+0000","last_change":"2024-05-09T00:20:37.736570+0000","last_active":"2024-05-09T00:20:37.736489+0000","last_peered":"2024-05-09T00:20:37.736489+0000","last_clean":"2024-05-09T00:20:37.736489+0000","last_became_active":"2024-05-09T00:08:44.097354+0000","last_became_peered":"2024-05-09T00:08:44.097354+0000","last_unstale":"2024-05-09T00:20:37.736489+0000","last_undegraded":"2024-05-09T00:20:37.736489+0000","last_fullsized":"2024-05-09T00:20:37.736489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'32","last_scrub_stamp":"2024-05-09T00:20:37.736224+0000","last_deep_scrub":"38'32","last_deep_scrub_stamp":"2024-05-09T00:20:37.736224+0000","last_clean_scrub_stamp":"2024-05-09T00:20:37.736224+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:02.241248+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2411","reported_seq":2470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.938794+0000","last_change":"2024-05-09T00:20:15.938934+0000","last_active":"2024-05-09T00:20:15.938794+0000","last_peered":"2024-05-09T00:20:15.938794+0000","last_clean":"2024-05-09T00:20:15.938794+0000","last_became_active":"2024-05-09T00:08:45.105469+0000","last_became_peered":"2024-05-09T00:08:45.105469+0000","last_unstale":"2024-05-09T00:20:15.938794+0000","last_undegraded":"2024-05-09T00:20:15.938794+0000","last_fullsized":"2024-05-09T00:20:15.938794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2411","last_scrub_stamp":"2024-05-09T00:20:15.938500+0000","last_deep_scrub":"38'2411","last_deep_scrub_stamp":"2024-05-09T00:20:15.938500+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.938500+0000","objects_scrubbed":0,"log_size":2411,"log_dups_size":0,"ondisk_log_size":2411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:37.037260+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":35584,"num_write_kb":447799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"38'22","reported_seq":86,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.927300+0000","last_change":"2024-05-09T00:20:14.927376+0000","last_active":"2024-05-09T00:20:14.927300+0000","last_peered":"2024-05-09T00:20:14.927300+0000","last_clean":"2024-05-09T00:20:14.927300+0000","last_became_active":"2024-05-09T00:08:54.221231+0000","last_became_peered":"2024-05-09T00:08:54.221231+0000","last_unstale":"2024-05-09T00:20:14.927300+0000","last_undegraded":"2024-05-09T00:20:14.927300+0000","last_fullsized":"2024-05-09T00:20:14.927300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'22","last_scrub_stamp":"2024-05-09T00:20:14.927074+0000","last_deep_scrub":"38'22","last_deep_scrub_stamp":"2024-05-09T00:20:14.927074+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.927074+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:28.478375+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2608","reported_seq":2673,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:34.596296+0000","last_change":"2024-05-09T00:20:34.596371+0000","last_active":"2024-05-09T00:20:34.596296+0000","last_peered":"2024-05-09T00:20:34.596296+0000","last_clean":"2024-05-09T00:20:34.596296+0000","last_became_active":"2024-05-09T00:08:55.241754+0000","last_became_peered":"2024-05-09T00:08:55.241754+0000","last_unstale":"2024-05-09T00:20:34.596296+0000","last_undegraded":"2024-05-09T00:20:34.596296+0000","last_fullsized":"2024-05-09T00:20:34.596296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2608","last_scrub_stamp":"2024-05-09T00:20:34.596060+0000","last_deep_scrub":"38'2608","last_deep_scrub_stamp":"2024-05-09T00:20:34.596060+0000","last_clean_scrub_stamp":"2024-05-09T00:20:34.596060+0000","objects_scrubbed":0,"log_size":2608,"log_dups_size":0,"ondisk_log_size":2608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:55.460179+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":38767,"num_write_kb":481995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"38'1148","reported_seq":1212,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.553103+0000","last_change":"2024-05-09T00:20:27.553184+0000","last_active":"2024-05-09T00:20:27.553103+0000","last_peered":"2024-05-09T00:20:27.553103+0000","last_clean":"2024-05-09T00:20:27.553103+0000","last_became_active":"2024-05-09T00:08:44.106442+0000","last_became_peered":"2024-05-09T00:08:44.106442+0000","last_unstale":"2024-05-09T00:20:27.553103+0000","last_undegraded":"2024-05-09T00:20:27.553103+0000","last_fullsized":"2024-05-09T00:20:27.553103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1148","last_scrub_stamp":"2024-05-09T00:20:27.552887+0000","last_deep_scrub":"38'1148","last_deep_scrub_stamp":"2024-05-09T00:20:27.552887+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.552887+0000","objects_scrubbed":1,"log_size":1148,"log_dups_size":0,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:35.020953+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1144,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2597","reported_seq":2657,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.747644+0000","last_change":"2024-05-09T00:20:12.747700+0000","last_active":"2024-05-09T00:20:12.747644+0000","last_peered":"2024-05-09T00:20:12.747644+0000","last_clean":"2024-05-09T00:20:12.747644+0000","last_became_active":"2024-05-09T00:08:45.089132+0000","last_became_peered":"2024-05-09T00:08:45.089132+0000","last_unstale":"2024-05-09T00:20:12.747644+0000","last_undegraded":"2024-05-09T00:20:12.747644+0000","last_fullsized":"2024-05-09T00:20:12.747644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2597","last_scrub_stamp":"2024-05-09T00:20:12.747484+0000","last_deep_scrub":"38'2597","last_deep_scrub_stamp":"2024-05-09T00:20:12.747484+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.747484+0000","objects_scrubbed":0,"log_size":2597,"log_dups_size":0,"ondisk_log_size":2597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:28.339175+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":38330,"num_write_kb":482954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"38'95","reported_seq":165,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.956333+0000","last_change":"2024-05-09T00:20:21.956415+0000","last_active":"2024-05-09T00:20:21.956333+0000","last_peered":"2024-05-09T00:20:21.956333+0000","last_clean":"2024-05-09T00:20:21.956333+0000","last_became_active":"2024-05-09T00:08:54.226431+0000","last_became_peered":"2024-05-09T00:08:54.226431+0000","last_unstale":"2024-05-09T00:20:21.956333+0000","last_undegraded":"2024-05-09T00:20:21.956333+0000","last_fullsized":"2024-05-09T00:20:21.956333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'95","last_scrub_stamp":"2024-05-09T00:20:21.956084+0000","last_deep_scrub":"38'95","last_deep_scrub_stamp":"2024-05-09T00:20:21.956084+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.956084+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:42.244880+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":30171,"num_write":78,"num_write_kb":12339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"38'3350","reported_seq":3406,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:39.600352+0000","last_change":"2024-05-09T00:20:39.600425+0000","last_active":"2024-05-09T00:20:39.600352+0000","last_peered":"2024-05-09T00:20:39.600352+0000","last_clean":"2024-05-09T00:20:39.600352+0000","last_became_active":"2024-05-09T00:09:31.617773+0000","last_became_peered":"2024-05-09T00:09:31.617773+0000","last_unstale":"2024-05-09T00:20:39.600352+0000","last_undegraded":"2024-05-09T00:20:39.600352+0000","last_fullsized":"2024-05-09T00:20:39.600352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3350","last_scrub_stamp":"2024-05-09T00:20:39.600097+0000","last_deep_scrub":"38'3350","last_deep_scrub_stamp":"2024-05-09T00:20:39.600097+0000","last_clean_scrub_stamp":"2024-05-09T00:20:39.600097+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:03.850749+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":49731,"num_write_kb":622162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"38'3807","reported_seq":3871,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.384757+0000","last_change":"2024-05-09T00:20:21.384825+0000","last_active":"2024-05-09T00:20:21.384757+0000","last_peered":"2024-05-09T00:20:21.384757+0000","last_clean":"2024-05-09T00:20:21.384757+0000","last_became_active":"2024-05-09T00:08:45.103852+0000","last_became_peered":"2024-05-09T00:08:45.103852+0000","last_unstale":"2024-05-09T00:20:21.384757+0000","last_undegraded":"2024-05-09T00:20:21.384757+0000","last_fullsized":"2024-05-09T00:20:21.384757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3807","last_scrub_stamp":"2024-05-09T00:20:21.384526+0000","last_deep_scrub":"38'3807","last_deep_scrub_stamp":"2024-05-09T00:20:21.384526+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.384526+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:21.210461+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56537,"num_write_kb":719929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"38'4248","reported_seq":4313,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:37.849982+0000","last_change":"2024-05-09T00:20:37.850052+0000","last_active":"2024-05-09T00:20:37.849982+0000","last_peered":"2024-05-09T00:20:37.849982+0000","last_clean":"2024-05-09T00:20:37.849982+0000","last_became_active":"2024-05-09T00:08:55.235594+0000","last_became_peered":"2024-05-09T00:08:55.235594+0000","last_unstale":"2024-05-09T00:20:37.849982+0000","last_undegraded":"2024-05-09T00:20:37.849982+0000","last_fullsized":"2024-05-09T00:20:37.849982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4248","last_scrub_stamp":"2024-05-09T00:20:37.849738+0000","last_deep_scrub":"38'4248","last_deep_scrub_stamp":"2024-05-09T00:20:37.849738+0000","last_clean_scrub_stamp":"2024-05-09T00:20:37.849738+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:09.914867+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":62726,"num_write_kb":786275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"38'3362","reported_seq":3422,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.850430+0000","last_change":"2024-05-09T00:20:18.850490+0000","last_active":"2024-05-09T00:20:18.850430+0000","last_peered":"2024-05-09T00:20:18.850430+0000","last_clean":"2024-05-09T00:20:18.850430+0000","last_became_active":"2024-05-09T00:08:45.110769+0000","last_became_peered":"2024-05-09T00:08:45.110769+0000","last_unstale":"2024-05-09T00:20:18.850430+0000","last_undegraded":"2024-05-09T00:20:18.850430+0000","last_fullsized":"2024-05-09T00:20:18.850430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3362","last_scrub_stamp":"2024-05-09T00:20:18.850284+0000","last_deep_scrub":"38'3362","last_deep_scrub_stamp":"2024-05-09T00:20:18.850284+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.850284+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:40.073477+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":49795,"num_write_kb":622024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"38'3281","reported_seq":3346,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.411245+0000","last_change":"2024-05-09T00:20:18.411314+0000","last_active":"2024-05-09T00:20:18.411245+0000","last_peered":"2024-05-09T00:20:18.411245+0000","last_clean":"2024-05-09T00:20:18.411245+0000","last_became_active":"2024-05-09T00:08:55.208906+0000","last_became_peered":"2024-05-09T00:08:55.208906+0000","last_unstale":"2024-05-09T00:20:18.411245+0000","last_undegraded":"2024-05-09T00:20:18.411245+0000","last_fullsized":"2024-05-09T00:20:18.411245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3281","last_scrub_stamp":"2024-05-09T00:20:18.411008+0000","last_deep_scrub":"38'3281","last_deep_scrub_stamp":"2024-05-09T00:20:18.411008+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.411008+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:51.464836+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":48739,"num_write_kb":615858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"38'3810","reported_seq":3872,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.765337+0000","last_change":"2024-05-09T00:20:19.765504+0000","last_active":"2024-05-09T00:20:19.765337+0000","last_peered":"2024-05-09T00:20:19.765337+0000","last_clean":"2024-05-09T00:20:19.765337+0000","last_became_active":"2024-05-09T00:08:45.103029+0000","last_became_peered":"2024-05-09T00:08:45.103029+0000","last_unstale":"2024-05-09T00:20:19.765337+0000","last_undegraded":"2024-05-09T00:20:19.765337+0000","last_fullsized":"2024-05-09T00:20:19.765337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3810","last_scrub_stamp":"2024-05-09T00:20:19.765077+0000","last_deep_scrub":"38'3810","last_deep_scrub_stamp":"2024-05-09T00:20:19.765077+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.765077+0000","objects_scrubbed":0,"log_size":3810,"log_dups_size":0,"ondisk_log_size":3810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:53.849417+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":56385,"num_write_kb":712291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"38'3855","reported_seq":3930,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:37.542096+0000","last_change":"2024-05-09T00:20:37.542164+0000","last_active":"2024-05-09T00:20:37.542096+0000","last_peered":"2024-05-09T00:20:37.542096+0000","last_clean":"2024-05-09T00:20:37.542096+0000","last_became_active":"2024-05-09T00:08:55.236621+0000","last_became_peered":"2024-05-09T00:08:55.236621+0000","last_unstale":"2024-05-09T00:20:37.542096+0000","last_undegraded":"2024-05-09T00:20:37.542096+0000","last_fullsized":"2024-05-09T00:20:37.542096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3855","last_scrub_stamp":"2024-05-09T00:20:37.541865+0000","last_deep_scrub":"38'3855","last_deep_scrub_stamp":"2024-05-09T00:20:37.541865+0000","last_clean_scrub_stamp":"2024-05-09T00:20:37.541865+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:49.018325+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":57187,"num_write_kb":738779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"38'2596","reported_seq":2660,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.505439+0000","last_change":"2024-05-09T00:20:30.505512+0000","last_active":"2024-05-09T00:20:30.505439+0000","last_peered":"2024-05-09T00:20:30.505439+0000","last_clean":"2024-05-09T00:20:30.505439+0000","last_became_active":"2024-05-09T00:08:45.095621+0000","last_became_peered":"2024-05-09T00:08:45.095621+0000","last_unstale":"2024-05-09T00:20:30.505439+0000","last_undegraded":"2024-05-09T00:20:30.505439+0000","last_fullsized":"2024-05-09T00:20:30.505439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2596","last_scrub_stamp":"2024-05-09T00:20:30.505214+0000","last_deep_scrub":"38'2596","last_deep_scrub_stamp":"2024-05-09T00:20:30.505214+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.505214+0000","objects_scrubbed":0,"log_size":2596,"log_dups_size":0,"ondisk_log_size":2596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:48.426751+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":38426,"num_write_kb":503771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"38'4370","reported_seq":4445,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.215284+0000","last_change":"2024-05-09T00:20:31.215354+0000","last_active":"2024-05-09T00:20:31.215284+0000","last_peered":"2024-05-09T00:20:31.215284+0000","last_clean":"2024-05-09T00:20:31.215284+0000","last_became_active":"2024-05-09T00:08:55.236186+0000","last_became_peered":"2024-05-09T00:08:55.236186+0000","last_unstale":"2024-05-09T00:20:31.215284+0000","last_undegraded":"2024-05-09T00:20:31.215284+0000","last_fullsized":"2024-05-09T00:20:31.215284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4370","last_scrub_stamp":"2024-05-09T00:20:31.215046+0000","last_deep_scrub":"38'4370","last_deep_scrub_stamp":"2024-05-09T00:20:31.215046+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.215046+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:47.643877+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":64728,"num_write_kb":825535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"38'2760","reported_seq":2821,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.199180+0000","last_change":"2024-05-09T00:20:17.199248+0000","last_active":"2024-05-09T00:20:17.199180+0000","last_peered":"2024-05-09T00:20:17.199180+0000","last_clean":"2024-05-09T00:20:17.199180+0000","last_became_active":"2024-05-09T00:08:45.115269+0000","last_became_peered":"2024-05-09T00:08:45.115269+0000","last_unstale":"2024-05-09T00:20:17.199180+0000","last_undegraded":"2024-05-09T00:20:17.199180+0000","last_fullsized":"2024-05-09T00:20:17.199180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2760","last_scrub_stamp":"2024-05-09T00:20:17.198952+0000","last_deep_scrub":"38'2760","last_deep_scrub_stamp":"2024-05-09T00:20:17.198952+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.198952+0000","objects_scrubbed":0,"log_size":2760,"log_dups_size":0,"ondisk_log_size":2760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:59.115446+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40728,"num_write_kb":512798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"38'3218","reported_seq":3290,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:33.216187+0000","last_change":"2024-05-09T00:20:33.216260+0000","last_active":"2024-05-09T00:20:33.216187+0000","last_peered":"2024-05-09T00:20:33.216187+0000","last_clean":"2024-05-09T00:20:33.216187+0000","last_became_active":"2024-05-09T00:09:31.550552+0000","last_became_peered":"2024-05-09T00:09:31.550552+0000","last_unstale":"2024-05-09T00:20:33.216187+0000","last_undegraded":"2024-05-09T00:20:33.216187+0000","last_fullsized":"2024-05-09T00:20:33.216187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3218","last_scrub_stamp":"2024-05-09T00:20:33.215967+0000","last_deep_scrub":"38'3218","last_deep_scrub_stamp":"2024-05-09T00:20:33.215967+0000","last_clean_scrub_stamp":"2024-05-09T00:20:33.215967+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:35.980005+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":47610,"num_write_kb":596071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"38'3281","reported_seq":3341,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.224365+0000","last_change":"2024-05-09T00:20:23.224501+0000","last_active":"2024-05-09T00:20:23.224365+0000","last_peered":"2024-05-09T00:20:23.224365+0000","last_clean":"2024-05-09T00:20:23.224365+0000","last_became_active":"2024-05-09T00:08:45.102630+0000","last_became_peered":"2024-05-09T00:08:45.102630+0000","last_unstale":"2024-05-09T00:20:23.224365+0000","last_undegraded":"2024-05-09T00:20:23.224365+0000","last_fullsized":"2024-05-09T00:20:23.224365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3281","last_scrub_stamp":"2024-05-09T00:20:23.224081+0000","last_deep_scrub":"38'3281","last_deep_scrub_stamp":"2024-05-09T00:20:23.224081+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.224081+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:37.209272+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":48628,"num_write_kb":610539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"38'4466","reported_seq":4535,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.803902+0000","last_change":"2024-05-09T00:20:12.803972+0000","last_active":"2024-05-09T00:20:12.803902+0000","last_peered":"2024-05-09T00:20:12.803902+0000","last_clean":"2024-05-09T00:20:12.803902+0000","last_became_active":"2024-05-09T00:08:55.214910+0000","last_became_peered":"2024-05-09T00:08:55.214910+0000","last_unstale":"2024-05-09T00:20:12.803902+0000","last_undegraded":"2024-05-09T00:20:12.803902+0000","last_fullsized":"2024-05-09T00:20:12.803902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4466","last_scrub_stamp":"2024-05-09T00:20:12.803616+0000","last_deep_scrub":"38'4466","last_deep_scrub_stamp":"2024-05-09T00:20:12.803616+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.803616+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:13.927769+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":66102,"num_write_kb":855861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"38'2915","reported_seq":2976,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.489244+0000","last_change":"2024-05-09T00:20:27.489310+0000","last_active":"2024-05-09T00:20:27.489244+0000","last_peered":"2024-05-09T00:20:27.489244+0000","last_clean":"2024-05-09T00:20:27.489244+0000","last_became_active":"2024-05-09T00:08:45.113032+0000","last_became_peered":"2024-05-09T00:08:45.113032+0000","last_unstale":"2024-05-09T00:20:27.489244+0000","last_undegraded":"2024-05-09T00:20:27.489244+0000","last_fullsized":"2024-05-09T00:20:27.489244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2915","last_scrub_stamp":"2024-05-09T00:20:27.489014+0000","last_deep_scrub":"38'2915","last_deep_scrub_stamp":"2024-05-09T00:20:27.489014+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.489014+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:08:32.319227+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":43083,"num_write_kb":548362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"38'3894","reported_seq":3962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.475555+0000","last_change":"2024-05-09T00:20:31.475825+0000","last_active":"2024-05-09T00:20:31.475555+0000","last_peered":"2024-05-09T00:20:31.475555+0000","last_clean":"2024-05-09T00:20:31.475555+0000","last_became_active":"2024-05-09T00:08:55.216663+0000","last_became_peered":"2024-05-09T00:08:55.216663+0000","last_unstale":"2024-05-09T00:20:31.475555+0000","last_undegraded":"2024-05-09T00:20:31.475555+0000","last_fullsized":"2024-05-09T00:20:31.475555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3894","last_scrub_stamp":"2024-05-09T00:20:31.475186+0000","last_deep_scrub":"38'3894","last_deep_scrub_stamp":"2024-05-09T00:20:31.475186+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.475186+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:10.826472+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":57917,"num_write_kb":734296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"38'3613","reported_seq":3678,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.446836+0000","last_change":"2024-05-09T00:20:21.446908+0000","last_active":"2024-05-09T00:20:21.446836+0000","last_peered":"2024-05-09T00:20:21.446836+0000","last_clean":"2024-05-09T00:20:21.446836+0000","last_became_active":"2024-05-09T00:08:45.099713+0000","last_became_peered":"2024-05-09T00:08:45.099713+0000","last_unstale":"2024-05-09T00:20:21.446836+0000","last_undegraded":"2024-05-09T00:20:21.446836+0000","last_fullsized":"2024-05-09T00:20:21.446836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3613","last_scrub_stamp":"2024-05-09T00:20:21.446563+0000","last_deep_scrub":"38'3613","last_deep_scrub_stamp":"2024-05-09T00:20:21.446563+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.446563+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:55.268681+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":53572,"num_write_kb":689167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"38'3075","reported_seq":3139,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.869282+0000","last_change":"2024-05-09T00:20:26.869356+0000","last_active":"2024-05-09T00:20:26.869282+0000","last_peered":"2024-05-09T00:20:26.869282+0000","last_clean":"2024-05-09T00:20:26.869282+0000","last_became_active":"2024-05-09T00:08:55.227601+0000","last_became_peered":"2024-05-09T00:08:55.227601+0000","last_unstale":"2024-05-09T00:20:26.869282+0000","last_undegraded":"2024-05-09T00:20:26.869282+0000","last_fullsized":"2024-05-09T00:20:26.869282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3075","last_scrub_stamp":"2024-05-09T00:20:26.869032+0000","last_deep_scrub":"38'3075","last_deep_scrub_stamp":"2024-05-09T00:20:26.869032+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.869032+0000","objects_scrubbed":0,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:10.304940+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":45134,"num_write_kb":543879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"38'2785","reported_seq":2846,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.714158+0000","last_change":"2024-05-09T00:20:21.714225+0000","last_active":"2024-05-09T00:20:21.714158+0000","last_peered":"2024-05-09T00:20:21.714158+0000","last_clean":"2024-05-09T00:20:21.714158+0000","last_became_active":"2024-05-09T00:08:45.103942+0000","last_became_peered":"2024-05-09T00:08:45.103942+0000","last_unstale":"2024-05-09T00:20:21.714158+0000","last_undegraded":"2024-05-09T00:20:21.714158+0000","last_fullsized":"2024-05-09T00:20:21.714158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2785","last_scrub_stamp":"2024-05-09T00:20:21.713933+0000","last_deep_scrub":"38'2785","last_deep_scrub_stamp":"2024-05-09T00:20:21.713933+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.713933+0000","objects_scrubbed":0,"log_size":2785,"log_dups_size":0,"ondisk_log_size":2785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:16.638047+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":41154,"num_write_kb":511430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"38'4375","reported_seq":4446,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:41.760597+0000","last_change":"2024-05-09T00:20:41.760666+0000","last_active":"2024-05-09T00:20:41.760597+0000","last_peered":"2024-05-09T00:20:41.760597+0000","last_clean":"2024-05-09T00:20:41.760597+0000","last_became_active":"2024-05-09T00:08:55.218291+0000","last_became_peered":"2024-05-09T00:08:55.218291+0000","last_unstale":"2024-05-09T00:20:41.760597+0000","last_undegraded":"2024-05-09T00:20:41.760597+0000","last_fullsized":"2024-05-09T00:20:41.760597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4375","last_scrub_stamp":"2024-05-09T00:20:41.760306+0000","last_deep_scrub":"38'4375","last_deep_scrub_stamp":"2024-05-09T00:20:41.760306+0000","last_clean_scrub_stamp":"2024-05-09T00:20:41.760306+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:19.009941+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":64891,"num_write_kb":820909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"38'3014","reported_seq":3077,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.535814+0000","last_change":"2024-05-09T00:20:14.535884+0000","last_active":"2024-05-09T00:20:14.535814+0000","last_peered":"2024-05-09T00:20:14.535814+0000","last_clean":"2024-05-09T00:20:14.535814+0000","last_became_active":"2024-05-09T00:08:45.111075+0000","last_became_peered":"2024-05-09T00:08:45.111075+0000","last_unstale":"2024-05-09T00:20:14.535814+0000","last_undegraded":"2024-05-09T00:20:14.535814+0000","last_fullsized":"2024-05-09T00:20:14.535814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3014","last_scrub_stamp":"2024-05-09T00:20:14.535546+0000","last_deep_scrub":"38'3014","last_deep_scrub_stamp":"2024-05-09T00:20:14.535546+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.535546+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:56.457133+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":44654,"num_write_kb":570209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"38'3563","reported_seq":3631,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:33.134741+0000","last_change":"2024-05-09T00:20:33.134808+0000","last_active":"2024-05-09T00:20:33.134741+0000","last_peered":"2024-05-09T00:20:33.134741+0000","last_clean":"2024-05-09T00:20:33.134741+0000","last_became_active":"2024-05-09T00:08:55.234638+0000","last_became_peered":"2024-05-09T00:08:55.234638+0000","last_unstale":"2024-05-09T00:20:33.134741+0000","last_undegraded":"2024-05-09T00:20:33.134741+0000","last_fullsized":"2024-05-09T00:20:33.134741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3563","last_scrub_stamp":"2024-05-09T00:20:33.134482+0000","last_deep_scrub":"38'3563","last_deep_scrub_stamp":"2024-05-09T00:20:33.134482+0000","last_clean_scrub_stamp":"2024-05-09T00:20:33.134482+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:03.181190+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":52470,"num_write_kb":678263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"38'3369","reported_seq":3431,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.782404+0000","last_change":"2024-05-09T00:20:13.782540+0000","last_active":"2024-05-09T00:20:13.782404+0000","last_peered":"2024-05-09T00:20:13.782404+0000","last_clean":"2024-05-09T00:20:13.782404+0000","last_became_active":"2024-05-09T00:08:45.097844+0000","last_became_peered":"2024-05-09T00:08:45.097844+0000","last_unstale":"2024-05-09T00:20:13.782404+0000","last_undegraded":"2024-05-09T00:20:13.782404+0000","last_fullsized":"2024-05-09T00:20:13.782404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3369","last_scrub_stamp":"2024-05-09T00:20:13.782116+0000","last_deep_scrub":"38'3369","last_deep_scrub_stamp":"2024-05-09T00:20:13.782116+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.782116+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:18.834535+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":49853,"num_write_kb":630819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"38'3672","reported_seq":3741,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.905174+0000","last_change":"2024-05-09T00:20:25.905241+0000","last_active":"2024-05-09T00:20:25.905174+0000","last_peered":"2024-05-09T00:20:25.905174+0000","last_clean":"2024-05-09T00:20:25.905174+0000","last_became_active":"2024-05-09T00:08:55.225484+0000","last_became_peered":"2024-05-09T00:08:55.225484+0000","last_unstale":"2024-05-09T00:20:25.905174+0000","last_undegraded":"2024-05-09T00:20:25.905174+0000","last_fullsized":"2024-05-09T00:20:25.905174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3672","last_scrub_stamp":"2024-05-09T00:20:25.904945+0000","last_deep_scrub":"38'3672","last_deep_scrub_stamp":"2024-05-09T00:20:25.904945+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.904945+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:09.773930+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":54179,"num_write_kb":674825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"38'3222","reported_seq":3290,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:21.883806+0000","last_change":"2024-05-09T00:20:21.883949+0000","last_active":"2024-05-09T00:20:21.883806+0000","last_peered":"2024-05-09T00:20:21.883806+0000","last_clean":"2024-05-09T00:20:21.883806+0000","last_became_active":"2024-05-09T00:08:45.099451+0000","last_became_peered":"2024-05-09T00:08:45.099451+0000","last_unstale":"2024-05-09T00:20:21.883806+0000","last_undegraded":"2024-05-09T00:20:21.883806+0000","last_fullsized":"2024-05-09T00:20:21.883806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3222","last_scrub_stamp":"2024-05-09T00:20:21.883403+0000","last_deep_scrub":"38'3222","last_deep_scrub_stamp":"2024-05-09T00:20:21.883403+0000","last_clean_scrub_stamp":"2024-05-09T00:20:21.883403+0000","objects_scrubbed":0,"log_size":3222,"log_dups_size":0,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:15.054311+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":47611,"num_write_kb":602581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"38'3892","reported_seq":3962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:35.608256+0000","last_change":"2024-05-09T00:20:35.608320+0000","last_active":"2024-05-09T00:20:35.608256+0000","last_peered":"2024-05-09T00:20:35.608256+0000","last_clean":"2024-05-09T00:20:35.608256+0000","last_became_active":"2024-05-09T00:09:31.545211+0000","last_became_peered":"2024-05-09T00:09:31.545211+0000","last_unstale":"2024-05-09T00:20:35.608256+0000","last_undegraded":"2024-05-09T00:20:35.608256+0000","last_fullsized":"2024-05-09T00:20:35.608256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3892","last_scrub_stamp":"2024-05-09T00:20:35.608047+0000","last_deep_scrub":"38'3892","last_deep_scrub_stamp":"2024-05-09T00:20:35.608047+0000","last_clean_scrub_stamp":"2024-05-09T00:20:35.608047+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:06.531987+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":57743,"num_write_kb":746959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"38'3008","reported_seq":3069,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:10.112345+0000","last_change":"2024-05-09T00:20:10.112378+0000","last_active":"2024-05-09T00:20:10.112345+0000","last_peered":"2024-05-09T00:20:10.112345+0000","last_clean":"2024-05-09T00:20:10.112345+0000","last_became_active":"2024-05-09T00:08:45.103268+0000","last_became_peered":"2024-05-09T00:08:45.103268+0000","last_unstale":"2024-05-09T00:20:10.112345+0000","last_undegraded":"2024-05-09T00:20:10.112345+0000","last_fullsized":"2024-05-09T00:20:10.112345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3008","last_scrub_stamp":"2024-05-09T00:20:10.112226+0000","last_deep_scrub":"38'3008","last_deep_scrub_stamp":"2024-05-09T00:20:10.112226+0000","last_clean_scrub_stamp":"2024-05-09T00:20:10.112226+0000","objects_scrubbed":0,"log_size":3008,"log_dups_size":0,"ondisk_log_size":3008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:04.325861+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":44592,"num_write_kb":561827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"38'3782","reported_seq":3851,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.122510+0000","last_change":"2024-05-09T00:20:27.122579+0000","last_active":"2024-05-09T00:20:27.122510+0000","last_peered":"2024-05-09T00:20:27.122510+0000","last_clean":"2024-05-09T00:20:27.122510+0000","last_became_active":"2024-05-09T00:08:55.230632+0000","last_became_peered":"2024-05-09T00:08:55.230632+0000","last_unstale":"2024-05-09T00:20:27.122510+0000","last_undegraded":"2024-05-09T00:20:27.122510+0000","last_fullsized":"2024-05-09T00:20:27.122510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3782","last_scrub_stamp":"2024-05-09T00:20:27.122270+0000","last_deep_scrub":"38'3782","last_deep_scrub_stamp":"2024-05-09T00:20:27.122270+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.122270+0000","objects_scrubbed":0,"log_size":3782,"log_dups_size":0,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:32.797955+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":56061,"num_write_kb":704361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"38'3143","reported_seq":3204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.683494+0000","last_change":"2024-05-09T00:20:23.683566+0000","last_active":"2024-05-09T00:20:23.683494+0000","last_peered":"2024-05-09T00:20:23.683494+0000","last_clean":"2024-05-09T00:20:23.683494+0000","last_became_active":"2024-05-09T00:08:45.094893+0000","last_became_peered":"2024-05-09T00:08:45.094893+0000","last_unstale":"2024-05-09T00:20:23.683494+0000","last_undegraded":"2024-05-09T00:20:23.683494+0000","last_fullsized":"2024-05-09T00:20:23.683494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3143","last_scrub_stamp":"2024-05-09T00:20:23.683221+0000","last_deep_scrub":"38'3143","last_deep_scrub_stamp":"2024-05-09T00:20:23.683221+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.683221+0000","objects_scrubbed":0,"log_size":3143,"log_dups_size":0,"ondisk_log_size":3143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:23.490984+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":46620,"num_write_kb":572561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"38'3200","reported_seq":3264,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.519364+0000","last_change":"2024-05-09T00:20:32.519457+0000","last_active":"2024-05-09T00:20:32.519364+0000","last_peered":"2024-05-09T00:20:32.519364+0000","last_clean":"2024-05-09T00:20:32.519364+0000","last_became_active":"2024-05-09T00:08:55.233056+0000","last_became_peered":"2024-05-09T00:08:55.233056+0000","last_unstale":"2024-05-09T00:20:32.519364+0000","last_undegraded":"2024-05-09T00:20:32.519364+0000","last_fullsized":"2024-05-09T00:20:32.519364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3200","last_scrub_stamp":"2024-05-09T00:20:32.519122+0000","last_deep_scrub":"38'3200","last_deep_scrub_stamp":"2024-05-09T00:20:32.519122+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.519122+0000","objects_scrubbed":0,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:00.682961+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":47638,"num_write_kb":598134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"38'2549","reported_seq":2619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.868621+0000","last_change":"2024-05-09T00:20:19.868727+0000","last_active":"2024-05-09T00:20:19.868621+0000","last_peered":"2024-05-09T00:20:19.868621+0000","last_clean":"2024-05-09T00:20:19.868621+0000","last_became_active":"2024-05-09T00:08:45.114002+0000","last_became_peered":"2024-05-09T00:08:45.114002+0000","last_unstale":"2024-05-09T00:20:19.868621+0000","last_undegraded":"2024-05-09T00:20:19.868621+0000","last_fullsized":"2024-05-09T00:20:19.868621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2549","last_scrub_stamp":"2024-05-09T00:20:19.868405+0000","last_deep_scrub":"38'2549","last_deep_scrub_stamp":"2024-05-09T00:20:19.868405+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.868405+0000","objects_scrubbed":0,"log_size":2549,"log_dups_size":0,"ondisk_log_size":2549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:34.779534+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":37364,"num_write_kb":466647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"38'3628","reported_seq":3695,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.089966+0000","last_change":"2024-05-09T00:20:30.090099+0000","last_active":"2024-05-09T00:20:30.089966+0000","last_peered":"2024-05-09T00:20:30.089966+0000","last_clean":"2024-05-09T00:20:30.089966+0000","last_became_active":"2024-05-09T00:08:55.210236+0000","last_became_peered":"2024-05-09T00:08:55.210236+0000","last_unstale":"2024-05-09T00:20:30.089966+0000","last_undegraded":"2024-05-09T00:20:30.089966+0000","last_fullsized":"2024-05-09T00:20:30.089966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3628","last_scrub_stamp":"2024-05-09T00:20:30.089584+0000","last_deep_scrub":"38'3628","last_deep_scrub_stamp":"2024-05-09T00:20:30.089584+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.089584+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:24.571372+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":53577,"num_write_kb":665989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"38'3771","reported_seq":3837,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:45.711675+0000","last_change":"2024-05-09T00:20:45.711747+0000","last_active":"2024-05-09T00:20:45.711675+0000","last_peered":"2024-05-09T00:20:45.711675+0000","last_clean":"2024-05-09T00:20:45.711675+0000","last_became_active":"2024-05-09T00:09:31.551042+0000","last_became_peered":"2024-05-09T00:09:31.551042+0000","last_unstale":"2024-05-09T00:20:45.711675+0000","last_undegraded":"2024-05-09T00:20:45.711675+0000","last_fullsized":"2024-05-09T00:20:45.711675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3771","last_scrub_stamp":"2024-05-09T00:20:45.711423+0000","last_deep_scrub":"38'3771","last_deep_scrub_stamp":"2024-05-09T00:20:45.711423+0000","last_clean_scrub_stamp":"2024-05-09T00:20:45.711423+0000","objects_scrubbed":0,"log_size":3771,"log_dups_size":0,"ondisk_log_size":3771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:42.640207+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":55729,"num_write_kb":713868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"38'4117","reported_seq":4186,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.928490+0000","last_change":"2024-05-09T00:20:18.928558+0000","last_active":"2024-05-09T00:20:18.928490+0000","last_peered":"2024-05-09T00:20:18.928490+0000","last_clean":"2024-05-09T00:20:18.928490+0000","last_became_active":"2024-05-09T00:08:55.225620+0000","last_became_peered":"2024-05-09T00:08:55.225620+0000","last_unstale":"2024-05-09T00:20:18.928490+0000","last_undegraded":"2024-05-09T00:20:18.928490+0000","last_fullsized":"2024-05-09T00:20:18.928490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4117","last_scrub_stamp":"2024-05-09T00:20:18.928249+0000","last_deep_scrub":"38'4117","last_deep_scrub_stamp":"2024-05-09T00:20:18.928249+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.928249+0000","objects_scrubbed":0,"log_size":4117,"log_dups_size":0,"ondisk_log_size":4117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:23.823874+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":60808,"num_write_kb":797910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"38'2692","reported_seq":2754,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.756872+0000","last_change":"2024-05-09T00:20:16.756872+0000","last_active":"2024-05-09T00:20:16.756872+0000","last_peered":"2024-05-09T00:20:16.756872+0000","last_clean":"2024-05-09T00:20:16.756872+0000","last_became_active":"2024-05-09T00:08:45.112496+0000","last_became_peered":"2024-05-09T00:08:45.112496+0000","last_unstale":"2024-05-09T00:20:16.756872+0000","last_undegraded":"2024-05-09T00:20:16.756872+0000","last_fullsized":"2024-05-09T00:20:16.756872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2692","last_scrub_stamp":"2024-05-09T00:20:16.756574+0000","last_deep_scrub":"38'2692","last_deep_scrub_stamp":"2024-05-09T00:20:16.756574+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.756574+0000","objects_scrubbed":0,"log_size":2692,"log_dups_size":0,"ondisk_log_size":2692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:06.864332+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":39850,"num_write_kb":524211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"38'4344","reported_seq":4416,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:23.701161+0000","last_change":"2024-05-09T00:20:23.701228+0000","last_active":"2024-05-09T00:20:23.701161+0000","last_peered":"2024-05-09T00:20:23.701161+0000","last_clean":"2024-05-09T00:20:23.701161+0000","last_became_active":"2024-05-09T00:08:55.242326+0000","last_became_peered":"2024-05-09T00:08:55.242326+0000","last_unstale":"2024-05-09T00:20:23.701161+0000","last_undegraded":"2024-05-09T00:20:23.701161+0000","last_fullsized":"2024-05-09T00:20:23.701161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4344","last_scrub_stamp":"2024-05-09T00:20:23.700946+0000","last_deep_scrub":"38'4344","last_deep_scrub_stamp":"2024-05-09T00:20:23.700946+0000","last_clean_scrub_stamp":"2024-05-09T00:20:23.700946+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:37:00.348753+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":64402,"num_write_kb":850383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"38'3032","reported_seq":3099,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.494178+0000","last_change":"2024-05-09T00:20:15.494178+0000","last_active":"2024-05-09T00:20:15.494178+0000","last_peered":"2024-05-09T00:20:15.494178+0000","last_clean":"2024-05-09T00:20:15.494178+0000","last_became_active":"2024-05-09T00:08:45.106729+0000","last_became_peered":"2024-05-09T00:08:45.106729+0000","last_unstale":"2024-05-09T00:20:15.494178+0000","last_undegraded":"2024-05-09T00:20:15.494178+0000","last_fullsized":"2024-05-09T00:20:15.494178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3032","last_scrub_stamp":"2024-05-09T00:20:15.493865+0000","last_deep_scrub":"38'3032","last_deep_scrub_stamp":"2024-05-09T00:20:15.493865+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.493865+0000","objects_scrubbed":0,"log_size":3032,"log_dups_size":0,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:42.879748+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":44827,"num_write_kb":567733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"38'3034","reported_seq":3100,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:18.736275+0000","last_change":"2024-05-09T00:20:18.736354+0000","last_active":"2024-05-09T00:20:18.736275+0000","last_peered":"2024-05-09T00:20:18.736275+0000","last_clean":"2024-05-09T00:20:18.736275+0000","last_became_active":"2024-05-09T00:08:55.209840+0000","last_became_peered":"2024-05-09T00:08:55.209840+0000","last_unstale":"2024-05-09T00:20:18.736275+0000","last_undegraded":"2024-05-09T00:20:18.736275+0000","last_fullsized":"2024-05-09T00:20:18.736275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3034","last_scrub_stamp":"2024-05-09T00:20:18.736057+0000","last_deep_scrub":"38'3034","last_deep_scrub_stamp":"2024-05-09T00:20:18.736057+0000","last_clean_scrub_stamp":"2024-05-09T00:20:18.736057+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:40.654257+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":44931,"num_write_kb":564239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"38'2966","reported_seq":3032,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.206164+0000","last_change":"2024-05-09T00:20:24.206164+0000","last_active":"2024-05-09T00:20:24.206164+0000","last_peered":"2024-05-09T00:20:24.206164+0000","last_clean":"2024-05-09T00:20:24.206164+0000","last_became_active":"2024-05-09T00:08:45.105442+0000","last_became_peered":"2024-05-09T00:08:45.105442+0000","last_unstale":"2024-05-09T00:20:24.206164+0000","last_undegraded":"2024-05-09T00:20:24.206164+0000","last_fullsized":"2024-05-09T00:20:24.206164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2966","last_scrub_stamp":"2024-05-09T00:20:24.205680+0000","last_deep_scrub":"38'2966","last_deep_scrub_stamp":"2024-05-09T00:20:24.205680+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.205680+0000","objects_scrubbed":0,"log_size":2966,"log_dups_size":0,"ondisk_log_size":2966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:39.694129+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":43736,"num_write_kb":568620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"38'3544","reported_seq":3610,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:44.688002+0000","last_change":"2024-05-09T00:20:44.688070+0000","last_active":"2024-05-09T00:20:44.688002+0000","last_peered":"2024-05-09T00:20:44.688002+0000","last_clean":"2024-05-09T00:20:44.688002+0000","last_became_active":"2024-05-09T00:08:55.242758+0000","last_became_peered":"2024-05-09T00:08:55.242758+0000","last_unstale":"2024-05-09T00:20:44.688002+0000","last_undegraded":"2024-05-09T00:20:44.688002+0000","last_fullsized":"2024-05-09T00:20:44.688002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3544","last_scrub_stamp":"2024-05-09T00:20:44.687774+0000","last_deep_scrub":"38'3544","last_deep_scrub_stamp":"2024-05-09T00:20:44.687774+0000","last_clean_scrub_stamp":"2024-05-09T00:20:44.687774+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:04.869093+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":52851,"num_write_kb":659445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"38'2755","reported_seq":2823,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:27.120362+0000","last_change":"2024-05-09T00:20:27.120362+0000","last_active":"2024-05-09T00:20:27.120362+0000","last_peered":"2024-05-09T00:20:27.120362+0000","last_clean":"2024-05-09T00:20:27.120362+0000","last_became_active":"2024-05-09T00:08:45.108691+0000","last_became_peered":"2024-05-09T00:08:45.108691+0000","last_unstale":"2024-05-09T00:20:27.120362+0000","last_undegraded":"2024-05-09T00:20:27.120362+0000","last_fullsized":"2024-05-09T00:20:27.120362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2755","last_scrub_stamp":"2024-05-09T00:20:27.119936+0000","last_deep_scrub":"38'2755","last_deep_scrub_stamp":"2024-05-09T00:20:27.119936+0000","last_clean_scrub_stamp":"2024-05-09T00:20:27.119936+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:48.882399+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":40873,"num_write_kb":526996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"38'3706","reported_seq":3779,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:31.895231+0000","last_change":"2024-05-09T00:20:31.895231+0000","last_active":"2024-05-09T00:20:31.895231+0000","last_peered":"2024-05-09T00:20:31.895231+0000","last_clean":"2024-05-09T00:20:31.895231+0000","last_became_active":"2024-05-09T00:08:55.233704+0000","last_became_peered":"2024-05-09T00:08:55.233704+0000","last_unstale":"2024-05-09T00:20:31.895231+0000","last_undegraded":"2024-05-09T00:20:31.895231+0000","last_fullsized":"2024-05-09T00:20:31.895231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3706","last_scrub_stamp":"2024-05-09T00:20:31.894762+0000","last_deep_scrub":"38'3706","last_deep_scrub_stamp":"2024-05-09T00:20:31.894762+0000","last_clean_scrub_stamp":"2024-05-09T00:20:31.894762+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.071916+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":54772,"num_write_kb":692736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"38'2556","reported_seq":2619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:13.138215+0000","last_change":"2024-05-09T00:20:13.138287+0000","last_active":"2024-05-09T00:20:13.138215+0000","last_peered":"2024-05-09T00:20:13.138215+0000","last_clean":"2024-05-09T00:20:13.138215+0000","last_became_active":"2024-05-09T00:08:45.102866+0000","last_became_peered":"2024-05-09T00:08:45.102866+0000","last_unstale":"2024-05-09T00:20:13.138215+0000","last_undegraded":"2024-05-09T00:20:13.138215+0000","last_fullsized":"2024-05-09T00:20:13.138215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2556","last_scrub_stamp":"2024-05-09T00:20:13.137981+0000","last_deep_scrub":"38'2556","last_deep_scrub_stamp":"2024-05-09T00:20:13.137981+0000","last_clean_scrub_stamp":"2024-05-09T00:20:13.137981+0000","objects_scrubbed":0,"log_size":2556,"log_dups_size":0,"ondisk_log_size":2556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:47.448591+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":37712,"num_write_kb":481655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"38'3255","reported_seq":3324,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:32.103902+0000","last_change":"2024-05-09T00:20:32.104034+0000","last_active":"2024-05-09T00:20:32.103902+0000","last_peered":"2024-05-09T00:20:32.103902+0000","last_clean":"2024-05-09T00:20:32.103902+0000","last_became_active":"2024-05-09T00:08:55.231437+0000","last_became_peered":"2024-05-09T00:08:55.231437+0000","last_unstale":"2024-05-09T00:20:32.103902+0000","last_undegraded":"2024-05-09T00:20:32.103902+0000","last_fullsized":"2024-05-09T00:20:32.103902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3255","last_scrub_stamp":"2024-05-09T00:20:32.103447+0000","last_deep_scrub":"38'3255","last_deep_scrub_stamp":"2024-05-09T00:20:32.103447+0000","last_clean_scrub_stamp":"2024-05-09T00:20:32.103447+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:42.554532+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":48245,"num_write_kb":626583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"38'2916","reported_seq":2979,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.178846+0000","last_change":"2024-05-09T00:20:14.178891+0000","last_active":"2024-05-09T00:20:14.178846+0000","last_peered":"2024-05-09T00:20:14.178846+0000","last_clean":"2024-05-09T00:20:14.178846+0000","last_became_active":"2024-05-09T00:08:45.125424+0000","last_became_peered":"2024-05-09T00:08:45.125424+0000","last_unstale":"2024-05-09T00:20:14.178846+0000","last_undegraded":"2024-05-09T00:20:14.178846+0000","last_fullsized":"2024-05-09T00:20:14.178846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2916","last_scrub_stamp":"2024-05-09T00:20:14.178683+0000","last_deep_scrub":"38'2916","last_deep_scrub_stamp":"2024-05-09T00:20:14.178683+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.178683+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:07.732646+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":43226,"num_write_kb":536465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"38'3196","reported_seq":3258,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:30.164892+0000","last_change":"2024-05-09T00:20:30.164892+0000","last_active":"2024-05-09T00:20:30.164892+0000","last_peered":"2024-05-09T00:20:30.164892+0000","last_clean":"2024-05-09T00:20:30.164892+0000","last_became_active":"2024-05-09T00:08:55.233897+0000","last_became_peered":"2024-05-09T00:08:55.233897+0000","last_unstale":"2024-05-09T00:20:30.164892+0000","last_undegraded":"2024-05-09T00:20:30.164892+0000","last_fullsized":"2024-05-09T00:20:30.164892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3196","last_scrub_stamp":"2024-05-09T00:20:30.164580+0000","last_deep_scrub":"38'3196","last_deep_scrub_stamp":"2024-05-09T00:20:30.164580+0000","last_clean_scrub_stamp":"2024-05-09T00:20:30.164580+0000","objects_scrubbed":0,"log_size":3196,"log_dups_size":0,"ondisk_log_size":3196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:18.969021+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":47414,"num_write_kb":607139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"38'3503","reported_seq":3566,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:12.107047+0000","last_change":"2024-05-09T00:20:12.107113+0000","last_active":"2024-05-09T00:20:12.107047+0000","last_peered":"2024-05-09T00:20:12.107047+0000","last_clean":"2024-05-09T00:20:12.107047+0000","last_became_active":"2024-05-09T00:08:45.117021+0000","last_became_peered":"2024-05-09T00:08:45.117021+0000","last_unstale":"2024-05-09T00:20:12.107047+0000","last_undegraded":"2024-05-09T00:20:12.107047+0000","last_fullsized":"2024-05-09T00:20:12.107047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3503","last_scrub_stamp":"2024-05-09T00:20:12.106895+0000","last_deep_scrub":"38'3503","last_deep_scrub_stamp":"2024-05-09T00:20:12.106895+0000","last_clean_scrub_stamp":"2024-05-09T00:20:12.106895+0000","objects_scrubbed":0,"log_size":3503,"log_dups_size":0,"ondisk_log_size":3503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:44.222985+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":51962,"num_write_kb":660810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"38'3882","reported_seq":3953,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:28.167872+0000","last_change":"2024-05-09T00:20:28.167872+0000","last_active":"2024-05-09T00:20:28.167872+0000","last_peered":"2024-05-09T00:20:28.167872+0000","last_clean":"2024-05-09T00:20:28.167872+0000","last_became_active":"2024-05-09T00:08:55.230753+0000","last_became_peered":"2024-05-09T00:08:55.230753+0000","last_unstale":"2024-05-09T00:20:28.167872+0000","last_undegraded":"2024-05-09T00:20:28.167872+0000","last_fullsized":"2024-05-09T00:20:28.167872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3882","last_scrub_stamp":"2024-05-09T00:20:28.167571+0000","last_deep_scrub":"38'3882","last_deep_scrub_stamp":"2024-05-09T00:20:28.167571+0000","last_clean_scrub_stamp":"2024-05-09T00:20:28.167571+0000","objects_scrubbed":0,"log_size":3882,"log_dups_size":0,"ondisk_log_size":3882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:29.295629+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":57695,"num_write_kb":692841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"38'3732","reported_seq":3791,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.791931+0000","last_change":"2024-05-09T00:20:15.791999+0000","last_active":"2024-05-09T00:20:15.791931+0000","last_peered":"2024-05-09T00:20:15.791931+0000","last_clean":"2024-05-09T00:20:15.791931+0000","last_became_active":"2024-05-09T00:08:45.098598+0000","last_became_peered":"2024-05-09T00:08:45.098598+0000","last_unstale":"2024-05-09T00:20:15.791931+0000","last_undegraded":"2024-05-09T00:20:15.791931+0000","last_fullsized":"2024-05-09T00:20:15.791931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3732","last_scrub_stamp":"2024-05-09T00:20:15.791705+0000","last_deep_scrub":"38'3732","last_deep_scrub_stamp":"2024-05-09T00:20:15.791705+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.791705+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:01.837637+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":55072,"num_write_kb":708295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"38'4565","reported_seq":4637,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:36.564172+0000","last_change":"2024-05-09T00:20:36.564248+0000","last_active":"2024-05-09T00:20:36.564172+0000","last_peered":"2024-05-09T00:20:36.564172+0000","last_clean":"2024-05-09T00:20:36.564172+0000","last_became_active":"2024-05-09T00:08:55.233570+0000","last_became_peered":"2024-05-09T00:08:55.233570+0000","last_unstale":"2024-05-09T00:20:36.564172+0000","last_undegraded":"2024-05-09T00:20:36.564172+0000","last_fullsized":"2024-05-09T00:20:36.564172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4565","last_scrub_stamp":"2024-05-09T00:20:36.563923+0000","last_deep_scrub":"38'4565","last_deep_scrub_stamp":"2024-05-09T00:20:36.563923+0000","last_clean_scrub_stamp":"2024-05-09T00:20:36.563923+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:55.092554+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":67870,"num_write_kb":862032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"38'3274","reported_seq":3337,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.471425+0000","last_change":"2024-05-09T00:20:17.471492+0000","last_active":"2024-05-09T00:20:17.471425+0000","last_peered":"2024-05-09T00:20:17.471425+0000","last_clean":"2024-05-09T00:20:17.471425+0000","last_became_active":"2024-05-09T00:08:45.103343+0000","last_became_peered":"2024-05-09T00:08:45.103343+0000","last_unstale":"2024-05-09T00:20:17.471425+0000","last_undegraded":"2024-05-09T00:20:17.471425+0000","last_fullsized":"2024-05-09T00:20:17.471425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3274","last_scrub_stamp":"2024-05-09T00:20:17.471199+0000","last_deep_scrub":"38'3274","last_deep_scrub_stamp":"2024-05-09T00:20:17.471199+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.471199+0000","objects_scrubbed":0,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:51.978298+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":48595,"num_write_kb":613070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"38'3191","reported_seq":3257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:33.558207+0000","last_change":"2024-05-09T00:20:33.558273+0000","last_active":"2024-05-09T00:20:33.558207+0000","last_peered":"2024-05-09T00:20:33.558207+0000","last_clean":"2024-05-09T00:20:33.558207+0000","last_became_active":"2024-05-09T00:08:55.236653+0000","last_became_peered":"2024-05-09T00:08:55.236653+0000","last_unstale":"2024-05-09T00:20:33.558207+0000","last_undegraded":"2024-05-09T00:20:33.558207+0000","last_fullsized":"2024-05-09T00:20:33.558207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3191","last_scrub_stamp":"2024-05-09T00:20:33.557976+0000","last_deep_scrub":"38'3191","last_deep_scrub_stamp":"2024-05-09T00:20:33.557976+0000","last_clean_scrub_stamp":"2024-05-09T00:20:33.557976+0000","objects_scrubbed":0,"log_size":3191,"log_dups_size":0,"ondisk_log_size":3191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:34.437001+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":47307,"num_write_kb":598779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"38'2895","reported_seq":2959,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:15.214613+0000","last_change":"2024-05-09T00:20:15.214746+0000","last_active":"2024-05-09T00:20:15.214613+0000","last_peered":"2024-05-09T00:20:15.214613+0000","last_clean":"2024-05-09T00:20:15.214613+0000","last_became_active":"2024-05-09T00:08:45.103075+0000","last_became_peered":"2024-05-09T00:08:45.103075+0000","last_unstale":"2024-05-09T00:20:15.214613+0000","last_undegraded":"2024-05-09T00:20:15.214613+0000","last_fullsized":"2024-05-09T00:20:15.214613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2895","last_scrub_stamp":"2024-05-09T00:20:15.214335+0000","last_deep_scrub":"38'2895","last_deep_scrub_stamp":"2024-05-09T00:20:15.214335+0000","last_clean_scrub_stamp":"2024-05-09T00:20:15.214335+0000","objects_scrubbed":0,"log_size":2895,"log_dups_size":0,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:59:30.039132+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":42980,"num_write_kb":536887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"38'3240","reported_seq":3306,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:38.588884+0000","last_change":"2024-05-09T00:20:38.588955+0000","last_active":"2024-05-09T00:20:38.588884+0000","last_peered":"2024-05-09T00:20:38.588884+0000","last_clean":"2024-05-09T00:20:38.588884+0000","last_became_active":"2024-05-09T00:09:31.548548+0000","last_became_peered":"2024-05-09T00:09:31.548548+0000","last_unstale":"2024-05-09T00:20:38.588884+0000","last_undegraded":"2024-05-09T00:20:38.588884+0000","last_fullsized":"2024-05-09T00:20:38.588884+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3240","last_scrub_stamp":"2024-05-09T00:20:38.588563+0000","last_deep_scrub":"38'3240","last_deep_scrub_stamp":"2024-05-09T00:20:38.588563+0000","last_clean_scrub_stamp":"2024-05-09T00:20:38.588563+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:37.205101+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":48187,"num_write_kb":638325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3a","version":"38'2713","reported_seq":2773,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:26.534691+0000","last_change":"2024-05-09T00:20:26.534760+0000","last_active":"2024-05-09T00:20:26.534691+0000","last_peered":"2024-05-09T00:20:26.534691+0000","last_clean":"2024-05-09T00:20:26.534691+0000","last_became_active":"2024-05-09T00:08:45.112234+0000","last_became_peered":"2024-05-09T00:08:45.112234+0000","last_unstale":"2024-05-09T00:20:26.534691+0000","last_undegraded":"2024-05-09T00:20:26.534691+0000","last_fullsized":"2024-05-09T00:20:26.534691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2713","last_scrub_stamp":"2024-05-09T00:20:26.534454+0000","last_deep_scrub":"38'2713","last_deep_scrub_stamp":"2024-05-09T00:20:26.534454+0000","last_clean_scrub_stamp":"2024-05-09T00:20:26.534454+0000","objects_scrubbed":0,"log_size":2713,"log_dups_size":0,"ondisk_log_size":2713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:03.665864+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":40136,"num_write_kb":502625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"38'3769","reported_seq":3837,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.717261+0000","last_change":"2024-05-09T00:20:17.717328+0000","last_active":"2024-05-09T00:20:17.717261+0000","last_peered":"2024-05-09T00:20:17.717261+0000","last_clean":"2024-05-09T00:20:17.717261+0000","last_became_active":"2024-05-09T00:08:55.210211+0000","last_became_peered":"2024-05-09T00:08:55.210211+0000","last_unstale":"2024-05-09T00:20:17.717261+0000","last_undegraded":"2024-05-09T00:20:17.717261+0000","last_fullsized":"2024-05-09T00:20:17.717261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3769","last_scrub_stamp":"2024-05-09T00:20:17.717034+0000","last_deep_scrub":"38'3769","last_deep_scrub_stamp":"2024-05-09T00:20:17.717034+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.717034+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:19.332633+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7,"num_write":55645,"num_write_kb":699546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"38'3742","reported_seq":3810,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:17.167884+0000","last_change":"2024-05-09T00:20:17.167954+0000","last_active":"2024-05-09T00:20:17.167884+0000","last_peered":"2024-05-09T00:20:17.167884+0000","last_clean":"2024-05-09T00:20:17.167884+0000","last_became_active":"2024-05-09T00:08:45.102160+0000","last_became_peered":"2024-05-09T00:08:45.102160+0000","last_unstale":"2024-05-09T00:20:17.167884+0000","last_undegraded":"2024-05-09T00:20:17.167884+0000","last_fullsized":"2024-05-09T00:20:17.167884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3742","last_scrub_stamp":"2024-05-09T00:20:17.167636+0000","last_deep_scrub":"38'3742","last_deep_scrub_stamp":"2024-05-09T00:20:17.167636+0000","last_clean_scrub_stamp":"2024-05-09T00:20:17.167636+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:46.018392+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":55258,"num_write_kb":668332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"38'3188","reported_seq":3252,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:24.915117+0000","last_change":"2024-05-09T00:20:24.915184+0000","last_active":"2024-05-09T00:20:24.915117+0000","last_peered":"2024-05-09T00:20:24.915117+0000","last_clean":"2024-05-09T00:20:24.915117+0000","last_became_active":"2024-05-09T00:08:55.216732+0000","last_became_peered":"2024-05-09T00:08:55.216732+0000","last_unstale":"2024-05-09T00:20:24.915117+0000","last_undegraded":"2024-05-09T00:20:24.915117+0000","last_fullsized":"2024-05-09T00:20:24.915117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3188","last_scrub_stamp":"2024-05-09T00:20:24.914892+0000","last_deep_scrub":"38'3188","last_deep_scrub_stamp":"2024-05-09T00:20:24.914892+0000","last_clean_scrub_stamp":"2024-05-09T00:20:24.914892+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:10.307312+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":47104,"num_write_kb":589873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"38'2889","reported_seq":2950,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:25.487331+0000","last_change":"2024-05-09T00:20:25.487400+0000","last_active":"2024-05-09T00:20:25.487331+0000","last_peered":"2024-05-09T00:20:25.487331+0000","last_clean":"2024-05-09T00:20:25.487331+0000","last_became_active":"2024-05-09T00:08:45.112264+0000","last_became_peered":"2024-05-09T00:08:45.112264+0000","last_unstale":"2024-05-09T00:20:25.487331+0000","last_undegraded":"2024-05-09T00:20:25.487331+0000","last_fullsized":"2024-05-09T00:20:25.487331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2889","last_scrub_stamp":"2024-05-09T00:20:25.487106+0000","last_deep_scrub":"38'2889","last_deep_scrub_stamp":"2024-05-09T00:20:25.487106+0000","last_clean_scrub_stamp":"2024-05-09T00:20:25.487106+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:58:47.722081+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":42948,"num_write_kb":549753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"38'4368","reported_seq":4435,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:34.482482+0000","last_change":"2024-05-09T00:20:34.482551+0000","last_active":"2024-05-09T00:20:34.482482+0000","last_peered":"2024-05-09T00:20:34.482482+0000","last_clean":"2024-05-09T00:20:34.482482+0000","last_became_active":"2024-05-09T00:08:55.209483+0000","last_became_peered":"2024-05-09T00:08:55.209483+0000","last_unstale":"2024-05-09T00:20:34.482482+0000","last_undegraded":"2024-05-09T00:20:34.482482+0000","last_fullsized":"2024-05-09T00:20:34.482482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4368","last_scrub_stamp":"2024-05-09T00:20:34.482247+0000","last_deep_scrub":"38'4368","last_deep_scrub_stamp":"2024-05-09T00:20:34.482247+0000","last_clean_scrub_stamp":"2024-05-09T00:20:34.482247+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:14.947291+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":64699,"num_write_kb":791644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"38'3241","reported_seq":3302,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.531883+0000","last_change":"2024-05-09T00:20:29.531954+0000","last_active":"2024-05-09T00:20:29.531883+0000","last_peered":"2024-05-09T00:20:29.531883+0000","last_clean":"2024-05-09T00:20:29.531883+0000","last_became_active":"2024-05-09T00:08:45.094638+0000","last_became_peered":"2024-05-09T00:08:45.094638+0000","last_unstale":"2024-05-09T00:20:29.531883+0000","last_undegraded":"2024-05-09T00:20:29.531883+0000","last_fullsized":"2024-05-09T00:20:29.531883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3241","last_scrub_stamp":"2024-05-09T00:20:29.531616+0000","last_deep_scrub":"38'3241","last_deep_scrub_stamp":"2024-05-09T00:20:29.531616+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.531616+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.306789+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":47841,"num_write_kb":582702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"38'3908","reported_seq":3982,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:14.365539+0000","last_change":"2024-05-09T00:20:14.365575+0000","last_active":"2024-05-09T00:20:14.365539+0000","last_peered":"2024-05-09T00:20:14.365539+0000","last_clean":"2024-05-09T00:20:14.365539+0000","last_became_active":"2024-05-09T00:08:55.199999+0000","last_became_peered":"2024-05-09T00:08:55.199999+0000","last_unstale":"2024-05-09T00:20:14.365539+0000","last_undegraded":"2024-05-09T00:20:14.365539+0000","last_fullsized":"2024-05-09T00:20:14.365539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3908","last_scrub_stamp":"2024-05-09T00:20:14.365386+0000","last_deep_scrub":"38'3908","last_deep_scrub_stamp":"2024-05-09T00:20:14.365386+0000","last_clean_scrub_stamp":"2024-05-09T00:20:14.365386+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:50.598170+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":58133,"num_write_kb":728914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"38'3816","reported_seq":3880,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:19.430771+0000","last_change":"2024-05-09T00:20:19.430842+0000","last_active":"2024-05-09T00:20:19.430771+0000","last_peered":"2024-05-09T00:20:19.430771+0000","last_clean":"2024-05-09T00:20:19.430771+0000","last_became_active":"2024-05-09T00:08:45.102048+0000","last_became_peered":"2024-05-09T00:08:45.102048+0000","last_unstale":"2024-05-09T00:20:19.430771+0000","last_undegraded":"2024-05-09T00:20:19.430771+0000","last_fullsized":"2024-05-09T00:20:19.430771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3816","last_scrub_stamp":"2024-05-09T00:20:19.430509+0000","last_deep_scrub":"38'3816","last_deep_scrub_stamp":"2024-05-09T00:20:19.430509+0000","last_clean_scrub_stamp":"2024-05-09T00:20:19.430509+0000","objects_scrubbed":0,"log_size":3816,"log_dups_size":0,"ondisk_log_size":3816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:18.387130+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":56666,"num_write_kb":741300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"38'3575","reported_seq":3634,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:29.463989+0000","last_change":"2024-05-09T00:20:29.464055+0000","last_active":"2024-05-09T00:20:29.463989+0000","last_peered":"2024-05-09T00:20:29.463989+0000","last_clean":"2024-05-09T00:20:29.463989+0000","last_became_active":"2024-05-09T00:08:55.214163+0000","last_became_peered":"2024-05-09T00:08:55.214163+0000","last_unstale":"2024-05-09T00:20:29.463989+0000","last_undegraded":"2024-05-09T00:20:29.463989+0000","last_fullsized":"2024-05-09T00:20:29.463989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3575","last_scrub_stamp":"2024-05-09T00:20:29.463758+0000","last_deep_scrub":"38'3575","last_deep_scrub_stamp":"2024-05-09T00:20:29.463758+0000","last_clean_scrub_stamp":"2024-05-09T00:20:29.463758+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:40:12.601299+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":52889,"num_write_kb":664811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"38'2753","reported_seq":2816,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-09T00:20:16.175735+0000","last_change":"2024-05-09T00:20:16.175790+0000","last_active":"2024-05-09T00:20:16.175735+0000","last_peered":"2024-05-09T00:20:16.175735+0000","last_clean":"2024-05-09T00:20:16.175735+0000","last_became_active":"2024-05-09T00:08:45.127025+0000","last_became_peered":"2024-05-09T00:08:45.127025+0000","last_unstale":"2024-05-09T00:20:16.175735+0000","last_undegraded":"2024-05-09T00:20:16.175735+0000","last_fullsized":"2024-05-09T00:20:16.175735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2753","last_scrub_stamp":"2024-05-09T00:20:16.175517+0000","last_deep_scrub":"38'2753","last_deep_scrub_stamp":"2024-05-09T00:20:16.175517+0000","last_clean_scrub_stamp":"2024-05-09T00:20:16.175517+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:12.764267+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":40609,"num_write_kb":513099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1156,"num_read_kb":11,"num_write":3472550,"num_write_kb":43957042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234380,"ondisk_log_size":234380,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":94516670,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":449,"num_read_kb":234536,"num_write":3119,"num_write_kb":94508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":189095936,"data_stored":189033340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3008,"ondisk_log_size":3008,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":0,"num_write":2947124,"num_write_kb":37270707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199144,"ondisk_log_size":199144,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93475205,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":515,"num_read_kb":184607,"num_write":3552,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187015168,"data_stored":186950410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3419,"ondisk_log_size":3419,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509589,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407236,"kb_used_data":29180,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93964604,"statfs":{"total":96636764160,"available":96219754496,"internally_reserved":0,"allocated":29880320,"data_stored":29641906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":387119562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509586,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":512232,"kb_used_data":34272,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93859608,"statfs":{"total":96636764160,"available":96112238592,"internally_reserved":0,"allocated":35094528,"data_stored":34859623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":489421254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509588,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533384,"kb_used_data":55424,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93838456,"statfs":{"total":96636764160,"available":96090578944,"internally_reserved":0,"allocated":56754176,"data_stored":56509593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509584,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":576580,"kb_used_data":72252,"kb_used_omap":1,"kb_used_meta":504318,"kb_avail":93795260,"statfs":{"total":96636764160,"available":96046346240,"internally_reserved":0,"allocated":73986048,"data_stored":73738590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":516422087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509581,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":611836,"kb_used_data":43572,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93760004,"statfs":{"total":96636764160,"available":96010244096,"internally_reserved":0,"allocated":44617728,"data_stored":44377810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":482412,"kb_used_data":50148,"kb_used_omap":1,"kb_used_meta":432254,"kb_avail":93889428,"statfs":{"total":96636764160,"available":96142774272,"internally_reserved":0,"allocated":51351552,"data_stored":51115708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":442628549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509582,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581804,"kb_used_data":37284,"kb_used_omap":1,"kb_used_meta":544510,"kb_avail":93790036,"statfs":{"total":96636764160,"available":96040996864,"internally_reserved":0,"allocated":38178816,"data_stored":37942434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":557578693},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542290,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589948,"kb_used_data":49588,"kb_used_omap":1,"kb_used_meta":540350,"kb_avail":93781892,"statfs":{"total":96636764160,"available":96032657408,"internally_reserved":0,"allocated":50778112,"data_stored":50527238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553318853},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37748792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12583584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37749318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12599296,"data_stored":12584256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30572544,"data_stored":30559267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13693879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12671116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31608832,"data_stored":31600674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35815424,"data_stored":35795720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25166406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:20:56.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T00:20:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.502+0000 7ff544c00640 1 Processor -- start 2024-05-09T00:20:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.502+0000 7ff544c00640 1 -- start start 2024-05-09T00:20:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff544c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff540072d50 0x7ff5400c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff544c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540072890 0x7ff540159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff544c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5400c4ca0 con 0x7ff540160600 2024-05-09T00:20:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff544c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff540160170 con 0x7ff540072d50 2024-05-09T00:20:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff544c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff54015a190 con 0x7ff540072890 2024-05-09T00:20:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff53de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff540072d50 0x7ff5400c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff53de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff540072d50 0x7ff5400c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38384/0 (socket says 172.21.15.114:38384) 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.504+0000 7ff53de00640 1 -- 172.21.15.114:0/3235393105 learned_addr learned my addr 172.21.15.114:0/3235393105 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.505+0000 7ff535400640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540072890 0x7ff540159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.505+0000 7ff53de00640 1 -- 172.21.15.114:0/3235393105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540072890 msgr2=0x7ff540159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.505+0000 7ff53de00640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540072890 0x7ff540159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.505+0000 7ff53de00640 1 -- 172.21.15.114:0/3235393105 >> v1:172.21.15.153:6789/0 conn(0x7ff540160600 legacy=0x7ff5400c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.505+0000 7ff53de00640 1 -- 172.21.15.114:0/3235393105 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54015fe20 con 0x7ff540072d50 2024-05-09T00:20:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.505+0000 7ff535400640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540072890 0x7ff540159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.506+0000 7ff53de00640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072d50 0x7ff5400c4760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff530009870 tx=0x7ff53002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6448758d111ad0de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.506+0000 7ff53d400640 1 -- 172.21.15.114:0/3235393105 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530037070 con 0x7ff540072d50 2024-05-09T00:20:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.506+0000 7ff53d400640 1 -- 172.21.15.114:0/3235393105 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff530032440 con 0x7ff540072d50 2024-05-09T00:20:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.506+0000 7ff53d400640 1 -- 172.21.15.114:0/3235393105 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530032810 con 0x7ff540072d50 2024-05-09T00:20:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.507+0000 7ff544c00640 1 -- 172.21.15.114:0/3235393105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072d50 msgr2=0x7ff5400c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.507+0000 7ff544c00640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072d50 0x7ff5400c4760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff530009870 tx=0x7ff53002a130 comp rx=0 tx=0).stop 2024-05-09T00:20:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.507+0000 7ff544c00640 1 -- 172.21.15.114:0/3235393105 shutdown_connections 2024-05-09T00:20:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.507+0000 7ff544c00640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540072890 0x7ff540159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.507+0000 7ff544c00640 1 --2- 172.21.15.114:0/3235393105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072d50 0x7ff5400c4760 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.507+0000 7ff544c00640 1 -- 172.21.15.114:0/3235393105 >> 172.21.15.114:0/3235393105 conn(0x7ff54006c680 msgr2=0x7ff54006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:56.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.508+0000 7ff544c00640 1 -- 172.21.15.114:0/3235393105 shutdown_connections 2024-05-09T00:20:56.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.508+0000 7ff544c00640 1 -- 172.21.15.114:0/3235393105 wait complete. 2024-05-09T00:20:56.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.510+0000 7ff544c00640 1 Processor -- start 2024-05-09T00:20:56.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.510+0000 7ff544c00640 1 -- start start 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.511+0000 7ff544c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 0x7ff5400c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.511+0000 7ff544c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff540072d50 0x7ff540157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.511+0000 7ff544c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540160600 0x7ff54014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.511+0000 7ff544c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5400c42e0 con 0x7ff540072890 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.511+0000 7ff544c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff54015d490 con 0x7ff540072d50 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.511+0000 7ff544c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff5400c6760 con 0x7ff540160600 2024-05-09T00:20:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 0x7ff5400c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 0x7ff5400c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38386/0 (socket says 172.21.15.114:38386) 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 -- 172.21.15.114:0/2570611238 learned_addr learned my addr 172.21.15.114:0/2570611238 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff535400640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff540072d50 0x7ff540157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 -- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540160600 msgr2=0x7ff54014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540160600 0x7ff54014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 -- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff540072d50 msgr2=0x7ff540157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff540072d50 0x7ff540157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 -- 172.21.15.114:0/2570611238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54015f460 con 0x7ff540072890 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.512+0000 7ff53de00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 0x7ff5400c8930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff530000c00 tx=0x7ff5300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.513+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530037040 con 0x7ff540072890 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.513+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff530042070 con 0x7ff540072890 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.513+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530030bb0 con 0x7ff540072890 2024-05-09T00:20:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.513+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5401f6d90 con 0x7ff540072890 2024-05-09T00:20:56.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.513+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5401583e0 con 0x7ff540072890 2024-05-09T00:20:56.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.514+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff540077430 con 0x7ff540072890 2024-05-09T00:20:56.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.515+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff530047460 con 0x7ff540072890 2024-05-09T00:20:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.516+0000 7ff536a00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff51c076300 0x7ff51c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.517+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7ff5300b8a20 con 0x7ff540072890 2024-05-09T00:20:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.517+0000 7ff535400640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff51c076300 0x7ff51c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.517+0000 7ff535400640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff51c076300 0x7ff51c078810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff54015b2d0 tx=0x7ff528008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.521+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5300815b0 con 0x7ff540072890 2024-05-09T00:20:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.729+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff540158d30 con 0x7ff540072890 2024-05-09T00:20:56.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.735+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7ff5300858b0 con 0x7ff540072890 2024-05-09T00:20:56.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.736+0000 7ff536a00640 1 -- 172.21.15.114:0/2570611238 <== mon.0 v2:172.21.15.114:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5300be080 con 0x7ff540072890 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff51c076300 msgr2=0x7ff51c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff51c076300 0x7ff51c078810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff54015b2d0 tx=0x7ff528008040 comp rx=0 tx=0).stop 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 msgr2=0x7ff5400c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 0x7ff5400c8930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff530000c00 tx=0x7ff5300046c0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 shutdown_connections 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff51c076300 0x7ff51c078810 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff540160600 0x7ff54014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff540072d50 0x7ff540157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 --2- 172.21.15.114:0/2570611238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff540072890 0x7ff5400c8930 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 >> 172.21.15.114:0/2570611238 conn(0x7ff54006c680 msgr2=0x7ff54015c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 shutdown_connections 2024-05-09T00:20:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:56.740+0000 7ff544c00640 1 -- 172.21.15.114:0/2570611238 wait complete. 2024-05-09T00:20:56.767 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-05-09T00:20:56.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:20:57.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.038+0000 7f78d2400640 1 Processor -- start 2024-05-09T00:20:57.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.038+0000 7f78d2400640 1 -- start start 2024-05-09T00:20:57.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.040+0000 7f78d2400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f78cc0aba00 0x7f78cc0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.040+0000 7f78d2400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78cc0ad340 con 0x7f78cc1566f0 2024-05-09T00:20:57.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.040+0000 7f78d2400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78cc155f10 con 0x7f78cc156b00 2024-05-09T00:20:57.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.040+0000 7f78d2400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f78cc156260 con 0x7f78cc0aba00 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.041+0000 7f78cbe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f78cc1566f0 0x7f78cc0ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48826/0 (socket says 172.21.15.114:48826) 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.041+0000 7f78cbe00640 1 -- 172.21.15.114:0/2776574141 learned_addr learned my addr 172.21.15.114:0/2776574141 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.041+0000 7f78d1000640 1 --2- 172.21.15.114:0/2776574141 >> v2:172.21.15.153:3300/0 conn(0x7f78cc0aba00 0x7f78cc0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.041+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314300919 0 0) 0x7f78cc0ad340 con 0x7f78cc1566f0 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.041+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b4003520 con 0x7f78cc1566f0 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.041+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 440276204 0 0) 0x7f78b4003520 con 0x7f78cc1566f0 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 >> v2:172.21.15.153:3300/0 conn(0x7f78cc0aba00 msgr2=0x7f78cc0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 --2- 172.21.15.114:0/2776574141 >> v2:172.21.15.153:3300/0 conn(0x7f78cc0aba00 0x7f78cc0accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 >> v1:172.21.15.153:6789/0 conn(0x7f78cc156b00 legacy=0x7f78cc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc0c4f40 con 0x7f78cc1566f0 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7f78b80016f0 con 0x7f78cc1566f0 2024-05-09T00:20:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 >> v1:172.21.15.114:6789/0 conn(0x7f78cc1566f0 legacy=0x7f78cc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b4003a50 0x7f78b4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4004800 0x7f78b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4005250 0x7f78b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc156260 con 0x7f78b4004800 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78b400c1e0 con 0x7f78b4003a50 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78b400c3e0 con 0x7f78b4005250 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cbe00640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4004800 0x7f78b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78d1000640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b4003a50 0x7f78b4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cbe00640 1 -- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4005250 msgr2=0x7f78b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cbe00640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4005250 0x7f78b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cbe00640 1 -- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b4003a50 msgr2=0x7f78b4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.042+0000 7f78cbe00640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b4003a50 0x7f78b4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.043+0000 7f78cbe00640 1 -- 172.21.15.114:0/2776574141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b4003520 con 0x7f78b4004800 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.043+0000 7f78d1a00640 1 -- 172.21.15.114:0/2776574141 reap_dead start 2024-05-09T00:20:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.043+0000 7f78d1000640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b4003a50 0x7f78b4003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:57.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.044+0000 7f78cbe00640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4004800 0x7f78b4004c10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c210 tx=0x7f78b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4919767f29008f4a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:57.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.044+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007d60 con 0x7f78b4004800 2024-05-09T00:20:57.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.044+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f78b8005ad0 con 0x7f78b4004800 2024-05-09T00:20:57.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.044+0000 7f78cb400640 1 -- 172.21.15.114:0/2776574141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007070 con 0x7f78b4004800 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 -- 172.21.15.114:0/2776574141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4004800 msgr2=0x7f78b4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4004800 0x7f78b4004c10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c210 tx=0x7f78b4005830 comp rx=0 tx=0).stop 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 -- 172.21.15.114:0/2776574141 shutdown_connections 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 --2- 172.21.15.114:0/2776574141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4004800 0x7f78b4004c10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 -- 172.21.15.114:0/2776574141 >> 172.21.15.114:0/2776574141 conn(0x7f78cc0c9730 msgr2=0x7f78cc0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 -- 172.21.15.114:0/2776574141 shutdown_connections 2024-05-09T00:20:57.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.045+0000 7f78d2400640 1 -- 172.21.15.114:0/2776574141 wait complete. 2024-05-09T00:20:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.047+0000 7f78d2400640 1 Processor -- start 2024-05-09T00:20:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.047+0000 7f78d2400640 1 -- start start 2024-05-09T00:20:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.048+0000 7f78d2400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4004800 0x7f78cc0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d2400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 0x7f78cc159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d2400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78cc1f1950 0x7f78cc1f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d2400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc13e830 con 0x7f78cc1df980 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d2400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc0c4920 con 0x7f78cc1f1950 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d2400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78cc13e9b0 con 0x7f78b4004800 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 0x7f78cc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 0x7f78cc159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38404/0 (socket says 172.21.15.114:38404) 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 -- 172.21.15.114:0/4235557387 learned_addr learned my addr 172.21.15.114:0/4235557387 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d1000640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4004800 0x7f78cc0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d1a00640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78cc1f1950 0x7f78cc1f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 -- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4004800 msgr2=0x7f78cc0c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4004800 0x7f78cc0c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 -- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78cc1f1950 msgr2=0x7f78cc1f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78cc1f1950 0x7f78cc1f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78cbe00640 1 -- 172.21.15.114:0/4235557387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc159650 con 0x7f78cc1df980 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.049+0000 7f78d1a00640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78cc1f1950 0x7f78cc1f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.050+0000 7f78cbe00640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 0x7f78cc159110 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f78b802ada0 tx=0x7f78cc0c5110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.050+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8042070 con 0x7f78cc1df980 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.050+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f78b80047e0 con 0x7f78cc1df980 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.050+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8037040 con 0x7f78cc1df980 2024-05-09T00:20:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.050+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc159ec0 con 0x7f78cc1df980 2024-05-09T00:20:57.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.050+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc1f2610 con 0x7f78cc1df980 2024-05-09T00:20:57.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.051+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78cc078430 con 0x7f78cc1df980 2024-05-09T00:20:57.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.052+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f78b8004bd0 con 0x7f78cc1df980 2024-05-09T00:20:57.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.053+0000 7f78c8c00640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f78ac0762d0 0x7f78ac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.054+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7f78b80b75b0 con 0x7f78cc1df980 2024-05-09T00:20:57.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.054+0000 7f78d1000640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f78ac0762d0 0x7f78ac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.054+0000 7f78d1000640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f78ac0762d0 0x7f78ac0787e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f78cc06b240 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:57.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.058+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f78b80805f0 con 0x7f78cc1df980 2024-05-09T00:20:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.301+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78cc1f23a0 con 0x7f78cc1df980 2024-05-09T00:20:57.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.302+0000 7f78c8c00640 1 -- 172.21.15.114:0/4235557387 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+6503 (secure 0 0 0) 0x7f78b807fef0 con 0x7f78cc1df980 2024-05-09T00:20:57.303 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:20:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 66 2024-05-09T00:20:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f78ac0762d0 msgr2=0x7f78ac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f78ac0762d0 0x7f78ac0787e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f78cc06b240 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 msgr2=0x7f78cc159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 0x7f78cc159110 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f78b802ada0 tx=0x7f78cc0c5110 comp rx=0 tx=0).stop 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 shutdown_connections 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f78ac0762d0 0x7f78ac0787e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78cc1f1950 0x7f78cc1f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78cc1df980 0x7f78cc159110 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 --2- 172.21.15.114:0/4235557387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78b4004800 0x7f78cc0c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 >> 172.21.15.114:0/4235557387 conn(0x7f78cc0c9730 msgr2=0x7f78cc0c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 shutdown_connections 2024-05-09T00:20:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.305+0000 7f78d2400640 1 -- 172.21.15.114:0/4235557387 wait complete. 2024-05-09T00:20:57.332 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:20:57.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.597+0000 7fc4bdc00640 1 Processor -- start 2024-05-09T00:20:57.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.597+0000 7fc4bdc00640 1 -- start start 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 0x7fc4b806c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bdc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4b806cbc0 0x7fc4b81580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bdc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80c4380 con 0x7fc4b8155820 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bdc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b80c5c20 con 0x7fc4b806cbc0 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80c35c0 con 0x7fc4b80740b0 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bd200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4b8155820 0x7fc4b8158620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48838/0 (socket says 172.21.15.114:48838) 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.599+0000 7fc4bd200640 1 -- 172.21.15.114:0/1683570916 learned_addr learned my addr 172.21.15.114:0/1683570916 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 0x7fc4b806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b7400640 1 --2- 172.21.15.114:0/1683570916 >> v2:172.21.15.153:3300/0 conn(0x7fc4b806cbc0 0x7fc4b81580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174306453 0 0) 0x7fc4b0001110 con 0x7fc4b8155820 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc498003520 con 0x7fc4b8155820 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 55019856 0 0) 0x7fc498003520 con 0x7fc4b8155820 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 msgr2=0x7fc4b806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 0x7fc4b806c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 >> v2:172.21.15.153:3300/0 conn(0x7fc4b806cbc0 msgr2=0x7fc4b81580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 --2- 172.21.15.114:0/1683570916 >> v2:172.21.15.153:3300/0 conn(0x7fc4b806cbc0 0x7fc4b81580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b80c38a0 con 0x7fc4b8155820 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fc4b00018c0 con 0x7fc4b8155820 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 >> v1:172.21.15.114:6789/0 conn(0x7fc4b8155820 legacy=0x7fc4b8158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc498003a00 0x7fc498003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.600+0000 7fc4b6a00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc498004800 0x7fc498004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b6a00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 0x7fc498005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80c5c20 con 0x7fc498003a00 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80c35c0 con 0x7fc498004800 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc49800ba70 con 0x7fc4b80740b0 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc498003a00 0x7fc498003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7e00640 1 -- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 msgr2=0x7fc498005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7400640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc498004800 0x7fc498004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80740b0 0x7fc498005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7e00640 1 -- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc498004800 msgr2=0x7fc498004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc498004800 0x7fc498004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7e00640 1 -- 172.21.15.114:0/1683570916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc498003520 con 0x7fc498003a00 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.601+0000 7fc4b7400640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc498004800 0x7fc498004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.602+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc498003a00 0x7fc498003e70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009a90 tx=0x7fc498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf76e334cea5319e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8036070 con 0x7fc498003a00 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc4a8031400 con 0x7fc498003a00 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4b6a00640 1 -- 172.21.15.114:0/1683570916 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8009690 con 0x7fc498003a00 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4bdc00640 1 -- 172.21.15.114:0/1683570916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc498003a00 msgr2=0x7fc498003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/1683570916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc498003a00 0x7fc498003e70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009a90 tx=0x7fc498005830 comp rx=0 tx=0).stop 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4bd200640 1 -- 172.21.15.114:0/1683570916 reap_dead start 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4bdc00640 1 -- 172.21.15.114:0/1683570916 shutdown_connections 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4bdc00640 1 -- 172.21.15.114:0/1683570916 >> 172.21.15.114:0/1683570916 conn(0x7fc4b80c9e40 msgr2=0x7fc4b80ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.603+0000 7fc4bdc00640 1 -- 172.21.15.114:0/1683570916 shutdown_connections 2024-05-09T00:20:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.604+0000 7fc4bdc00640 1 -- 172.21.15.114:0/1683570916 wait complete. 2024-05-09T00:20:57.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.606+0000 7fc4bdc00640 1 Processor -- start 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.606+0000 7fc4bdc00640 1 -- start start 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498003a00 0x7fc4b81eee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 0x7fc4b815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b815a6a0 0x7fc4b81eba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8074cb0 con 0x7fc4b815abe0 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80c3e60 con 0x7fc4b815a6a0 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b8073100 con 0x7fc498003a00 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.607+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 0x7fc4b815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 0x7fc4b815a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38426/0 (socket says 172.21.15.114:38426) 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 -- 172.21.15.114:0/4104177510 learned_addr learned my addr 172.21.15.114:0/4104177510 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498003a00 0x7fc4b81eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4bd200640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b815a6a0 0x7fc4b81eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 -- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498003a00 msgr2=0x7fc4b81eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498003a00 0x7fc4b81eee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 -- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b815a6a0 msgr2=0x7fc4b81eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b815a6a0 0x7fc4b81eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 -- 172.21.15.114:0/4104177510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b815bfa0 con 0x7fc4b815abe0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4bd200640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b815a6a0 0x7fc4b81eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.608+0000 7fc4b7400640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 0x7fc4b815a160 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000f430 tx=0x7fc4a000f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.609+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0003990 con 0x7fc4b815abe0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.609+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc4a0003b30 con 0x7fc4b815abe0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.609+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b815c280 con 0x7fc4b815abe0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.609+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0004020 con 0x7fc4b815abe0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.609+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b8159560 con 0x7fc4b815abe0 2024-05-09T00:20:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.610+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b815b2f0 con 0x7fc4b815abe0 2024-05-09T00:20:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.611+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc4a0005d10 con 0x7fc4b815abe0 2024-05-09T00:20:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.612+0000 7fc4afe00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc494076300 0x7fc494078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.612+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fc4a00988b0 con 0x7fc4b815abe0 2024-05-09T00:20:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.612+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc494076300 0x7fc494078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:57.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.613+0000 7fc4b7e00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc494076300 0x7fc494078810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009a90 tx=0x7fc4a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:57.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.617+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc4a0024020 con 0x7fc4b815abe0 2024-05-09T00:20:57.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.861+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4b815bd90 con 0x7fc4b815abe0 2024-05-09T00:20:57.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.862+0000 7fc4afe00640 1 -- 172.21.15.114:0/4104177510 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+6503 (secure 0 0 0) 0x7fc4a00613b0 con 0x7fc4b815abe0 2024-05-09T00:20:57.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:44.610847+0000","modified":"2024-05-09T00:18:52.267982+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":20,"addr":"172.21.15.114:6837/2437507270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2437507270},{"type":"v1","addr":"172.21.15.114:6837","nonce":2437507270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5406,"qdb_cluster":[5406]},"id":1},{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:20:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 66 2024-05-09T00:20:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc494076300 msgr2=0x7fc494078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc494076300 0x7fc494078810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009a90 tx=0x7fc4a8008030 comp rx=0 tx=0).stop 2024-05-09T00:20:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 msgr2=0x7fc4b815a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 0x7fc4b815a160 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000f430 tx=0x7fc4a000f8f0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 shutdown_connections 2024-05-09T00:20:57.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc494076300 0x7fc494078810 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b815a6a0 0x7fc4b81eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4b815abe0 0x7fc4b815a160 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 --2- 172.21.15.114:0/4104177510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498003a00 0x7fc4b81eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:57.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 >> 172.21.15.114:0/4104177510 conn(0x7fc4b80c9e40 msgr2=0x7fc4b80c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:57.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 shutdown_connections 2024-05-09T00:20:57.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:57.865+0000 7fc4bdc00640 1 -- 172.21.15.114:0/4104177510 wait complete. 2024-05-09T00:20:57.894 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:20:58.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.141+0000 7fbf31400640 1 Processor -- start 2024-05-09T00:20:58.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.141+0000 7fbf31400640 1 -- start start 2024-05-09T00:20:58.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf31400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf2c0aba00 0x7fbf2c0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf31400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 0x7fbf2c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf31400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2c0ad340 con 0x7fbf2c1566f0 2024-05-09T00:20:58.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf31400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c156260 con 0x7fbf2c0aba00 2024-05-09T00:20:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf31400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c155f10 con 0x7fbf2c156b00 2024-05-09T00:20:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf23e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbf2c1566f0 0x7fbf2c0ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37374/0 (socket says 172.21.15.114:37374) 2024-05-09T00:20:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.143+0000 7fbf23e00640 1 -- 172.21.15.114:0/209528691 learned_addr learned my addr 172.21.15.114:0/209528691 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2be00640 1 --2- 172.21.15.114:0/209528691 >> v2:172.21.15.153:3300/0 conn(0x7fbf2c0aba00 0x7fbf2c0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf30a00640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 0x7fbf2c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469154641 0 0) 0x7fbf2c0ad340 con 0x7fbf2c1566f0 2024-05-09T00:20:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf10003520 con 0x7fbf2c1566f0 2024-05-09T00:20:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3651738255 0 0) 0x7fbf10003520 con 0x7fbf2c1566f0 2024-05-09T00:20:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 msgr2=0x7fbf2c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 0x7fbf2c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 >> v2:172.21.15.153:3300/0 conn(0x7fbf2c0aba00 msgr2=0x7fbf2c0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 --2- 172.21.15.114:0/209528691 >> v2:172.21.15.153:3300/0 conn(0x7fbf2c0aba00 0x7fbf2c0accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c0c4f40 con 0x7fbf2c1566f0 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fbf140016f0 con 0x7fbf2c1566f0 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 >> v1:172.21.15.114:6789/0 conn(0x7fbf2c1566f0 legacy=0x7fbf2c0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 0x7fbf10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf10004d40 0x7fbf10005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c156260 con 0x7fbf10003a00 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c155f10 con 0x7fbf10004d40 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1000ba70 con 0x7fbf2c156b00 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.144+0000 7fbf2be00640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.145+0000 7fbf2be00640 1 -- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 msgr2=0x7fbf10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.145+0000 7fbf2be00640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c156b00 0x7fbf10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.145+0000 7fbf2be00640 1 -- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf10004d40 msgr2=0x7fbf10005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.145+0000 7fbf2be00640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf10004d40 0x7fbf10005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.145+0000 7fbf2be00640 1 -- 172.21.15.114:0/209528691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf10003520 con 0x7fbf10003a00 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.146+0000 7fbf2be00640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf10003e70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c071ba0 tx=0x7fbf10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98fcd1c19895936 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.146+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c036070 con 0x7fbf10003a00 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.146+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbf1c031400 con 0x7fbf10003a00 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.146+0000 7fbf2b400640 1 -- 172.21.15.114:0/209528691 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c009690 con 0x7fbf10003a00 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf31400640 1 -- 172.21.15.114:0/209528691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 msgr2=0x7fbf10003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf31400640 1 --2- 172.21.15.114:0/209528691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf10003e70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c071ba0 tx=0x7fbf10005830 comp rx=0 tx=0).stop 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf30a00640 1 -- 172.21.15.114:0/209528691 reap_dead start 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf31400640 1 -- 172.21.15.114:0/209528691 shutdown_connections 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf31400640 1 -- 172.21.15.114:0/209528691 >> 172.21.15.114:0/209528691 conn(0x7fbf2c0c9730 msgr2=0x7fbf2c0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf31400640 1 -- 172.21.15.114:0/209528691 shutdown_connections 2024-05-09T00:20:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.147+0000 7fbf31400640 1 -- 172.21.15.114:0/209528691 wait complete. 2024-05-09T00:20:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.149+0000 7fbf31400640 1 Processor -- start 2024-05-09T00:20:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.149+0000 7fbf31400640 1 -- start start 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.150+0000 7fbf31400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf2c0c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf31400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c158730 0x7fbf2c158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf31400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf2c1527e0 0x7fbf2c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf31400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c13e830 con 0x7fbf10003a00 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf31400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c0c4920 con 0x7fbf2c1527e0 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf31400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c13e9b0 con 0x7fbf2c158730 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf2c0c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf2c0c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54526/0 (socket says 172.21.15.114:54526) 2024-05-09T00:20:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 -- 172.21.15.114:0/2730977850 learned_addr learned my addr 172.21.15.114:0/2730977850 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 -- 172.21.15.114:0/2730977850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c158730 msgr2=0x7fbf2c158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c158730 0x7fbf2c158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 -- 172.21.15.114:0/2730977850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf2c1527e0 msgr2=0x7fbf2c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf2c1527e0 0x7fbf2c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 -- 172.21.15.114:0/2730977850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c1eea70 con 0x7fbf10003a00 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.151+0000 7fbf2be00640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf2c0c29b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c034040 tx=0x7fbf1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.152+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c040020 con 0x7fbf10003a00 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.152+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbf1c03b6a0 con 0x7fbf10003a00 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.152+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c036040 con 0x7fbf10003a00 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.152+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c159910 con 0x7fbf10003a00 2024-05-09T00:20:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.152+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c153130 con 0x7fbf10003a00 2024-05-09T00:20:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.153+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c078430 con 0x7fbf10003a00 2024-05-09T00:20:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.154+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf1c043020 con 0x7fbf10003a00 2024-05-09T00:20:58.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.155+0000 7fbf28c00640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf080762d0 0x7fbf080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.155+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fbf1c0b8660 con 0x7fbf10003a00 2024-05-09T00:20:58.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.155+0000 7fbf23e00640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf080762d0 0x7fbf080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.156+0000 7fbf23e00640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf080762d0 0x7fbf080787e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbf14001eb0 tx=0x7fbf140015f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:58.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.160+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf1c04a030 con 0x7fbf10003a00 2024-05-09T00:20:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.350+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf2c0c4b80 con 0x7fbf10003a00 2024-05-09T00:20:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.354+0000 7fbf28c00640 1 -- 172.21.15.114:0/2730977850 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+22077 (secure 0 0 0) 0x7fbf1c081720 con 0x7fbf10003a00 2024-05-09T00:20:58.355 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:20:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:18:35.026013+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T00:08:42.283655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T00:08:43.588739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6836/2312453128":"2024-05-10T00:18:35.025950+0000","172.21.15.114:6834/2312453128":"2024-05-10T00:18:35.025950+0000","172.21.15.114:6835/372512194":"2024-05-10T00:17:25.004758+0000","172.21.15.114:6834/281438172":"2024-05-10T00:16:34.973324+0000","172.21.15.153:6835/4100525107":"2024-05-10T00:15:44.956406+0000","172.21.15.153:6835/1232162808":"2024-05-10T00:18:25.023032+0000","172.21.15.153:6834/3829412957":"2024-05-10T00:11:14.866186+0000","172.21.15.114:6836/1891949153":"2024-05-10T00:15:04.943103+0000","172.21.15.114:6836/281438172":"2024-05-10T00:16:34.973324+0000","172.21.15.153:6835/3829412957":"2024-05-10T00:11:14.866186+0000","172.21.15.114:6836/1498992114":"2024-05-10T00:11:24.870997+0000","172.21.15.114:6835/2960717153":"2024-05-10T00:14:19.928294+0000","172.21.15.114:6834/1498992114":"2024-05-10T00:11:24.870997+0000","172.21.15.153:6834/1585617173":"2024-05-10T00:13:34.914248+0000","172.21.15.153:6834/1232162808":"2024-05-10T00:18:25.023032+0000","172.21.15.153:6835/1585617173":"2024-05-10T00:13:34.914248+0000","172.21.15.153:6833/690310809":"2024-05-10T00:13:34.914171+0000","172.21.15.114:6834/1891949153":"2024-05-10T00:15:04.943103+0000","172.21.15.153:6832/690310809":"2024-05-10T00:13:34.914171+0000","172.21.15.114:6837/2960717153":"2024-05-10T00:14:19.928294+0000","172.21.15.114:6837/372512194":"2024-05-10T00:17:25.004758+0000","172.21.15.153:6834/4100525107":"2024-05-10T00:15:44.956406+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:20:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf080762d0 msgr2=0x7fbf080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf080762d0 0x7fbf080787e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbf14001eb0 tx=0x7fbf140015f0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 msgr2=0x7fbf2c0c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf2c0c29b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c034040 tx=0x7fbf1c004730 comp rx=0 tx=0).stop 2024-05-09T00:20:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 shutdown_connections 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fbf080762d0 0x7fbf080787e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf2c1527e0 0x7fbf2c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf2c158730 0x7fbf2c158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 --2- 172.21.15.114:0/2730977850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf10003a00 0x7fbf2c0c29b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.357+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 >> 172.21.15.114:0/2730977850 conn(0x7fbf2c0c9730 msgr2=0x7fbf2c13eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.358+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 shutdown_connections 2024-05-09T00:20:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.358+0000 7fbf31400640 1 -- 172.21.15.114:0/2730977850 wait complete. 2024-05-09T00:20:58.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-05-09T00:20:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.647+0000 7fc41be00640 1 Processor -- start 2024-05-09T00:20:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.647+0000 7fc41be00640 1 -- start start 2024-05-09T00:20:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc41c13f360 0x7fc41c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 0x7fc41c0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41be00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41c06f490 con 0x7fc41c1567d0 2024-05-09T00:20:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41be00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc41c0ad260 con 0x7fc41c13f360 2024-05-09T00:20:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c06f920 con 0x7fc41c0af270 2024-05-09T00:20:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc41c1567d0 0x7fc41c0c4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37386/0 (socket says 172.21.15.114:37386) 2024-05-09T00:20:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41b400640 1 -- 172.21.15.114:0/475936083 learned_addr learned my addr 172.21.15.114:0/475936083 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41aa00640 1 --2- 172.21.15.114:0/475936083 >> v2:172.21.15.153:3300/0 conn(0x7fc41c13f360 0x7fc41c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.649+0000 7fc41a000640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 0x7fc41c0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432235755 0 0) 0x7fc41c06f490 con 0x7fc41c1567d0 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc400003520 con 0x7fc41c1567d0 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4249027445 0 0) 0x7fc400003520 con 0x7fc41c1567d0 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 msgr2=0x7fc41c0acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 0x7fc41c0acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 >> v2:172.21.15.153:3300/0 conn(0x7fc41c13f360 msgr2=0x7fc41c06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 --2- 172.21.15.114:0/475936083 >> v2:172.21.15.153:3300/0 conn(0x7fc41c13f360 0x7fc41c06e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c06fc00 con 0x7fc41c1567d0 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 473247238 0 0) 0x7fc414001a70 con 0x7fc41c1567d0 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 >> v1:172.21.15.114:6789/0 conn(0x7fc41c1567d0 legacy=0x7fc41c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc400003a00 0x7fc400003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 0x7fc400004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc400004d40 0x7fc400005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0ad260 con 0x7fc400003a00 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c06f920 con 0x7fc400004d40 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.650+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc40000ff00 con 0x7fc41c0af270 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41aa00640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc400003a00 0x7fc400003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41a000640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 0x7fc400004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41b400640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc400004d40 0x7fc400005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41aa00640 1 -- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 msgr2=0x7fc400004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41aa00640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc41c0af270 0x7fc400004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41aa00640 1 -- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc400004d40 msgr2=0x7fc400005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:20:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41aa00640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc400004d40 0x7fc400005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41aa00640 1 -- 172.21.15.114:0/475936083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc400003520 con 0x7fc400003a00 2024-05-09T00:20:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.651+0000 7fc41b400640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc400004d40 0x7fc400005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.653+0000 7fc41aa00640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc400003a00 0x7fc400003e70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009a90 tx=0x7fc400005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3a00945513eff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.653+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c036070 con 0x7fc400003a00 2024-05-09T00:20:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.653+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc40c031400 con 0x7fc400003a00 2024-05-09T00:20:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.653+0000 7fc419600640 1 -- 172.21.15.114:0/475936083 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c009690 con 0x7fc400003a00 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41be00640 1 -- 172.21.15.114:0/475936083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc400003a00 msgr2=0x7fc400003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41be00640 1 --2- 172.21.15.114:0/475936083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc400003a00 0x7fc400003e70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009a90 tx=0x7fc400005830 comp rx=0 tx=0).stop 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41b400640 1 -- 172.21.15.114:0/475936083 reap_dead start 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41be00640 1 -- 172.21.15.114:0/475936083 shutdown_connections 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41be00640 1 -- 172.21.15.114:0/475936083 >> 172.21.15.114:0/475936083 conn(0x7fc41c0c5ea0 msgr2=0x7fc41c0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41be00640 1 -- 172.21.15.114:0/475936083 shutdown_connections 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.654+0000 7fc41be00640 1 -- 172.21.15.114:0/475936083 wait complete. 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.656+0000 7fc41be00640 1 Processor -- start 2024-05-09T00:20:58.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.656+0000 7fc41be00640 1 -- start start 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.657+0000 7fc41be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc400003a00 0x7fc41c134b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.657+0000 7fc41be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc41c0c6f40 0x7fc41c136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 0x7fc41c137080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0c54c0 con 0x7fc41c132d20 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c06fee0 con 0x7fc41c0c6f40 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c0c5640 con 0x7fc400003a00 2024-05-09T00:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 0x7fc41c137080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 0x7fc41c137080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54532/0 (socket says 172.21.15.114:54532) 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 -- 172.21.15.114:0/3829830616 learned_addr learned my addr 172.21.15.114:0/3829830616 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41a000640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc41c0c6f40 0x7fc41c136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 -- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc400003a00 msgr2=0x7fc41c134b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc400003a00 0x7fc41c134b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 -- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc41c0c6f40 msgr2=0x7fc41c136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc41c0c6f40 0x7fc41c136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41b400640 1 -- 172.21.15.114:0/3829830616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c1350d0 con 0x7fc41c132d20 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.658+0000 7fc41a000640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc41c0c6f40 0x7fc41c136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.659+0000 7fc41b400640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 0x7fc41c137080 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0acc50 tx=0x7fc41400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.659+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414004d60 con 0x7fc41c132d20 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.659+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc41400bb20 con 0x7fc41c132d20 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.659+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414007070 con 0x7fc41c132d20 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.659+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c1385d0 con 0x7fc41c132d20 2024-05-09T00:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.659+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c073d90 con 0x7fc41c132d20 2024-05-09T00:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.660+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41c078430 con 0x7fc41c132d20 2024-05-09T00:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.662+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc41401b020 con 0x7fc41c132d20 2024-05-09T00:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.663+0000 7fc412a00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc3fc076300 0x7fc3fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.663+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7612+0+0 (secure 0 0 0) 0x7fc414097fd0 con 0x7fc41c132d20 2024-05-09T00:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.663+0000 7fc41aa00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc3fc076300 0x7fc3fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:58.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.664+0000 7fc41aa00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc3fc076300 0x7fc3fc078810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc40c033000 tx=0x7fc40c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:58.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.668+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc414061090 con 0x7fc41c132d20 2024-05-09T00:20:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.914+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7fc41c06f660 con 0x7fc41c132d20 2024-05-09T00:20:58.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.921+0000 7fc412a00640 1 -- 172.21.15.114:0/3829830616 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) ==== 151+0+0 (secure 0 0 0) 0x7fc414060990 con 0x7fc41c132d20 2024-05-09T00:20:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T00:20:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc3fc076300 msgr2=0x7fc3fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc3fc076300 0x7fc3fc078810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc40c033000 tx=0x7fc40c02e000 comp rx=0 tx=0).stop 2024-05-09T00:20:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 msgr2=0x7fc41c137080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 0x7fc41c137080 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0acc50 tx=0x7fc41400b4a0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 shutdown_connections 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc3fc076300 0x7fc3fc078810 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc41c132d20 0x7fc41c137080 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc41c0c6f40 0x7fc41c136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 --2- 172.21.15.114:0/3829830616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc400003a00 0x7fc41c134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.925+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 >> 172.21.15.114:0/3829830616 conn(0x7fc41c0c5ea0 msgr2=0x7fc41c06e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:58.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.926+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 shutdown_connections 2024-05-09T00:20:58.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:58.927+0000 7fc41be00640 1 -- 172.21.15.114:0/3829830616 wait complete. 2024-05-09T00:20:58.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-05-09T00:20:59.089 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-05-09T00:20:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.230+0000 7f1a7c000640 1 Processor -- start 2024-05-09T00:20:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.230+0000 7f1a7c000640 1 -- start start 2024-05-09T00:20:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.232+0000 7f1a7c000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a741585c0 0x7f1a741589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.232+0000 7f1a7c000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a74074040 con 0x7f1a74073800 2024-05-09T00:20:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.232+0000 7f1a7c000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a740c58f0 con 0x7f1a74072720 2024-05-09T00:20:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.232+0000 7f1a7c000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1a74073df0 con 0x7f1a741585c0 2024-05-09T00:20:59.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.232+0000 7f1a79600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1a74073800 0x7f1a740c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37392/0 (socket says 172.21.15.114:37392) 2024-05-09T00:20:59.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.232+0000 7f1a79600640 1 -- 172.21.15.114:0/1307981588 learned_addr learned my addr 172.21.15.114:0/1307981588 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:20:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.233+0000 7f1a7a000640 1 --2- 172.21.15.114:0/1307981588 >> v2:172.21.15.114:3300/0 conn(0x7f1a741585c0 0x7f1a741589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.233+0000 7f1a73e00640 1 -- 172.21.15.114:0/1307981588 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116021307 0 0) 0x7f1a74074040 con 0x7f1a74073800 2024-05-09T00:20:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.233+0000 7f1a73e00640 1 -- 172.21.15.114:0/1307981588 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a5c003520 con 0x7f1a74073800 2024-05-09T00:20:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.233+0000 7f1a7a000640 1 -- 172.21.15.114:0/1307981588 >> v1:172.21.15.153:6789/0 conn(0x7f1a74072720 legacy=0x7f1a740c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.233+0000 7f1a7a000640 1 -- 172.21.15.114:0/1307981588 >> v1:172.21.15.114:6789/0 conn(0x7f1a74073800 legacy=0x7f1a740c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.233+0000 7f1a7a000640 1 -- 172.21.15.114:0/1307981588 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a740c5bd0 con 0x7f1a741585c0 2024-05-09T00:20:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.234+0000 7f1a7a000640 1 --2- 172.21.15.114:0/1307981588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a741585c0 0x7f1a741589d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009d90 tx=0x7f1a6c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1673a3cfaa4122cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a73e00640 1 -- 172.21.15.114:0/1307981588 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c007740 con 0x7f1a741585c0 2024-05-09T00:20:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a73e00640 1 -- 172.21.15.114:0/1307981588 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1a6c0078e0 con 0x7f1a741585c0 2024-05-09T00:20:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a73e00640 1 -- 172.21.15.114:0/1307981588 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c007c90 con 0x7f1a741585c0 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a7c000640 1 -- 172.21.15.114:0/1307981588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a741585c0 msgr2=0x7f1a741589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1307981588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a741585c0 0x7f1a741589d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009d90 tx=0x7f1a6c02a6f0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a7c000640 1 -- 172.21.15.114:0/1307981588 shutdown_connections 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1307981588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a741585c0 0x7f1a741589d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.235+0000 7f1a7c000640 1 -- 172.21.15.114:0/1307981588 >> 172.21.15.114:0/1307981588 conn(0x7f1a7406c680 msgr2=0x7f1a7406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.236+0000 7f1a7c000640 1 -- 172.21.15.114:0/1307981588 shutdown_connections 2024-05-09T00:20:59.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.236+0000 7f1a7c000640 1 -- 172.21.15.114:0/1307981588 wait complete. 2024-05-09T00:20:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.238+0000 7f1a7c000640 1 Processor -- start 2024-05-09T00:20:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.238+0000 7f1a7c000640 1 -- start start 2024-05-09T00:20:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.239+0000 7f1a7c000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a74072720 0x7f1a74148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.239+0000 7f1a7c000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 0x7f1a741e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.239+0000 7f1a7c000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a741585c0 0x7f1a741f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.239+0000 7f1a7c000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74074320 con 0x7f1a74073800 2024-05-09T00:20:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.239+0000 7f1a7c000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a740c5f40 con 0x7f1a74072720 2024-05-09T00:20:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.239+0000 7f1a7c000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a74149920 con 0x7f1a741585c0 2024-05-09T00:20:59.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 0x7f1a741e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:59.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 0x7f1a741e2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54576/0 (socket says 172.21.15.114:54576) 2024-05-09T00:20:59.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 -- 172.21.15.114:0/1486658423 learned_addr learned my addr 172.21.15.114:0/1486658423 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:20:59.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a79600640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a74072720 0x7f1a74148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a7a000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a741585c0 0x7f1a741f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 -- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a741585c0 msgr2=0x7f1a741f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a741585c0 0x7f1a741f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 -- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a74072720 msgr2=0x7f1a74148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a74072720 0x7f1a74148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a78c00640 1 -- 172.21.15.114:0/1486658423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a740c98e0 con 0x7f1a74073800 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.240+0000 7f1a7a000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a741585c0 0x7f1a741f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.241+0000 7f1a78c00640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 0x7f1a741e2dd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c3d0 tx=0x7f1a6000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.241+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60017070 con 0x7f1a74073800 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.241+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1a600052d0 con 0x7f1a74073800 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.241+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a741eedb0 con 0x7f1a74073800 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.241+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60003850 con 0x7f1a74073800 2024-05-09T00:20:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.241+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a740c2b60 con 0x7f1a74073800 2024-05-09T00:20:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.242+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a74077430 con 0x7f1a74073800 2024-05-09T00:20:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.244+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a6001a070 con 0x7f1a74073800 2024-05-09T00:20:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.244+0000 7f1a71600640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1a54076300 0x7f1a54078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:20:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.245+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 7698+0+0 (secure 0 0 0) 0x7f1a600971e0 con 0x7f1a74073800 2024-05-09T00:20:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.245+0000 7f1a79600640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1a54076300 0x7f1a54078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:20:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.245+0000 7f1a79600640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1a54076300 0x7f1a54078810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1a68007a60 tx=0x7f1a68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:20:59.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.249+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1a600602d0 con 0x7f1a74073800 2024-05-09T00:20:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.497+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7f1a740c5630 con 0x7f1a74073800 2024-05-09T00:20:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.925+0000 7f1a71600640 1 -- 172.21.15.114:0/1486658423 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v68) ==== 99+0+0 (secure 0 0 0) 0x7f1a600682c0 con 0x7f1a74073800 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1a54076300 msgr2=0x7f1a54078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1a54076300 0x7f1a54078810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1a68007a60 tx=0x7f1a68009040 comp rx=0 tx=0).stop 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 msgr2=0x7f1a741e2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 0x7f1a741e2dd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c3d0 tx=0x7f1a6000c890 comp rx=0 tx=0).stop 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 shutdown_connections 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f1a54076300 0x7f1a54078810 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a741585c0 0x7f1a741f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a74073800 0x7f1a741e2dd0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 --2- 172.21.15.114:0/1486658423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a74072720 0x7f1a74148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:20:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.931+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 >> 172.21.15.114:0/1486658423 conn(0x7f1a7406c680 msgr2=0x7f1a7406f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:20:59.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.932+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 shutdown_connections 2024-05-09T00:20:59.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:20:59.932+0000 7f1a7c000640 1 -- 172.21.15.114:0/1486658423 wait complete. 2024-05-09T00:20:59.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-05-09T00:21:00.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.235+0000 7f00f9600640 1 Processor -- start 2024-05-09T00:21:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.235+0000 7f00f9600640 1 -- start start 2024-05-09T00:21:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f9600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00f40af070 0x7f00f40c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f9600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40c5020 0x7f00f4158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f9600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f4155e50 con 0x7f00f406e5f0 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f9600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f00f40745c0 con 0x7f00f40af070 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f9600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00f406f560 con 0x7f00f40c5020 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00f40af070 0x7f00f40c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.237+0000 7f00f8c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f00f406e5f0 0x7f00f4158db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37398/0 (socket says 172.21.15.114:37398) 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00f8c00640 1 -- 172.21.15.114:0/427662700 learned_addr learned my addr 172.21.15.114:0/427662700 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00ebe00640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40c5020 0x7f00f4158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00f3e00640 1 -- 172.21.15.114:0/427662700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40c5020 msgr2=0x7f00f4158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00f3e00640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40c5020 0x7f00f4158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00f3e00640 1 -- 172.21.15.114:0/427662700 >> v1:172.21.15.114:6789/0 conn(0x7f00f406e5f0 legacy=0x7f00f4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00f3e00640 1 -- 172.21.15.114:0/427662700 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f40abb30 con 0x7f00f40af070 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00f3400640 1 -- 172.21.15.114:0/427662700 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267036804 0 0) 0x7f00f4155e50 con 0x7f00f406e5f0 2024-05-09T00:21:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.238+0000 7f00ebe00640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40c5020 0x7f00f4158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.239+0000 7f00f3e00640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40af070 0x7f00f40c4ae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f00e40097a0 tx=0x7f00e402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a60ca3d6779b40d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.239+0000 7f00f3400640 1 -- 172.21.15.114:0/427662700 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4037070 con 0x7f00f40af070 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f3400640 1 -- 172.21.15.114:0/427662700 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f00e402adb0 con 0x7f00f40af070 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f3400640 1 -- 172.21.15.114:0/427662700 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4032680 con 0x7f00f40af070 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 -- 172.21.15.114:0/427662700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40af070 msgr2=0x7f00f40c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40af070 0x7f00f40c4ae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f00e40097a0 tx=0x7f00e402a060 comp rx=0 tx=0).stop 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 -- 172.21.15.114:0/427662700 shutdown_connections 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40c5020 0x7f00f4158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 --2- 172.21.15.114:0/427662700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40af070 0x7f00f40c4ae0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:00.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 -- 172.21.15.114:0/427662700 >> 172.21.15.114:0/427662700 conn(0x7f00f40c5bd0 msgr2=0x7f00f40c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:00.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.240+0000 7f00f9600640 1 -- 172.21.15.114:0/427662700 shutdown_connections 2024-05-09T00:21:00.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.241+0000 7f00f9600640 1 -- 172.21.15.114:0/427662700 wait complete. 2024-05-09T00:21:00.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.243+0000 7f00f9600640 1 Processor -- start 2024-05-09T00:21:00.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.243+0000 7f00f9600640 1 -- start start 2024-05-09T00:21:00.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.244+0000 7f00f9600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f406e5f0 0x7f00f40c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:00.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.244+0000 7f00f9600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40af070 0x7f00f41ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:00.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.244+0000 7f00f9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 0x7f00f4143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:00.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.244+0000 7f00f9600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00f40abdd0 con 0x7f00f40c5020 2024-05-09T00:21:00.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.244+0000 7f00f9600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4155920 con 0x7f00f406e5f0 2024-05-09T00:21:00.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.244+0000 7f00f9600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00f40ac0b0 con 0x7f00f40af070 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 0x7f00f4143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 0x7f00f4143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54594/0 (socket says 172.21.15.114:54594) 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 -- 172.21.15.114:0/3582528037 learned_addr learned my addr 172.21.15.114:0/3582528037 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00ebe00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40af070 0x7f00f41ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 -- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40af070 msgr2=0x7f00f41ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40af070 0x7f00f41ef8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 -- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f406e5f0 msgr2=0x7f00f40c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f406e5f0 0x7f00f40c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 -- 172.21.15.114:0/3582528037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f41491e0 con 0x7f00f40c5020 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.245+0000 7f00f8c00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 0x7f00f4143a90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c680 tx=0x7f00ec00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.246+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec018070 con 0x7f00f40c5020 2024-05-09T00:21:00.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.246+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f00ec004d60 con 0x7f00f40c5020 2024-05-09T00:21:00.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.246+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00a8a0 con 0x7f00f40c5020 2024-05-09T00:21:00.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.246+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f4144850 con 0x7f00f40c5020 2024-05-09T00:21:00.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.246+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f4161a40 con 0x7f00f40c5020 2024-05-09T00:21:00.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.247+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f4078430 con 0x7f00f40c5020 2024-05-09T00:21:00.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.248+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00ec00aa40 con 0x7f00f40c5020 2024-05-09T00:21:00.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.249+0000 7f00f0c00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f00d00762d0 0x7f00d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:00.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.249+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 7698+0+0 (secure 0 0 0) 0x7f00ec097570 con 0x7f00f40c5020 2024-05-09T00:21:00.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.249+0000 7f00f3e00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f00d00762d0 0x7f00d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:00.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.250+0000 7f00f3e00640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f00d00762d0 0x7f00d00787e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00e4034000 tx=0x7f00e402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:00.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.254+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00ec0605d0 con 0x7f00f40c5020 2024-05-09T00:21:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:00.463+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00f41f2370 con 0x7f00f40c5020 2024-05-09T00:21:01.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.363+0000 7f00f0c00640 1 -- 172.21.15.114:0/3582528037 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v40) ==== 166+0+0 (secure 0 0 0) 0x7f00ec05fed0 con 0x7f00f40c5020 2024-05-09T00:21:01.364 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'a_metadata' removed 2024-05-09T00:21:01.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.367+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f00d00762d0 msgr2=0x7f00d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:01.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.367+0000 7f00f9600640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f00d00762d0 0x7f00d00787e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00e4034000 tx=0x7f00e402c000 comp rx=0 tx=0).stop 2024-05-09T00:21:01.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.367+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 msgr2=0x7f00f4143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:01.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.367+0000 7f00f9600640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 0x7f00f4143a90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c680 tx=0x7f00ec00cb40 comp rx=0 tx=0).stop 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.368+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 shutdown_connections 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.368+0000 7f00f9600640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f00d00762d0 0x7f00d00787e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.368+0000 7f00f9600640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00f40c5020 0x7f00f4143a90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.368+0000 7f00f9600640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00f40af070 0x7f00f41ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.368+0000 7f00f9600640 1 --2- 172.21.15.114:0/3582528037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00f406e5f0 0x7f00f40c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.368+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 >> 172.21.15.114:0/3582528037 conn(0x7f00f40c5bd0 msgr2=0x7f00f40ac2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:01.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.369+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 shutdown_connections 2024-05-09T00:21:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.371+0000 7f00f9600640 1 -- 172.21.15.114:0/3582528037 wait complete. 2024-05-09T00:21:01.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-05-09T00:21:01.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.670+0000 7f29a4e00640 1 Processor -- start 2024-05-09T00:21:01.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.670+0000 7f29a4e00640 1 -- start start 2024-05-09T00:21:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.672+0000 7f29a4e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f29a006f770 0x7f29a00ac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f29a4e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29a0153440 0x7f29a0160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f29a4e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a006ff90 con 0x7f29a0156910 2024-05-09T00:21:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f29a4e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f29a006ecf0 con 0x7f29a0153440 2024-05-09T00:21:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f29a4e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f29a0070270 con 0x7f29a006f770 2024-05-09T00:21:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f299e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29a0153440 0x7f29a0160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f299e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29a0153440 0x7f29a0160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54606/0 (socket says 172.21.15.114:54606) 2024-05-09T00:21:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f299e800640 1 -- 172.21.15.114:0/420891102 learned_addr learned my addr 172.21.15.114:0/420891102 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f299e800640 1 -- 172.21.15.114:0/420891102 >> v2:172.21.15.153:3300/0 conn(0x7f29a006f770 msgr2=0x7f29a00ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f299e800640 1 --2- 172.21.15.114:0/420891102 >> v2:172.21.15.153:3300/0 conn(0x7f29a006f770 0x7f29a00ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.673+0000 7f299e800640 1 -- 172.21.15.114:0/420891102 >> v1:172.21.15.153:6789/0 conn(0x7f29a0156910 legacy=0x7f29a00ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.674+0000 7f299e800640 1 -- 172.21.15.114:0/420891102 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a00af430 con 0x7f29a0153440 2024-05-09T00:21:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.675+0000 7f299e800640 1 --2- 172.21.15.114:0/420891102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a0153440 0x7f29a0160850 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f29a0071ac0 tx=0x7f299802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19bc8376e7fbe73 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.675+0000 7f299d400640 1 -- 172.21.15.114:0/420891102 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998036070 con 0x7f29a0153440 2024-05-09T00:21:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.675+0000 7f299d400640 1 -- 172.21.15.114:0/420891102 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2998031600 con 0x7f29a0153440 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.675+0000 7f299d400640 1 -- 172.21.15.114:0/420891102 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29980319f0 con 0x7f29a0153440 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 -- 172.21.15.114:0/420891102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a0153440 msgr2=0x7f29a0160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 --2- 172.21.15.114:0/420891102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a0153440 0x7f29a0160850 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f29a0071ac0 tx=0x7f299802a610 comp rx=0 tx=0).stop 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 -- 172.21.15.114:0/420891102 shutdown_connections 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 --2- 172.21.15.114:0/420891102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a0153440 0x7f29a0160850 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 --2- 172.21.15.114:0/420891102 >> v2:172.21.15.153:3300/0 conn(0x7f29a006f770 0x7f29a00ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 -- 172.21.15.114:0/420891102 >> 172.21.15.114:0/420891102 conn(0x7f29a006ca70 msgr2=0x7f29a006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 -- 172.21.15.114:0/420891102 shutdown_connections 2024-05-09T00:21:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.676+0000 7f29a4e00640 1 -- 172.21.15.114:0/420891102 wait complete. 2024-05-09T00:21:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.678+0000 7f29a4e00640 1 Processor -- start 2024-05-09T00:21:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.678+0000 7f29a4e00640 1 -- start start 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f29a4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 0x7f29a01499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f29a4e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29a0153440 0x7f29a01585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f29a4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29a0156910 0x7f29a01efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f29a4e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f29a006ef40 con 0x7f29a006f770 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f29a4e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f29a0153850 con 0x7f29a0156910 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f29a4e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f29a00706e0 con 0x7f29a0153440 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 0x7f29a01499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 0x7f29a01499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54620/0 (socket says 172.21.15.114:54620) 2024-05-09T00:21:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 -- 172.21.15.114:0/2104807301 learned_addr learned my addr 172.21.15.114:0/2104807301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 -- 172.21.15.114:0/2104807301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29a0153440 msgr2=0x7f29a01585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29a0153440 0x7f29a01585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 -- 172.21.15.114:0/2104807301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29a0156910 msgr2=0x7f29a01efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.680+0000 7f299de00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29a0156910 0x7f29a01efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f299de00640 1 -- 172.21.15.114:0/2104807301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a0149f20 con 0x7f29a006f770 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f299de00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 0x7f29a01499e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f299000b410 tx=0x7f299000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990015020 con 0x7f29a006f770 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2990011850 con 0x7f29a006f770 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990011c60 con 0x7f29a006f770 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a01f0b00 con 0x7f29a006f770 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.681+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a014afb0 con 0x7f29a006f770 2024-05-09T00:21:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.682+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a0077430 con 0x7f29a006f770 2024-05-09T00:21:01.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.684+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2990018020 con 0x7f29a006f770 2024-05-09T00:21:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.685+0000 7f2996000640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f297c076300 0x7f297c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.685+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 7270+0+0 (secure 0 0 0) 0x7f2990097b10 con 0x7f29a006f770 2024-05-09T00:21:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.685+0000 7f2997e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f297c076300 0x7f297c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.686+0000 7f2997e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f297c076300 0x7f297c078810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f29a00c9320 tx=0x7f2988006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.690+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f299001f020 con 0x7f29a006f770 2024-05-09T00:21:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:01.920+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f29a00c3b90 con 0x7f29a006f770 2024-05-09T00:21:02.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.367+0000 7f2996000640 1 -- 172.21.15.114:0/2104807301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v41) ==== 154+0+0 (secure 0 0 0) 0x7f2990060e40 con 0x7f29a006f770 2024-05-09T00:21:02.368 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'a_data' removed 2024-05-09T00:21:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.372+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f297c076300 msgr2=0x7f297c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.372+0000 7f29a4e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f297c076300 0x7f297c078810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f29a00c9320 tx=0x7f2988006ba0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.372+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 msgr2=0x7f29a01499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:02.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.372+0000 7f29a4e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 0x7f29a01499e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f299000b410 tx=0x7f299000b8d0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.373+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 shutdown_connections 2024-05-09T00:21:02.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.373+0000 7f29a4e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f297c076300 0x7f297c078810 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.373+0000 7f29a4e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29a0156910 0x7f29a01efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.373+0000 7f29a4e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29a0153440 0x7f29a01585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.373+0000 7f29a4e00640 1 --2- 172.21.15.114:0/2104807301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a006f770 0x7f29a01499e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.373+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 >> 172.21.15.114:0/2104807301 conn(0x7f29a006ca70 msgr2=0x7f29a006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.377+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 shutdown_connections 2024-05-09T00:21:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.382+0000 7f29a4e00640 1 -- 172.21.15.114:0/2104807301 wait complete. 2024-05-09T00:21:02.441 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-05-09T00:21:02.441 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:21:02.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.777+0000 7fb151200640 1 Processor -- start 2024-05-09T00:21:02.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.777+0000 7fb151200640 1 -- start start 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.779+0000 7fb151200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb14c073800 0x7fb14c072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.779+0000 7fb151200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c074040 con 0x7fb14c0c4a70 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.779+0000 7fb151200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c0c58f0 con 0x7fb14c1585c0 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.779+0000 7fb151200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb14c073df0 con 0x7fb14c073800 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.779+0000 7fb149e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb14c073800 0x7fb14c072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb141400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb14c0c4a70 0x7fb14c0c63d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37406/0 (socket says 172.21.15.114:37406) 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb149e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb14c073800 0x7fb14c072720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54630/0 (socket says 172.21.15.114:54630) 2024-05-09T00:21:02.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb141400640 1 -- 172.21.15.114:0/1779571954 learned_addr learned my addr 172.21.15.114:0/1779571954 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:21:02.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb149e00640 1 -- 172.21.15.114:0/1779571954 >> v1:172.21.15.153:6789/0 conn(0x7fb14c1585c0 legacy=0x7fb14c15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:02.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb149e00640 1 -- 172.21.15.114:0/1779571954 >> v1:172.21.15.114:6789/0 conn(0x7fb14c0c4a70 legacy=0x7fb14c0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:02.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb149e00640 1 -- 172.21.15.114:0/1779571954 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c0c5bd0 con 0x7fb14c073800 2024-05-09T00:21:02.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.780+0000 7fb149400640 1 -- 172.21.15.114:0/1779571954 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749501562 0 0) 0x7fb14c074040 con 0x7fb14c0c4a70 2024-05-09T00:21:02.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.781+0000 7fb149e00640 1 --2- 172.21.15.114:0/1779571954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c073800 0x7fb14c072720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0097a0 tx=0x7fb13c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e98a53d589f62 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.781+0000 7fb149400640 1 -- 172.21.15.114:0/1779571954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c037070 con 0x7fb14c073800 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.781+0000 7fb149400640 1 -- 172.21.15.114:0/1779571954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb13c032440 con 0x7fb14c073800 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.781+0000 7fb149400640 1 -- 172.21.15.114:0/1779571954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c032830 con 0x7fb14c073800 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 -- 172.21.15.114:0/1779571954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c073800 msgr2=0x7fb14c072720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 --2- 172.21.15.114:0/1779571954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c073800 0x7fb14c072720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0097a0 tx=0x7fb13c02a180 comp rx=0 tx=0).stop 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 -- 172.21.15.114:0/1779571954 shutdown_connections 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 --2- 172.21.15.114:0/1779571954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c073800 0x7fb14c072720 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 -- 172.21.15.114:0/1779571954 >> 172.21.15.114:0/1779571954 conn(0x7fb14c06c680 msgr2=0x7fb14c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 -- 172.21.15.114:0/1779571954 shutdown_connections 2024-05-09T00:21:02.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.782+0000 7fb151200640 1 -- 172.21.15.114:0/1779571954 wait complete. 2024-05-09T00:21:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.784+0000 7fb151200640 1 Processor -- start 2024-05-09T00:21:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.785+0000 7fb151200640 1 -- start start 2024-05-09T00:21:02.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb151200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb14c073800 0x7fb14c1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:02.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb151200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 0x7fb14c1ee340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:02.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb151200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb14c1585c0 0x7fb14c140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb151200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c0c4e80 con 0x7fb14c0c4a70 2024-05-09T00:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb151200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c0c5f40 con 0x7fb14c1585c0 2024-05-09T00:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb151200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c14cc60 con 0x7fb14c073800 2024-05-09T00:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb141400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 0x7fb14c1ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb141400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 0x7fb14c1ee340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54642/0 (socket says 172.21.15.114:54642) 2024-05-09T00:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.786+0000 7fb141400640 1 -- 172.21.15.114:0/295886572 learned_addr learned my addr 172.21.15.114:0/295886572 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb141400640 1 -- 172.21.15.114:0/295886572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb14c073800 msgr2=0x7fb14c1419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb141400640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb14c073800 0x7fb14c1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb141400640 1 -- 172.21.15.114:0/295886572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb14c1585c0 msgr2=0x7fb14c140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb141400640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb14c1585c0 0x7fb14c140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb141400640 1 -- 172.21.15.114:0/295886572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c1f2080 con 0x7fb14c0c4a70 2024-05-09T00:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb141400640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 0x7fb14c1ee340 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c3e0 tx=0x7fb13400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340074e0 con 0x7fb14c0c4a70 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb1340047e0 con 0x7fb14c0c4a70 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134004bf0 con 0x7fb14c0c4a70 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.787+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c1f2360 con 0x7fb14c0c4a70 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.788+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c142870 con 0x7fb14c0c4a70 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.789+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c077430 con 0x7fb14c0c4a70 2024-05-09T00:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.790+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb134011070 con 0x7fb14c0c4a70 2024-05-09T00:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.791+0000 7fb142a00640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb128076300 0x7fb128078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.791+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6837+0+0 (secure 0 0 0) 0x7fb134097840 con 0x7fb14c0c4a70 2024-05-09T00:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.791+0000 7fb149e00640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb128076300 0x7fb128078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.792+0000 7fb149e00640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb128076300 0x7fb128078810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb13c034000 tx=0x7fb13c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:02.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:02.796+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb134060c00 con 0x7fb14c0c4a70 2024-05-09T00:21:03.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.071+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb14c164f50 con 0x7fb14c0c4a70 2024-05-09T00:21:03.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.072+0000 7fb142a00640 1 -- 172.21.15.114:0/295886572 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5192 (secure 0 0 0) 0x7fb134060500 con 0x7fb14c0c4a70 2024-05-09T00:21:03.072 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:21:03.072 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2903422251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2903422251},{"type":"v1","addr":"172.21.15.114:6837","nonce":2903422251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:21:03.073 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 68 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb128076300 msgr2=0x7fb128078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb128076300 0x7fb128078810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb13c034000 tx=0x7fb13c02c000 comp rx=0 tx=0).stop 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 msgr2=0x7fb14c1ee340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 0x7fb14c1ee340 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c3e0 tx=0x7fb13400c8a0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 shutdown_connections 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fb128076300 0x7fb128078810 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb14c1585c0 0x7fb14c140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb14c0c4a70 0x7fb14c1ee340 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 --2- 172.21.15.114:0/295886572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb14c073800 0x7fb14c1419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 >> 172.21.15.114:0/295886572 conn(0x7fb14c06c680 msgr2=0x7fb14c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 shutdown_connections 2024-05-09T00:21:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.075+0000 7fb151200640 1 -- 172.21.15.114:0/295886572 wait complete. 2024-05-09T00:21:03.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:21:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.356+0000 7fc6e1800640 1 Processor -- start 2024-05-09T00:21:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.356+0000 7fc6e1800640 1 -- start start 2024-05-09T00:21:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.358+0000 7fc6e1800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0accb0 0x7fc6dc0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e1800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6dc0aed60 0x7fc6dc0af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e1800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc0ad0c0 con 0x7fc6dc0aba00 2024-05-09T00:21:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e1800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc6dc156260 con 0x7fc6dc0aed60 2024-05-09T00:21:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e1800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc0ad340 con 0x7fc6dc0accb0 2024-05-09T00:21:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6dc0aed60 0x7fc6dc0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0accb0 0x7fc6dc0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6dc0aed60 0x7fc6dc0af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:41040/0 (socket says 172.21.15.114:41040) 2024-05-09T00:21:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6e0e00640 1 -- 172.21.15.114:0/96975731 learned_addr learned my addr 172.21.15.114:0/96975731 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.359+0000 7fc6dbe00640 1 --1- 172.21.15.114:0/96975731 >> v1:172.21.15.153:6789/0 conn(0x7fc6dc0aba00 0x7fc6dc1566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.114:54032/0 (socket says 172.21.15.114:54032) 2024-05-09T00:21:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.360+0000 7fc6e0e00640 1 -- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0accb0 msgr2=0x7fc6dc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.360+0000 7fc6e0e00640 1 --2- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0accb0 0x7fc6dc0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.360+0000 7fc6e0e00640 1 -- 172.21.15.114:0/96975731 >> v1:172.21.15.153:6789/0 conn(0x7fc6dc0aba00 legacy=0x7fc6dc1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.360+0000 7fc6e0e00640 1 -- 172.21.15.114:0/96975731 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc155f10 con 0x7fc6dc0aed60 2024-05-09T00:21:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.360+0000 7fc6d3400640 1 --2- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0accb0 0x7fc6dc0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:21:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.362+0000 7fc6e0e00640 1 --2- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc0af170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009e50 tx=0x7fc6d402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6e15d398ff3f0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.362+0000 7fc6db400640 1 -- 172.21.15.114:0/96975731 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4036070 con 0x7fc6dc0aed60 2024-05-09T00:21:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.362+0000 7fc6db400640 1 -- 172.21.15.114:0/96975731 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc6d4031600 con 0x7fc6dc0aed60 2024-05-09T00:21:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.362+0000 7fc6db400640 1 -- 172.21.15.114:0/96975731 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40319f0 con 0x7fc6dc0aed60 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 -- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 msgr2=0x7fc6dc0af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 --2- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc0af170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009e50 tx=0x7fc6d402a680 comp rx=0 tx=0).stop 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 -- 172.21.15.114:0/96975731 shutdown_connections 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 --2- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc0af170 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 --2- 172.21.15.114:0/96975731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0accb0 0x7fc6dc0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 -- 172.21.15.114:0/96975731 >> 172.21.15.114:0/96975731 conn(0x7fc6dc0c9730 msgr2=0x7fc6dc0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 -- 172.21.15.114:0/96975731 shutdown_connections 2024-05-09T00:21:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.363+0000 7fc6e1800640 1 -- 172.21.15.114:0/96975731 wait complete. 2024-05-09T00:21:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.366+0000 7fc6e1800640 1 Processor -- start 2024-05-09T00:21:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.366+0000 7fc6e1800640 1 -- start start 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6e1800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0aba00 0x7fc6dc152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6e1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 0x7fc6dc0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6e1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc1edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6e1800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc0c5220 con 0x7fc6dc0accb0 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6e1800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc0c4f40 con 0x7fc6dc0aed60 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6e1800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc0c4920 con 0x7fc6dc0aba00 2024-05-09T00:21:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 0x7fc6dc0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 0x7fc6dc0c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54646/0 (socket says 172.21.15.114:54646) 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.368+0000 7fc6d3400640 1 -- 172.21.15.114:0/2652917954 learned_addr learned my addr 172.21.15.114:0/2652917954 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d3400640 1 -- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0aba00 msgr2=0x7fc6dc152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6dbe00640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0aba00 0x7fc6dc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6e0e00640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc1edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d3400640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0aba00 0x7fc6dc152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d3400640 1 -- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 msgr2=0x7fc6dc1edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d3400640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc1edfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d3400640 1 -- 172.21.15.114:0/2652917954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc0c9000 con 0x7fc6dc0accb0 2024-05-09T00:21:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d3400640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 0x7fc6dc0c27d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400e930 tx=0x7fc6c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4017070 con 0x7fc6dc0accb0 2024-05-09T00:21:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc6c400ca00 con 0x7fc6dc0accb0 2024-05-09T00:21:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400ce10 con 0x7fc6dc0accb0 2024-05-09T00:21:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.369+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc1eea40 con 0x7fc6dc0accb0 2024-05-09T00:21:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.370+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1edae0 con 0x7fc6dc0accb0 2024-05-09T00:21:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.370+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc078430 con 0x7fc6dc0accb0 2024-05-09T00:21:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.372+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6c401a070 con 0x7fc6dc0accb0 2024-05-09T00:21:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.373+0000 7fc6d8c00640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6b80762d0 0x7fc6b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.373+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6837+0+0 (secure 0 0 0) 0x7fc6c4097730 con 0x7fc6dc0accb0 2024-05-09T00:21:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.373+0000 7fc6dbe00640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6b80762d0 0x7fc6b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.374+0000 7fc6dbe00640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6b80762d0 0x7fc6b80787e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc007fd0 tx=0x7fc6cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:03.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.378+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6dc0c9000 con 0x7fc6dc0accb0 2024-05-09T00:21:03.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.627+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6dc0c4b80 con 0x7fc6dc0accb0 2024-05-09T00:21:03.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.629+0000 7fc6d8c00640 1 -- 172.21.15.114:0/2652917954 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5192 (secure 0 0 0) 0x7fc6c4060af0 con 0x7fc6dc0accb0 2024-05-09T00:21:03.630 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:21:03.630 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2903422251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2903422251},{"type":"v1","addr":"172.21.15.114:6837","nonce":2903422251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:18:58.347796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4616":{"gid":4616,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":79,"addr":"172.21.15.153:6833/1507999433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1507999433},{"type":"v1","addr":"172.21.15.153:6833","nonce":1507999433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4616,"qdb_cluster":[4616]},"id":2}]} 2024-05-09T00:21:03.630 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 68 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6b80762d0 msgr2=0x7fc6b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6b80762d0 0x7fc6b80787e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc007fd0 tx=0x7fc6cc009040 comp rx=0 tx=0).stop 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 msgr2=0x7fc6dc0c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 0x7fc6dc0c27d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400e930 tx=0x7fc6c400edf0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 shutdown_connections 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fc6b80762d0 0x7fc6b80787e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6dc0aed60 0x7fc6dc1edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6dc0accb0 0x7fc6dc0c27d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 --2- 172.21.15.114:0/2652917954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6dc0aba00 0x7fc6dc152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 >> 172.21.15.114:0/2652917954 conn(0x7fc6dc0c9730 msgr2=0x7fc6dc13e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 shutdown_connections 2024-05-09T00:21:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.632+0000 7fc6e1800640 1 -- 172.21.15.114:0/2652917954 wait complete. 2024-05-09T00:21:03.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:21:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.930+0000 7ff465c00640 1 Processor -- start 2024-05-09T00:21:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.930+0000 7ff465c00640 1 -- start start 2024-05-09T00:21:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff465c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4601590f0 0x7ff46015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff465c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4600c8610 con 0x7ff4601583a0 2024-05-09T00:21:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff465c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4600c8050 con 0x7ff4600c8850 2024-05-09T00:21:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff465c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff4600c8330 con 0x7ff4601590f0 2024-05-09T00:21:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff45fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff4601583a0 0x7ff4600ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37416/0 (socket says 172.21.15.114:37416) 2024-05-09T00:21:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff45fe00640 1 -- 172.21.15.114:0/3863260472 learned_addr learned my addr 172.21.15.114:0/3863260472 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:21:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.932+0000 7ff465200640 1 --2- 172.21.15.114:0/3863260472 >> v2:172.21.15.114:3300/0 conn(0x7ff4601590f0 0x7ff46015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.933+0000 7ff45f400640 1 -- 172.21.15.114:0/3863260472 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875918820 0 0) 0x7ff4600c8610 con 0x7ff4601583a0 2024-05-09T00:21:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.933+0000 7ff45f400640 1 -- 172.21.15.114:0/3863260472 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff444003520 con 0x7ff4601583a0 2024-05-09T00:21:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.933+0000 7ff465200640 1 -- 172.21.15.114:0/3863260472 >> v1:172.21.15.153:6789/0 conn(0x7ff4600c8850 legacy=0x7ff4601589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.933+0000 7ff465200640 1 -- 172.21.15.114:0/3863260472 >> v1:172.21.15.114:6789/0 conn(0x7ff4601583a0 legacy=0x7ff4600ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.933+0000 7ff465200640 1 -- 172.21.15.114:0/3863260472 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46015b9b0 con 0x7ff4601590f0 2024-05-09T00:21:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.934+0000 7ff465200640 1 --2- 172.21.15.114:0/3863260472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601590f0 0x7ff46015beb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff458009d90 tx=0x7ff45802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b5efd1e8511ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.934+0000 7ff45f400640 1 -- 172.21.15.114:0/3863260472 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458007740 con 0x7ff4601590f0 2024-05-09T00:21:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.934+0000 7ff45f400640 1 -- 172.21.15.114:0/3863260472 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff4580078e0 con 0x7ff4601590f0 2024-05-09T00:21:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.934+0000 7ff45f400640 1 -- 172.21.15.114:0/3863260472 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458007cd0 con 0x7ff4601590f0 2024-05-09T00:21:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 -- 172.21.15.114:0/3863260472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601590f0 msgr2=0x7ff46015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 --2- 172.21.15.114:0/3863260472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601590f0 0x7ff46015beb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff458009d90 tx=0x7ff45802a660 comp rx=0 tx=0).stop 2024-05-09T00:21:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 -- 172.21.15.114:0/3863260472 shutdown_connections 2024-05-09T00:21:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 --2- 172.21.15.114:0/3863260472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601590f0 0x7ff46015beb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 -- 172.21.15.114:0/3863260472 >> 172.21.15.114:0/3863260472 conn(0x7ff4600af450 msgr2=0x7ff4600af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 -- 172.21.15.114:0/3863260472 shutdown_connections 2024-05-09T00:21:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.935+0000 7ff465c00640 1 -- 172.21.15.114:0/3863260472 wait complete. 2024-05-09T00:21:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.937+0000 7ff465c00640 1 Processor -- start 2024-05-09T00:21:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.937+0000 7ff465c00640 1 -- start start 2024-05-09T00:21:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff465c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4600c8850 0x7ff4601e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff465c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 0x7ff4601f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff465c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4601590f0 0x7ff4601528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff465c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600cc4c0 con 0x7ff4601583a0 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff465c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600cc340 con 0x7ff4600c8850 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff465c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff4600cc640 con 0x7ff4601590f0 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff457400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 0x7ff4601f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff457400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 0x7ff4601f1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54656/0 (socket says 172.21.15.114:54656) 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff457400640 1 -- 172.21.15.114:0/3010944259 learned_addr learned my addr 172.21.15.114:0/3010944259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.939+0000 7ff45fe00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4600c8850 0x7ff4601e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff457400640 1 -- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4601590f0 msgr2=0x7ff4601528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff457400640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4601590f0 0x7ff4601528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff457400640 1 -- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4600c8850 msgr2=0x7ff4601e21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff457400640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4600c8850 0x7ff4601e21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff457400640 1 -- 172.21.15.114:0/3010944259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff460153430 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff457400640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 0x7ff4601f1480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c370 tx=0x7ff44800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448017070 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff4480052d0 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4601f1d50 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448003830 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.940+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4600c4550 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.941+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff460078430 con 0x7ff4601583a0 2024-05-09T00:21:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.943+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff44801a070 con 0x7ff4601583a0 2024-05-09T00:21:03.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.944+0000 7ff45cc00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff43c0762d0 0x7ff43c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:03.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.945+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6837+0+0 (secure 0 0 0) 0x7ff448096d90 con 0x7ff4601583a0 2024-05-09T00:21:03.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.945+0000 7ff45fe00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff43c0762d0 0x7ff43c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:03.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.945+0000 7ff45fe00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff43c0762d0 0x7ff43c0787e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff450007a60 tx=0x7ff450009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:03.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:03.950+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff448060280 con 0x7ff4601583a0 2024-05-09T00:21:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.157+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4600ccf10 con 0x7ff4601583a0 2024-05-09T00:21:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.160+0000 7ff45cc00640 1 -- 172.21.15.114:0/3010944259 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18464 (secure 0 0 0) 0x7ff448068270 con 0x7ff4601583a0 2024-05-09T00:21:04.161 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:21:04.161 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"fsid":"3ba80eb4-67b3-44b1-9aaa-2222c4d8c9ae","created":"2024-05-09T00:08:25.076598+0000","modified":"2024-05-09T00:21:02.364711+0000","last_up_change":"2024-05-09T00:08:37.972589+0000","last_in_change":"2024-05-09T00:08:29.067375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:08:38.315422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T00:08:52.408571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T00:08:53.695063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b42b6afe-9a52-431c-b60f-3ef463fd909c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6817","nonce":694320788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6819","nonce":694320788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6825","nonce":694320788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":694320788},{"type":"v1","addr":"172.21.15.114:6821","nonce":694320788}]},"public_addr":"172.21.15.114:6817/694320788","cluster_addr":"172.21.15.114:6819/694320788","heartbeat_back_addr":"172.21.15.114:6825/694320788","heartbeat_front_addr":"172.21.15.114:6821/694320788","state":["exists","up"]},{"osd":1,"uuid":"32e3b05a-16b9-4525-b6e2-98c094f1fe1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6824","nonce":3701738775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6827","nonce":3701738775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6831","nonce":3701738775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3701738775},{"type":"v1","addr":"172.21.15.114:6829","nonce":3701738775}]},"public_addr":"172.21.15.114:6824/3701738775","cluster_addr":"172.21.15.114:6827/3701738775","heartbeat_back_addr":"172.21.15.114:6831/3701738775","heartbeat_front_addr":"172.21.15.114:6829/3701738775","state":["exists","up"]},{"osd":2,"uuid":"09b75db5-080a-4672-b5a4-308fdeda451d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6801","nonce":1426654840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6803","nonce":1426654840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6807","nonce":1426654840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1426654840},{"type":"v1","addr":"172.21.15.114:6805","nonce":1426654840}]},"public_addr":"172.21.15.114:6801/1426654840","cluster_addr":"172.21.15.114:6803/1426654840","heartbeat_back_addr":"172.21.15.114:6807/1426654840","heartbeat_front_addr":"172.21.15.114:6805/1426654840","state":["exists","up"]},{"osd":3,"uuid":"d4ae79fe-ddd3-4699-871b-ee740190b4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6809","nonce":3419026789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6811","nonce":3419026789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6815","nonce":3419026789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3419026789},{"type":"v1","addr":"172.21.15.114:6813","nonce":3419026789}]},"public_addr":"172.21.15.114:6809/3419026789","cluster_addr":"172.21.15.114:6811/3419026789","heartbeat_back_addr":"172.21.15.114:6815/3419026789","heartbeat_front_addr":"172.21.15.114:6813/3419026789","state":["exists","up"]},{"osd":4,"uuid":"89334d7c-628b-4e2b-899d-55085379af15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6801","nonce":2251471129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6803","nonce":2251471129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6807","nonce":2251471129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2251471129},{"type":"v1","addr":"172.21.15.153:6805","nonce":2251471129}]},"public_addr":"172.21.15.153:6801/2251471129","cluster_addr":"172.21.15.153:6803/2251471129","heartbeat_back_addr":"172.21.15.153:6807/2251471129","heartbeat_front_addr":"172.21.15.153:6805/2251471129","state":["exists","up"]},{"osd":5,"uuid":"3bbade74-d2bd-44e5-8151-e8e223b0812e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6825","nonce":4042985411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6827","nonce":4042985411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6831","nonce":4042985411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4042985411},{"type":"v1","addr":"172.21.15.153:6829","nonce":4042985411}]},"public_addr":"172.21.15.153:6825/4042985411","cluster_addr":"172.21.15.153:6827/4042985411","heartbeat_back_addr":"172.21.15.153:6831/4042985411","heartbeat_front_addr":"172.21.15.153:6829/4042985411","state":["exists","up"]},{"osd":6,"uuid":"a4bb8307-e545-40fb-bdce-02b394bc9a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6809","nonce":3084340676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6811","nonce":3084340676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6815","nonce":3084340676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3084340676},{"type":"v1","addr":"172.21.15.153:6813","nonce":3084340676}]},"public_addr":"172.21.15.153:6809/3084340676","cluster_addr":"172.21.15.153:6811/3084340676","heartbeat_back_addr":"172.21.15.153:6815/3084340676","heartbeat_front_addr":"172.21.15.153:6813/3084340676","state":["exists","up"]},{"osd":7,"uuid":"4d35ced3-d0b9-4e87-a0dd-23f4fc6c8e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6817","nonce":3047453472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6819","nonce":3047453472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6823","nonce":3047453472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3047453472},{"type":"v1","addr":"172.21.15.153:6821","nonce":3047453472}]},"public_addr":"172.21.15.153:6817/3047453472","cluster_addr":"172.21.15.153:6819/3047453472","heartbeat_back_addr":"172.21.15.153:6823/3047453472","heartbeat_front_addr":"172.21.15.153:6821/3047453472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.637298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.565337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.531395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.509075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.236827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.590754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.433999+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:08:34.577775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/2437507270":"2024-05-10T00:20:58.917291+0000","172.21.15.114:6836/2312453128":"2024-05-10T00:18:35.025950+0000","172.21.15.114:6834/2312453128":"2024-05-10T00:18:35.025950+0000","172.21.15.114:6835/372512194":"2024-05-10T00:17:25.004758+0000","172.21.15.114:6834/281438172":"2024-05-10T00:16:34.973324+0000","172.21.15.153:6835/4100525107":"2024-05-10T00:15:44.956406+0000","172.21.15.153:6835/1232162808":"2024-05-10T00:18:25.023032+0000","172.21.15.153:6834/3829412957":"2024-05-10T00:11:14.866186+0000","172.21.15.114:6836/1891949153":"2024-05-10T00:15:04.943103+0000","172.21.15.114:6836/281438172":"2024-05-10T00:16:34.973324+0000","172.21.15.153:6835/3829412957":"2024-05-10T00:11:14.866186+0000","172.21.15.114:6836/1498992114":"2024-05-10T00:11:24.870997+0000","172.21.15.114:6837/2437507270":"2024-05-10T00:20:58.917291+0000","172.21.15.114:6835/2960717153":"2024-05-10T00:14:19.928294+0000","172.21.15.114:6834/1498992114":"2024-05-10T00:11:24.870997+0000","172.21.15.153:6834/1585617173":"2024-05-10T00:13:34.914248+0000","172.21.15.153:6834/1232162808":"2024-05-10T00:18:25.023032+0000","172.21.15.153:6835/1585617173":"2024-05-10T00:13:34.914248+0000","172.21.15.153:6833/690310809":"2024-05-10T00:13:34.914171+0000","172.21.15.114:6834/1891949153":"2024-05-10T00:15:04.943103+0000","172.21.15.153:6832/690310809":"2024-05-10T00:13:34.914171+0000","172.21.15.114:6837/2960717153":"2024-05-10T00:14:19.928294+0000","172.21.15.114:6837/372512194":"2024-05-10T00:17:25.004758+0000","172.21.15.153:6834/4100525107":"2024-05-10T00:15:44.956406+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:21:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff43c0762d0 msgr2=0x7ff43c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff43c0762d0 0x7ff43c0787e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff450007a60 tx=0x7ff450009040 comp rx=0 tx=0).stop 2024-05-09T00:21:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 msgr2=0x7ff4601f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 0x7ff4601f1480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c370 tx=0x7ff44800c830 comp rx=0 tx=0).stop 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 shutdown_connections 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7ff43c0762d0 0x7ff43c0787e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4601590f0 0x7ff4601528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4601583a0 0x7ff4601f1480 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 --2- 172.21.15.114:0/3010944259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4600c8850 0x7ff4601e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 >> 172.21.15.114:0/3010944259 conn(0x7ff4600af450 msgr2=0x7ff46015a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 shutdown_connections 2024-05-09T00:21:04.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.163+0000 7ff465c00640 1 -- 172.21.15.114:0/3010944259 wait complete. 2024-05-09T00:21:04.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-05-09T00:21:04.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:21:04.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.463+0000 7fd192600640 1 Processor -- start 2024-05-09T00:21:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.463+0000 7fd192600640 1 -- start start 2024-05-09T00:21:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.465+0000 7fd192600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd18c155950 0x7fd18c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.465+0000 7fd192600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c15bd70 0x7fd18c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.465+0000 7fd192600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd18c1585d0 con 0x7fd18c0c0560 2024-05-09T00:21:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.465+0000 7fd192600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd18c155d60 con 0x7fd18c155950 2024-05-09T00:21:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.465+0000 7fd192600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd18c1588b0 con 0x7fd18c15bd70 2024-05-09T00:21:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.466+0000 7fd18aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd18c155950 0x7fd18c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.466+0000 7fd18aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd18c155950 0x7fd18c15b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.114:41060/0 (socket says 172.21.15.114:41060) 2024-05-09T00:21:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.466+0000 7fd18aa00640 1 -- 172.21.15.114:0/1053936465 learned_addr learned my addr 172.21.15.114:0/1053936465 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.466+0000 7fd18be00640 1 --2- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c15bd70 0x7fd18c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.467+0000 7fd18aa00640 1 -- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c15bd70 msgr2=0x7fd18c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.467+0000 7fd18aa00640 1 --2- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c15bd70 0x7fd18c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.467+0000 7fd18aa00640 1 -- 172.21.15.114:0/1053936465 >> v1:172.21.15.153:6789/0 conn(0x7fd18c0c0560 legacy=0x7fd18c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.467+0000 7fd18aa00640 1 -- 172.21.15.114:0/1053936465 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c158b90 con 0x7fd18c155950 2024-05-09T00:21:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.467+0000 7fd18a000640 1 -- 172.21.15.114:0/1053936465 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163851021 0 0) 0x7fd18c1585d0 con 0x7fd18c0c0560 2024-05-09T00:21:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.468+0000 7fd18aa00640 1 --2- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15b830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd178009870 tx=0x7fd17802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87b76ff8197eec7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.469+0000 7fd18a000640 1 -- 172.21.15.114:0/1053936465 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178037070 con 0x7fd18c155950 2024-05-09T00:21:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.469+0000 7fd18a000640 1 -- 172.21.15.114:0/1053936465 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd178032440 con 0x7fd18c155950 2024-05-09T00:21:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.469+0000 7fd18a000640 1 -- 172.21.15.114:0/1053936465 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178032830 con 0x7fd18c155950 2024-05-09T00:21:04.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 -- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 msgr2=0x7fd18c15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 --2- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15b830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd178009870 tx=0x7fd17802a270 comp rx=0 tx=0).stop 2024-05-09T00:21:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 -- 172.21.15.114:0/1053936465 shutdown_connections 2024-05-09T00:21:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 --2- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c15bd70 0x7fd18c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 --2- 172.21.15.114:0/1053936465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15b830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 -- 172.21.15.114:0/1053936465 >> 172.21.15.114:0/1053936465 conn(0x7fd18c0c7170 msgr2=0x7fd18c0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 -- 172.21.15.114:0/1053936465 shutdown_connections 2024-05-09T00:21:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.470+0000 7fd192600640 1 -- 172.21.15.114:0/1053936465 wait complete. 2024-05-09T00:21:04.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.472+0000 7fd192600640 1 Processor -- start 2024-05-09T00:21:04.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.473+0000 7fd192600640 1 -- start start 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd192600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c0c0560 0x7fd18c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd192600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd192600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 0x7fd18c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd192600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c0acc30 con 0x7fd18c15bd70 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd192600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c158280 con 0x7fd18c155950 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd192600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd18c06cd90 con 0x7fd18c0c0560 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.474+0000 7fd18be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 0x7fd18c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 0x7fd18c14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54672/0 (socket says 172.21.15.114:54672) 2024-05-09T00:21:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 -- 172.21.15.114:0/1403093111 learned_addr learned my addr 172.21.15.114:0/1403093111 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18b400640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c0c0560 0x7fd18c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18aa00640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 -- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c0c0560 msgr2=0x7fd18c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c0c0560 0x7fd18c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 -- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 msgr2=0x7fd18c15a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18be00640 1 -- 172.21.15.114:0/1403093111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c14fc70 con 0x7fd18c15bd70 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.475+0000 7fd18b400640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c0c0560 0x7fd18c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.476+0000 7fd18be00640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 0x7fd18c14e3b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd18400efc0 tx=0x7fd18400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.476+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184018020 con 0x7fd18c15bd70 2024-05-09T00:21:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.476+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd184014480 con 0x7fd18c15bd70 2024-05-09T00:21:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.476+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184009e60 con 0x7fd18c15bd70 2024-05-09T00:21:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.476+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c1eecf0 con 0x7fd18c15bd70 2024-05-09T00:21:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.476+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c14f990 con 0x7fd18c15bd70 2024-05-09T00:21:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.477+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18c077430 con 0x7fd18c15bd70 2024-05-09T00:21:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.479+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd18401b020 con 0x7fd18c15bd70 2024-05-09T00:21:04.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.480+0000 7fd183400640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd16c076300 0x7fd16c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.480+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6837+0+0 (secure 0 0 0) 0x7fd184098750 con 0x7fd18c15bd70 2024-05-09T00:21:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.480+0000 7fd18b400640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd16c076300 0x7fd16c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.481+0000 7fd18b400640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd16c076300 0x7fd16c078810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000f60 tx=0x7fd17c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:04.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.486+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd184022020 con 0x7fd18c15bd70 2024-05-09T00:21:04.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.498+0000 7f210aa00640 1 Processor -- start 2024-05-09T00:21:04.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.498+0000 7f210aa00640 1 -- start start 2024-05-09T00:21:04.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f210aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2104153760 0x7f2104159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f210aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21040ae940 0x7f21040aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f210aa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2104156bb0 con 0x7f21040c43c0 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f210aa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f21040ac710 con 0x7f21040ae940 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f210aa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2104156e90 con 0x7f2104153760 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f2103e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f21040c43c0 0x7f2104159830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37426/0 (socket says 172.21.15.114:37426) 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f2103e00640 1 -- 172.21.15.114:0/388562386 learned_addr learned my addr 172.21.15.114:0/388562386 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f2108a00640 1 --2- 172.21.15.114:0/388562386 >> v2:172.21.15.114:3300/0 conn(0x7f21040ae940 0x7f21040aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.500+0000 7f20fb400640 1 --2- 172.21.15.114:0/388562386 >> v2:172.21.15.153:3300/0 conn(0x7f2104153760 0x7f2104159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.501+0000 7f2103400640 1 -- 172.21.15.114:0/388562386 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726483891 0 0) 0x7f2104156bb0 con 0x7f21040c43c0 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.501+0000 7f2103400640 1 -- 172.21.15.114:0/388562386 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e8003520 con 0x7f21040c43c0 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.501+0000 7f2108a00640 1 -- 172.21.15.114:0/388562386 >> v2:172.21.15.153:3300/0 conn(0x7f2104153760 msgr2=0x7f2104159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.501+0000 7f2108a00640 1 --2- 172.21.15.114:0/388562386 >> v2:172.21.15.153:3300/0 conn(0x7f2104153760 0x7f2104159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.501+0000 7f2108a00640 1 -- 172.21.15.114:0/388562386 >> v1:172.21.15.114:6789/0 conn(0x7f21040c43c0 legacy=0x7f2104159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.501+0000 7f2108a00640 1 -- 172.21.15.114:0/388562386 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21040ac960 con 0x7f21040ae940 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.502+0000 7f2108a00640 1 --2- 172.21.15.114:0/388562386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21040ae940 0x7f21040aed50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f21040722f0 tx=0x7f20fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe11389ac0f5848d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.502+0000 7f2103400640 1 -- 172.21.15.114:0/388562386 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc037070 con 0x7f21040ae940 2024-05-09T00:21:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.502+0000 7f2103400640 1 -- 172.21.15.114:0/388562386 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20fc032440 con 0x7f21040ae940 2024-05-09T00:21:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.502+0000 7f2103400640 1 -- 172.21.15.114:0/388562386 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc02ae60 con 0x7f21040ae940 2024-05-09T00:21:04.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 -- 172.21.15.114:0/388562386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21040ae940 msgr2=0x7f21040aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 --2- 172.21.15.114:0/388562386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21040ae940 0x7f21040aed50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f21040722f0 tx=0x7f20fc02a110 comp rx=0 tx=0).stop 2024-05-09T00:21:04.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 -- 172.21.15.114:0/388562386 shutdown_connections 2024-05-09T00:21:04.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 --2- 172.21.15.114:0/388562386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21040ae940 0x7f21040aed50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 --2- 172.21.15.114:0/388562386 >> v2:172.21.15.153:3300/0 conn(0x7f2104153760 0x7f2104159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 -- 172.21.15.114:0/388562386 >> 172.21.15.114:0/388562386 conn(0x7f210406c680 msgr2=0x7f210406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:04.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 -- 172.21.15.114:0/388562386 shutdown_connections 2024-05-09T00:21:04.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.503+0000 7f210aa00640 1 -- 172.21.15.114:0/388562386 wait complete. 2024-05-09T00:21:04.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.507+0000 7f210aa00640 1 Processor -- start 2024-05-09T00:21:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.507+0000 7f210aa00640 1 -- start start 2024-05-09T00:21:04.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.509+0000 7f210aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21040ae940 0x7f2104149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f210aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21040c43c0 0x7f21040c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f210aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 0x7f21041f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f210aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f21040ad3c0 con 0x7f2104153760 2024-05-09T00:21:04.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f210aa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f210415a480 con 0x7f21040c43c0 2024-05-09T00:21:04.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f210aa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21040af290 con 0x7f21040ae940 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f2108a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 0x7f21041f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f2108a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 0x7f21041f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54694/0 (socket says 172.21.15.114:54694) 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f2108a00640 1 -- 172.21.15.114:0/714615852 learned_addr learned my addr 172.21.15.114:0/714615852 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f2103e00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21040ae940 0x7f2104149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.510+0000 7f20fb400640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21040c43c0 0x7f21040c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2108a00640 1 -- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21040ae940 msgr2=0x7f2104149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2108a00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21040ae940 0x7f2104149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2108a00640 1 -- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21040c43c0 msgr2=0x7f21040c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2108a00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21040c43c0 0x7f21040c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2108a00640 1 -- 172.21.15.114:0/714615852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2104149870 con 0x7f2104153760 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2108a00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 0x7f21041f1b30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f20fc02a150 tx=0x7f20fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc037050 con 0x7f2104153760 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20fc038040 con 0x7f2104153760 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc004450 con 0x7f2104153760 2024-05-09T00:21:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.511+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21041ee380 con 0x7f2104153760 2024-05-09T00:21:04.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.512+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21041ee920 con 0x7f2104153760 2024-05-09T00:21:04.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.513+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2104153350 con 0x7f2104153760 2024-05-09T00:21:04.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.514+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20fc030710 con 0x7f2104153760 2024-05-09T00:21:04.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.516+0000 7f2100c00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f20e0076300 0x7f20e0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.516+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6837+0+0 (secure 0 0 0) 0x7f20fc0b8530 con 0x7f2104153760 2024-05-09T00:21:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.516+0000 7f2103e00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f20e0076300 0x7f20e0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.517+0000 7f2103e00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f20e0076300 0x7f20e0078810 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20f4001760 tx=0x7f20f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:04.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.520+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2104153350 con 0x7f2104153760 2024-05-09T00:21:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.741+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7fd18c1524f0 con 0x7fd18c15bd70 2024-05-09T00:21:04.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.746+0000 7fd183400640 1 -- 172.21.15.114:0/1403093111 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) ==== 151+0+0 (secure 0 0 0) 0x7fd184010040 con 0x7fd18c15bd70 2024-05-09T00:21:04.746 INFO:teuthology.orchestra.run.smithi114.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.748+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd16c076300 msgr2=0x7fd16c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.748+0000 7fd192600640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd16c076300 0x7fd16c078810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000f60 tx=0x7fd17c009040 comp rx=0 tx=0).stop 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.748+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 msgr2=0x7fd18c14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.748+0000 7fd192600640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 0x7fd18c14e3b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd18400efc0 tx=0x7fd18400c490 comp rx=0 tx=0).stop 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 shutdown_connections 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fd16c076300 0x7fd16c078810 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd18c15bd70 0x7fd18c14e3b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd18c155950 0x7fd18c15a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 --2- 172.21.15.114:0/1403093111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd18c0c0560 0x7fd18c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 >> 172.21.15.114:0/1403093111 conn(0x7fd18c0c7170 msgr2=0x7fd18c074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 shutdown_connections 2024-05-09T00:21:04.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.749+0000 7fd192600640 1 -- 172.21.15.114:0/1403093111 wait complete. 2024-05-09T00:21:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.773+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2104077430 con 0x7f2104153760 2024-05-09T00:21:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.773+0000 7f2100c00640 1 -- 172.21.15.114:0/714615852 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+4348 (secure 0 0 0) 0x7f2104149870 con 0x7f2104153760 2024-05-09T00:21:04.774 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-09T00:21:04.774 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4976,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4159586138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4159586138},{"type":"v1","addr":"172.21.15.114:6836","nonce":4159586138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3094131751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3094131751},{"type":"v1","addr":"172.21.15.153:6835","nonce":3094131751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":5784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2903422251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2903422251},{"type":"v1","addr":"172.21.15.114:6837","nonce":2903422251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":69,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:08:54.746296+0000","modified":"2024-05-09T00:21:04.743657+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T00:21:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 69 2024-05-09T00:21:04.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-05-09T00:21:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f20e0076300 msgr2=0x7f20e0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f20e0076300 0x7f20e0078810 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20f4001760 tx=0x7f20f4009040 comp rx=0 tx=0).stop 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 msgr2=0x7f21041f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 0x7f21041f1b30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f20fc02a150 tx=0x7f20fc0046c0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 shutdown_connections 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f20e0076300 0x7f20e0078810 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2104153760 0x7f21041f1b30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21040c43c0 0x7f21040c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 --2- 172.21.15.114:0/714615852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21040ae940 0x7f2104149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 >> 172.21.15.114:0/714615852 conn(0x7f210406c680 msgr2=0x7f21040c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 shutdown_connections 2024-05-09T00:21:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:04.776+0000 7f210aa00640 1 -- 172.21.15.114:0/714615852 wait complete. 2024-05-09T00:21:04.936 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-09T00:21:05.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.032+0000 7fe7c3400640 1 Processor -- start 2024-05-09T00:21:05.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.033+0000 7fe7c3400640 1 -- start start 2024-05-09T00:21:05.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.035+0000 7fe7c3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7bc073800 0x7fe7bc072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:05.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.035+0000 7fe7c3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 0x7fe7bc1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:05.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.035+0000 7fe7c3400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7bc074040 con 0x7fe7bc0c4a70 2024-05-09T00:21:05.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.035+0000 7fe7c3400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe7bc073df0 con 0x7fe7bc073800 2024-05-09T00:21:05.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.035+0000 7fe7c3400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc0c5f40 con 0x7fe7bc1585c0 2024-05-09T00:21:05.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.035+0000 7fe7c1400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 0x7fe7bc1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:05.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c1400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 0x7fe7bc1589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.114:38876/0 (socket says 172.21.15.114:38876) 2024-05-09T00:21:05.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c1400640 1 -- 172.21.15.114:0/3830438042 learned_addr learned my addr 172.21.15.114:0/3830438042 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:05.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c0a00640 1 --2- 172.21.15.114:0/3830438042 >> v2:172.21.15.153:3300/0 conn(0x7fe7bc073800 0x7fe7bc072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:05.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c1400640 1 -- 172.21.15.114:0/3830438042 >> v2:172.21.15.153:3300/0 conn(0x7fe7bc073800 msgr2=0x7fe7bc072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:05.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c1400640 1 --2- 172.21.15.114:0/3830438042 >> v2:172.21.15.153:3300/0 conn(0x7fe7bc073800 0x7fe7bc072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c1400640 1 -- 172.21.15.114:0/3830438042 >> v1:172.21.15.153:6789/0 conn(0x7fe7bc0c4a70 legacy=0x7fe7bc0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:05.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.036+0000 7fe7c1400640 1 -- 172.21.15.114:0/3830438042 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc0c58f0 con 0x7fe7bc1585c0 2024-05-09T00:21:05.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.038+0000 7fe7c1400640 1 --2- 172.21.15.114:0/3830438042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 0x7fe7bc1589d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009870 tx=0x7fe7b402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8330f196f7c86cc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:05.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.038+0000 7fe7bb400640 1 -- 172.21.15.114:0/3830438042 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4037070 con 0x7fe7bc1585c0 2024-05-09T00:21:05.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7bb400640 1 -- 172.21.15.114:0/3830438042 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe7b4032440 con 0x7fe7bc1585c0 2024-05-09T00:21:05.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7bb400640 1 -- 172.21.15.114:0/3830438042 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4032830 con 0x7fe7bc1585c0 2024-05-09T00:21:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 -- 172.21.15.114:0/3830438042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 msgr2=0x7fe7bc1589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 --2- 172.21.15.114:0/3830438042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 0x7fe7bc1589d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009870 tx=0x7fe7b402a270 comp rx=0 tx=0).stop 2024-05-09T00:21:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 -- 172.21.15.114:0/3830438042 shutdown_connections 2024-05-09T00:21:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 --2- 172.21.15.114:0/3830438042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc1585c0 0x7fe7bc1589d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 --2- 172.21.15.114:0/3830438042 >> v2:172.21.15.153:3300/0 conn(0x7fe7bc073800 0x7fe7bc072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 -- 172.21.15.114:0/3830438042 >> 172.21.15.114:0/3830438042 conn(0x7fe7bc06c680 msgr2=0x7fe7bc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:05.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.039+0000 7fe7c3400640 1 -- 172.21.15.114:0/3830438042 shutdown_connections 2024-05-09T00:21:05.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.040+0000 7fe7c3400640 1 -- 172.21.15.114:0/3830438042 wait complete. 2024-05-09T00:21:05.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.042+0000 7fe7c3400640 1 Processor -- start 2024-05-09T00:21:05.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.042+0000 7fe7c3400640 1 -- start start 2024-05-09T00:21:05.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.043+0000 7fe7c3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc073800 0x7fe7bc149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.043+0000 7fe7c3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7bc0c4a70 0x7fe7bc15dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.043+0000 7fe7c3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 0x7fe7bc144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.043+0000 7fe7c3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc074320 con 0x7fe7bc1585c0 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.043+0000 7fe7c3400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc0c4e80 con 0x7fe7bc0c4a70 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.043+0000 7fe7c3400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc1498d0 con 0x7fe7bc073800 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 0x7fe7bc144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 0x7fe7bc144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54702/0 (socket says 172.21.15.114:54702) 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 -- 172.21.15.114:0/925735585 learned_addr learned my addr 172.21.15.114:0/925735585 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c0a00640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc073800 0x7fe7bc149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7bbe00640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7bc0c4a70 0x7fe7bc15dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 -- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc073800 msgr2=0x7fe7bc149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc073800 0x7fe7bc149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 -- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7bc0c4a70 msgr2=0x7fe7bc15dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7bc0c4a70 0x7fe7bc15dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.044+0000 7fe7c1400640 1 -- 172.21.15.114:0/925735585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc160b90 con 0x7fe7bc1585c0 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.045+0000 7fe7c1400640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 0x7fe7bc144a00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe7b402a2b0 tx=0x7fe7b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.045+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4041020 con 0x7fe7bc1585c0 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.045+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe7b4030660 con 0x7fe7bc1585c0 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.045+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4037040 con 0x7fe7bc1585c0 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.045+0000 7fe7c3400640 1 -- 172.21.15.114:0/925735585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7bc1603b0 con 0x7fe7bc1585c0 2024-05-09T00:21:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.045+0000 7fe7c3400640 1 -- 172.21.15.114:0/925735585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7bc1608b0 con 0x7fe7bc1585c0 2024-05-09T00:21:05.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.046+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7bc155ac0 con 0x7fe7bc1585c0 2024-05-09T00:21:05.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.047+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe7b4044020 con 0x7fe7bc1585c0 2024-05-09T00:21:05.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.049+0000 7fe7b8c00640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe7980762d0 0x7fe7980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:05.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.049+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6923+0+0 (secure 0 0 0) 0x7fe7b40b82d0 con 0x7fe7bc1585c0 2024-05-09T00:21:05.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.049+0000 7fe7c0a00640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe7980762d0 0x7fe7980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:05.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.050+0000 7fe7c0a00640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe7980762d0 0x7fe7980787e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009a30 tx=0x7fe7a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:05.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.054+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7bc155ac0 con 0x7fe7bc1585c0 2024-05-09T00:21:05.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.282+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7fe7bc077430 con 0x7fe7bc1585c0 2024-05-09T00:21:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.749+0000 7fe7b8c00640 1 -- 172.21.15.114:0/925735585 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v70) ==== 99+0+0 (secure 0 0 0) 0x7fe7b404b030 con 0x7fe7bc1585c0 2024-05-09T00:21:05.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe7980762d0 msgr2=0x7fe7980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe7980762d0 0x7fe7980787e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009a30 tx=0x7fe7a4008040 comp rx=0 tx=0).stop 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 msgr2=0x7fe7bc144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 0x7fe7bc144a00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe7b402a2b0 tx=0x7fe7b40046c0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 shutdown_connections 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7fe7980762d0 0x7fe7980787e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7bc1585c0 0x7fe7bc144a00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7bc0c4a70 0x7fe7bc15dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 --2- 172.21.15.114:0/925735585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7bc073800 0x7fe7bc149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:05.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.755+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 >> 172.21.15.114:0/925735585 conn(0x7fe7bc06c680 msgr2=0x7fe7bc0af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:05.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.756+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 shutdown_connections 2024-05-09T00:21:05.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:05.756+0000 7fe7b2000640 1 -- 172.21.15.114:0/925735585 wait complete. 2024-05-09T00:21:05.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-05-09T00:21:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.068+0000 7f73b1c00640 1 Processor -- start 2024-05-09T00:21:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.069+0000 7f73b1c00640 1 -- start start 2024-05-09T00:21:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73b1c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73ac1504a0 0x7f73ac13ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73b1c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f73ac156190 0x7f73ac1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73b1c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac0aea70 con 0x7f73ac13f180 2024-05-09T00:21:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73b1c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0af3a0 con 0x7f73ac156190 2024-05-09T00:21:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73b1c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0aed50 con 0x7f73ac1504a0 2024-05-09T00:21:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73ab400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f73ac13f180 0x7f73ac0c4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37428/0 (socket says 172.21.15.114:37428) 2024-05-09T00:21:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73ab400640 1 -- 172.21.15.114:0/3917803681 learned_addr learned my addr 172.21.15.114:0/3917803681 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-09T00:21:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73b1200640 1 --2- 172.21.15.114:0/3917803681 >> v2:172.21.15.114:3300/0 conn(0x7f73ac156190 0x7f73ac1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73abe00640 1 --2- 172.21.15.114:0/3917803681 >> v2:172.21.15.153:3300/0 conn(0x7f73ac1504a0 0x7f73ac13ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.071+0000 7f73aaa00640 1 -- 172.21.15.114:0/3917803681 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657478647 0 0) 0x7f73ac0aea70 con 0x7f73ac13f180 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.072+0000 7f73aaa00640 1 -- 172.21.15.114:0/3917803681 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7390003520 con 0x7f73ac13f180 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.072+0000 7f73b1200640 1 -- 172.21.15.114:0/3917803681 >> v2:172.21.15.153:3300/0 conn(0x7f73ac1504a0 msgr2=0x7f73ac13ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.072+0000 7f73b1200640 1 --2- 172.21.15.114:0/3917803681 >> v2:172.21.15.153:3300/0 conn(0x7f73ac1504a0 0x7f73ac13ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.072+0000 7f73b1200640 1 -- 172.21.15.114:0/3917803681 >> v1:172.21.15.114:6789/0 conn(0x7f73ac13f180 legacy=0x7f73ac0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.072+0000 7f73b1200640 1 -- 172.21.15.114:0/3917803681 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0af030 con 0x7f73ac156190 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.073+0000 7f73b1200640 1 --2- 172.21.15.114:0/3917803681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac156190 0x7f73ac1565a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0ca110 tx=0x7f73a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c4299db605ffd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.073+0000 7f73aaa00640 1 -- 172.21.15.114:0/3917803681 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4037070 con 0x7f73ac156190 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.073+0000 7f73aaa00640 1 -- 172.21.15.114:0/3917803681 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f73a4032440 con 0x7f73ac156190 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.073+0000 7f73aaa00640 1 -- 172.21.15.114:0/3917803681 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4032830 con 0x7f73ac156190 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 -- 172.21.15.114:0/3917803681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac156190 msgr2=0x7f73ac1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 --2- 172.21.15.114:0/3917803681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac156190 0x7f73ac1565a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0ca110 tx=0x7f73a402a1a0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 -- 172.21.15.114:0/3917803681 shutdown_connections 2024-05-09T00:21:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 --2- 172.21.15.114:0/3917803681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac156190 0x7f73ac1565a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 --2- 172.21.15.114:0/3917803681 >> v2:172.21.15.153:3300/0 conn(0x7f73ac1504a0 0x7f73ac13ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 -- 172.21.15.114:0/3917803681 >> 172.21.15.114:0/3917803681 conn(0x7f73ac0c5bd0 msgr2=0x7f73ac0c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 -- 172.21.15.114:0/3917803681 shutdown_connections 2024-05-09T00:21:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.074+0000 7f73b1c00640 1 -- 172.21.15.114:0/3917803681 wait complete. 2024-05-09T00:21:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.076+0000 7f73b1c00640 1 Processor -- start 2024-05-09T00:21:06.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.076+0000 7f73b1c00640 1 -- start start 2024-05-09T00:21:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73b1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 0x7f73ac152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73b1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac1504a0 0x7f73ac137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73b1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73ac156190 0x7f73ac138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73b1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0c51f0 con 0x7f73ac13f180 2024-05-09T00:21:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73b1c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac074460 con 0x7f73ac1504a0 2024-05-09T00:21:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73b1c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac0c5370 con 0x7f73ac156190 2024-05-09T00:21:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 0x7f73ac152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 0x7f73ac152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54734/0 (socket says 172.21.15.114:54734) 2024-05-09T00:21:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.078+0000 7f73abe00640 1 -- 172.21.15.114:0/4271684016 learned_addr learned my addr 172.21.15.114:0/4271684016 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73b1200640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73ac156190 0x7f73ac138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73ab400640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac1504a0 0x7f73ac137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73abe00640 1 -- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73ac156190 msgr2=0x7f73ac138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73abe00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73ac156190 0x7f73ac138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73abe00640 1 -- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac1504a0 msgr2=0x7f73ac137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73abe00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac1504a0 0x7f73ac137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73abe00640 1 -- 172.21.15.114:0/4271684016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac1388a0 con 0x7f73ac13f180 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73abe00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 0x7f73ac152140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f739400d600 tx=0x7f739400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394004240 con 0x7f73ac13f180 2024-05-09T00:21:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f73940043e0 con 0x7f73ac13f180 2024-05-09T00:21:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac13a8f0 con 0x7f73ac13f180 2024-05-09T00:21:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394003850 con 0x7f73ac13f180 2024-05-09T00:21:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.079+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac151660 con 0x7f73ac13f180 2024-05-09T00:21:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.080+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac078430 con 0x7f73ac13f180 2024-05-09T00:21:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.082+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f73940039f0 con 0x7f73ac13f180 2024-05-09T00:21:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.083+0000 7f73a3e00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73880762d0 0x7f73880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.083+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6923+0+0 (secure 0 0 0) 0x7f7394097e50 con 0x7f73ac13f180 2024-05-09T00:21:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.083+0000 7f73ab400640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73880762d0 0x7f73880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.084+0000 7f73ab400640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73880762d0 0x7f73880787e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f739c0015a0 tx=0x7f739c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:06.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.088+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7394061250 con 0x7f73ac13f180 2024-05-09T00:21:06.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.298+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73ac0accc0 con 0x7f73ac13f180 2024-05-09T00:21:06.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.754+0000 7f73a3e00640 1 -- 172.21.15.114:0/4271684016 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v43) ==== 166+0+0 (secure 0 0 0) 0x7f7394060b50 con 0x7f73ac13f180 2024-05-09T00:21:06.755 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'b_metadata' removed 2024-05-09T00:21:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.759+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73880762d0 msgr2=0x7f73880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.759+0000 7f73b1c00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73880762d0 0x7f73880787e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f739c0015a0 tx=0x7f739c009040 comp rx=0 tx=0).stop 2024-05-09T00:21:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.759+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 msgr2=0x7f73ac152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.759+0000 7f73b1c00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 0x7f73ac152140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f739400d600 tx=0x7f739400dac0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 shutdown_connections 2024-05-09T00:21:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f73880762d0 0x7f73880787e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73ac156190 0x7f73ac138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac1504a0 0x7f73ac137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 --2- 172.21.15.114:0/4271684016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73ac13f180 0x7f73ac152140 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 >> 172.21.15.114:0/4271684016 conn(0x7f73ac0c5bd0 msgr2=0x7f73ac13ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.761+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 shutdown_connections 2024-05-09T00:21:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:06.762+0000 7f73b1c00640 1 -- 172.21.15.114:0/4271684016 wait complete. 2024-05-09T00:21:06.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-05-09T00:21:07.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.066+0000 7f50a1a00640 1 Processor -- start 2024-05-09T00:21:07.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.066+0000 7f50a1a00640 1 -- start start 2024-05-09T00:21:07.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f50a1a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f509c074510 0x7f509c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:07.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f50a1a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f509c070540 con 0x7f509c0722f0 2024-05-09T00:21:07.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f50a1a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f509c074920 con 0x7f509c072700 2024-05-09T00:21:07.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f50a1a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f509c070260 con 0x7f509c074510 2024-05-09T00:21:07.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f509aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f509c074510 0x7f509c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:07.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f509aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f509c074510 0x7f509c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54744/0 (socket says 172.21.15.114:54744) 2024-05-09T00:21:07.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f5093e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f509c0722f0 0x7f509c1584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37436/0 (socket says 172.21.15.114:37436) 2024-05-09T00:21:07.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.068+0000 7f509aa00640 1 -- 172.21.15.114:0/2355061624 learned_addr learned my addr 172.21.15.114:0/2355061624 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:07.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.069+0000 7f509aa00640 1 -- 172.21.15.114:0/2355061624 >> v1:172.21.15.153:6789/0 conn(0x7f509c072700 legacy=0x7f509c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:21:07.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.069+0000 7f509aa00640 1 -- 172.21.15.114:0/2355061624 >> v1:172.21.15.114:6789/0 conn(0x7f509c0722f0 legacy=0x7f509c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:07.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.069+0000 7f509aa00640 1 -- 172.21.15.114:0/2355061624 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c06f740 con 0x7f509c074510 2024-05-09T00:21:07.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.069+0000 7f509a000640 1 -- 172.21.15.114:0/2355061624 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718806902 0 0) 0x7f509c070540 con 0x7f509c0722f0 2024-05-09T00:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.070+0000 7f509aa00640 1 --2- 172.21.15.114:0/2355061624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c074510 0x7f509c06e3c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f508c009870 tx=0x7f508c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0b1b76d64548c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.070+0000 7f509a000640 1 -- 172.21.15.114:0/2355061624 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c037070 con 0x7f509c074510 2024-05-09T00:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.070+0000 7f509a000640 1 -- 172.21.15.114:0/2355061624 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f508c032440 con 0x7f509c074510 2024-05-09T00:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.070+0000 7f509a000640 1 -- 172.21.15.114:0/2355061624 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c032830 con 0x7f509c074510 2024-05-09T00:21:07.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 -- 172.21.15.114:0/2355061624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c074510 msgr2=0x7f509c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:07.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 --2- 172.21.15.114:0/2355061624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c074510 0x7f509c06e3c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f508c009870 tx=0x7f508c02a270 comp rx=0 tx=0).stop 2024-05-09T00:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 -- 172.21.15.114:0/2355061624 shutdown_connections 2024-05-09T00:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 --2- 172.21.15.114:0/2355061624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c074510 0x7f509c06e3c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 -- 172.21.15.114:0/2355061624 >> 172.21.15.114:0/2355061624 conn(0x7f509c06ca70 msgr2=0x7f509c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 -- 172.21.15.114:0/2355061624 shutdown_connections 2024-05-09T00:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.071+0000 7f50a1a00640 1 -- 172.21.15.114:0/2355061624 wait complete. 2024-05-09T00:21:07.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.073+0000 7f50a1a00640 1 Processor -- start 2024-05-09T00:21:07.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.074+0000 7f50a1a00640 1 -- start start 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f50a1a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f509c0722f0 0x7f509c0c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f50a1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 0x7f509c162470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f50a1a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f509c074510 0x7f509c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f50a1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f509c06fec0 con 0x7f509c072700 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f50a1a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f509c159110 con 0x7f509c0722f0 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f50a1a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f509c070040 con 0x7f509c074510 2024-05-09T00:21:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f5093e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 0x7f509c162470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f5093e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 0x7f509c162470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54752/0 (socket says 172.21.15.114:54752) 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.075+0000 7f5093e00640 1 -- 172.21.15.114:0/1841678468 learned_addr learned my addr 172.21.15.114:0/1841678468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f509aa00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f509c0722f0 0x7f509c0c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5093e00640 1 -- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f509c074510 msgr2=0x7f509c14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5093e00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f509c074510 0x7f509c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5093e00640 1 -- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f509c0722f0 msgr2=0x7f509c0c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5093e00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f509c0722f0 0x7f509c0c2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5093e00640 1 -- 172.21.15.114:0/1841678468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c1ee3e0 con 0x7f509c072700 2024-05-09T00:21:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5093e00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 0x7f509c162470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f508400c410 tx=0x7f508400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:07.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50840074e0 con 0x7f509c072700 2024-05-09T00:21:07.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f50840047e0 con 0x7f509c072700 2024-05-09T00:21:07.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084004bf0 con 0x7f509c072700 2024-05-09T00:21:07.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.076+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c1ee8e0 con 0x7f509c072700 2024-05-09T00:21:07.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.077+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1eeea0 con 0x7f509c072700 2024-05-09T00:21:07.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.077+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509c077430 con 0x7f509c072700 2024-05-09T00:21:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.079+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5084011070 con 0x7f509c072700 2024-05-09T00:21:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.080+0000 7f5092a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f50780762d0 0x7f50780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:21:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.080+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6495+0+0 (secure 0 0 0) 0x7f50840976a0 con 0x7f509c072700 2024-05-09T00:21:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.080+0000 7f509aa00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f50780762d0 0x7f50780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:21:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.081+0000 7f509aa00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f50780762d0 0x7f50780787e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f508c034000 tx=0x7f508c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:21:07.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.085+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5084060bc0 con 0x7f509c072700 2024-05-09T00:21:07.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.291+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f509c1ee630 con 0x7f509c072700 2024-05-09T00:21:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.767+0000 7f5092a00640 1 -- 172.21.15.114:0/1841678468 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v44) ==== 154+0+0 (secure 0 0 0) 0x7f50840604c0 con 0x7f509c072700 2024-05-09T00:21:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'b_data' removed 2024-05-09T00:21:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.773+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f50780762d0 msgr2=0x7f50780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.773+0000 7f50a1a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f50780762d0 0x7f50780787e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f508c034000 tx=0x7f508c02e000 comp rx=0 tx=0).stop 2024-05-09T00:21:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.773+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 msgr2=0x7f509c162470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.773+0000 7f50a1a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 0x7f509c162470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f508400c410 tx=0x7f508400c8d0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.773+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 shutdown_connections 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.773+0000 7f50a1a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:6832/991477833,v1:172.21.15.114:6833/991477833] conn(0x7f50780762d0 0x7f50780787e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.774+0000 7f50a1a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f509c074510 0x7f509c14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.774+0000 7f50a1a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c072700 0x7f509c162470 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.774+0000 7f50a1a00640 1 --2- 172.21.15.114:0/1841678468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f509c0722f0 0x7f509c0c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:21:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.774+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 >> 172.21.15.114:0/1841678468 conn(0x7f509c06ca70 msgr2=0x7f509c072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:21:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.776+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 shutdown_connections 2024-05-09T00:21:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-09T00:21:07.776+0000 7f50a1a00640 1 -- 172.21.15.114:0/1841678468 wait complete. 2024-05-09T00:21:07.822 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T00:21:07.823 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T00:21:07.823 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:07.865 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T00:21:07.865 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T00:21:07.865 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:07.907 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T00:21:07.907 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T00:21:07.907 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:07.949 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T00:21:07.949 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T00:21:07.949 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:07.983 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T00:21:07.984 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T00:21:07.984 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T00:21:07.984 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:14.086 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T00:21:14.087 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T00:21:14.087 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:18.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:21:18.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:21:20.189 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T00:21:20.189 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T00:21:20.190 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-09T00:21:26.291 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T00:21:26.292 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T00:21:26.292 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:27.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-09T00:21:27.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-09T00:21:32.394 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T00:21:32.394 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T00:21:32.394 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:33.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2024-05-09T00:21:38.496 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T00:21:38.497 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T00:21:38.497 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:39.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-09T00:21:39.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-09T00:21:44.599 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T00:21:44.599 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T00:21:44.599 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:44.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-09T00:21:44.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-09T00:21:49.089 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:21:49.098 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:21:50.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-09T00:21:50.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-09T00:21:50.702 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T00:21:50.702 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T00:21:50.702 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:55.868 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-09T00:21:55.868 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-09T00:21:56.804 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T00:21:56.804 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T00:21:56.805 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T00:21:56.805 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:21:56.901 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T00:21:56.901 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T00:21:56.901 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:22:01.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-09T00:22:01.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-09T00:22:03.003 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T00:22:03.003 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T00:22:03.004 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T00:22:03.004 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:22:03.078 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T00:22:03.078 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T00:22:03.078 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:22:03.143 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T00:22:03.144 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T00:22:03.144 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T00:22:03.207 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T00:22:03.207 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T00:22:03.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-09T00:22:03.353 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:22:03.353 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T00:22:03.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:22:03.562 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T00:22:03.739 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:22:03.740 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T00:22:03.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:22:03.944 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T00:22:04.127 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:22:04.127 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T00:22:04.428 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:22:04.428 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T00:22:04.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:22:04.618 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T00:22:04.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:22:04.821 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T00:22:04.995 INFO:tasks.ceph:Archiving mon data... 2024-05-09T00:22:04.996 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/data/mon.a.tgz 2024-05-09T00:22:04.997 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-05-09T00:22:05.062 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.jUsHpGG1fv 2024-05-09T00:22:05.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jUsHpGG1fv 2024-05-09T00:22:05.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.jUsHpGG1fv 2024-05-09T00:22:05.398 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.jUsHpGG1fv is 410KB 2024-05-09T00:22:05.509 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.jUsHpGG1fv 2024-05-09T00:22:05.564 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/data/mon.b.tgz 2024-05-09T00:22:05.564 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-05-09T00:22:05.618 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.bo8jtB6cTq 2024-05-09T00:22:05.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.bo8jtB6cTq 2024-05-09T00:22:05.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.bo8jtB6cTq 2024-05-09T00:22:05.920 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.bo8jtB6cTq is 415KB 2024-05-09T00:22:06.020 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.bo8jtB6cTq 2024-05-09T00:22:06.071 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/data/mon.c.tgz 2024-05-09T00:22:06.071 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-05-09T00:22:06.161 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.MfSihU0QS6 2024-05-09T00:22:06.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MfSihU0QS6 2024-05-09T00:22:06.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-09T00:22:06.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.MfSihU0QS6 2024-05-09T00:22:06.432 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.MfSihU0QS6 is 415KB 2024-05-09T00:22:06.535 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.MfSihU0QS6 2024-05-09T00:22:06.591 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T00:22:06.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T00:22:06.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T00:22:06.743 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T00:22:06.801 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T00:22:06.802 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T00:22:06.803 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/remote/smithi114/crash 2024-05-09T00:22:06.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T00:22:06.889 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/remote/smithi153/crash 2024-05-09T00:22:06.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T00:22:06.978 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T00:22:06.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:22:06.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T00:22:07.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T00:22:07.223 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T00:22:07.312 INFO:tasks.ceph:Compressing logs... 2024-05-09T00:22:07.312 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T00:22:07.320 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T00:22:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55119.log 2024-05-09T00:22:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53996.log 2024-05-09T00:22:07.420 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40453.log 2024-05-09T00:22:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55119.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55119.log.gz 2024-05-09T00:22:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50521.log 2024-05-09T00:22:07.422 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35473.log 2024-05-09T00:22:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53996.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53996.log.gz 2024-05-09T00:22:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41819.log 2024-05-09T00:22:07.423 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.40453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40453.log.gz 2024-05-09T00:22:07.423 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35182.log 2024-05-09T00:22:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2024-05-09T00:22:07.424 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50521.log.gz 2024-05-09T00:22:07.424 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35273.log 2024-05-09T00:22:07.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35182.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35473.log.gz 2024-05-09T00:22:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49664.log 2024-05-09T00:22:07.426 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35182.log.gz 2024-05-09T00:22:07.426 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T00:22:07.426 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35273.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T00:22:07.427 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41815.log 2024-05-09T00:22:07.427 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35273.log.gz 2024-05-09T00:22:07.427 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T00:22:07.428 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T00:22:07.428 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49664.log: gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49664.log.gz /var/log/ceph/ceph-client.admin.50156.log 2024-05-09T00:22:07.429 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-09T00:22:07.429 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53094.log 2024-05-09T00:22:07.430 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T00:22:07.430 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T00:22:07.431 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55112.log 2024-05-09T00:22:07.431 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50156.log.gz 2024-05-09T00:22:07.431 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T00:22:07.432 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53094.log.gz 2024-05-09T00:22:07.432 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53197.log 2024-05-09T00:22:07.433 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35393.log 2024-05-09T00:22:07.433 INFO:teuthology.orchestra.run.smithi153.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T00:22:07.433 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T00:22:07.434 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-05-09T00:22:07.434 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55112.log.gz 2024-05-09T00:22:07.435 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53197.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53197.log.gz 2024-05-09T00:22:07.435 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-05-09T00:22:07.435 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44202.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41819.log.gz 2024-05-09T00:22:07.435 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52609.log 2024-05-09T00:22:07.436 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2024-05-09T00:22:07.437 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35393.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T00:22:07.437 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35393.log.gz 2024-05-09T00:22:07.437 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35313.log 2024-05-09T00:22:07.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2024-05-09T00:22:07.438 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-05-09T00:22:07.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52609.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52609.log.gz 2024-05-09T00:22:07.438 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2024-05-09T00:22:07.439 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T00:22:07.439 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz 2024-05-09T00:22:07.439 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48455.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz -5 2024-05-09T00:22:07.439 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51726.log 2024-05-09T00:22:07.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48371.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2024-05-09T00:22:07.440 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51272.log 2024-05-09T00:22:07.440 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35313.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35313.log.gz 2024-05-09T00:22:07.441 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51680.log 2024-05-09T00:22:07.442 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51272.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51726.log.gz 2024-05-09T00:22:07.442 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41489.log 2024-05-09T00:22:07.442 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51272.log.gz 2024-05-09T00:22:07.442 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40472.log 2024-05-09T00:22:07.443 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-05-09T00:22:07.443 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51680.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T00:22:07.443 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51680.log.gz 2024-05-09T00:22:07.444 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35226.log 2024-05-09T00:22:07.444 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2024-05-09T00:22:07.444 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41489.log.gz 2024-05-09T00:22:07.445 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-05-09T00:22:07.445 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.40472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35433.log 2024-05-09T00:22:07.445 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40472.log.gz 2024-05-09T00:22:07.446 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50795.log 2024-05-09T00:22:07.447 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-09T00:22:07.447 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40062.log 2024-05-09T00:22:07.448 INFO:teuthology.orchestra.run.smithi114.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T00:22:07.448 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-05-09T00:22:07.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2024-05-09T00:22:07.449 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50795.log.gz 2024-05-09T00:22:07.449 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35226.log: 87.4% 94.4%/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T00:22:07.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49268.log 2024-05-09T00:22:07.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42027.log 2024-05-09T00:22:07.451 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54416.log 2024-05-09T00:22:07.451 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49268.log.gz 2024-05-09T00:22:07.452 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35226.log.gz 2024-05-09T00:22:07.452 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T00:22:07.452 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35433.log.gz 2024-05-09T00:22:07.452 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35353.log 2024-05-09T00:22:07.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2024-05-09T00:22:07.453 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz 2024-05-09T00:22:07.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54416.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T00:22:07.453 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54416.log.gz 2024-05-09T00:22:07.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-05-09T00:22:07.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43721.log 2024-05-09T00:22:07.456 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42489.log 2024-05-09T00:22:07.456 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-05-09T00:22:07.457 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.35353.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35353.log.gz 2024-05-09T00:22:07.457 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-05-09T00:22:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2024-05-09T00:22:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2024-05-09T00:22:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48077.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-05-09T00:22:07.460 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50094.log 2024-05-09T00:22:07.460 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-05-09T00:22:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52455.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42027.log.gz 2024-05-09T00:22:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41271.log 2024-05-09T00:22:07.461 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2024-05-09T00:22:07.462 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50094.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.50094.log.gz 2024-05-09T00:22:07.462 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53870.log 2024-05-09T00:22:07.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53786.log 2024-05-09T00:22:07.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-05-09T00:22:07.464 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53870.log.gz 2024-05-09T00:22:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 89.0% 2024-05-09T00:22:07.465 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53786.log.gz 2024-05-09T00:22:07.465 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-05-09T00:22:07.466 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43721.log.gz 2024-05-09T00:22:07.466 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41271.log.gz 2024-05-09T00:22:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51315.log 2024-05-09T00:22:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54290.log 2024-05-09T00:22:07.467 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz 2024-05-09T00:22:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2024-05-09T00:22:07.468 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51315.log.gz 2024-05-09T00:22:07.469 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48775.log 2024-05-09T00:22:07.469 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54290.log.gz 2024-05-09T00:22:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42999.log 2024-05-09T00:22:07.470 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2024-05-09T00:22:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48775.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40062.log.gz 2024-05-09T00:22:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51417.log 2024-05-09T00:22:07.471 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48775.log.gz 2024-05-09T00:22:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42999.log.gz 2024-05-09T00:22:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51867.log 2024-05-09T00:22:07.473 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2024-05-09T00:22:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51417.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T00:22:07.473 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51417.log.gz 2024-05-09T00:22:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2024-05-09T00:22:07.474 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51867.log.gz 2024-05-09T00:22:07.475 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50563.log 2024-05-09T00:22:07.476 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49312.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42489.log.gz 2024-05-09T00:22:07.476 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2024-05-09T00:22:07.476 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2024-05-09T00:22:07.477 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43342.log 2024-05-09T00:22:07.477 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50563.log.gz 2024-05-09T00:22:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51501.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T00:22:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51638.log 2024-05-09T00:22:07.478 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz 2024-05-09T00:22:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52095.log 2024-05-09T00:22:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50240.log 2024-05-09T00:22:07.480 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51638.log.gz 2024-05-09T00:22:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43174.log 2024-05-09T00:22:07.481 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52095.log.gz 2024-05-09T00:22:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-05-09T00:22:07.482 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50240.log.gz 2024-05-09T00:22:07.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2024-05-09T00:22:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40158.log 2024-05-09T00:22:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41831.log 2024-05-09T00:22:07.485 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2024-05-09T00:22:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52922.log 2024-05-09T00:22:07.486 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43342.log.gz 2024-05-09T00:22:07.486 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40158.log.gz 2024-05-09T00:22:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49748.log 2024-05-09T00:22:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-05-09T00:22:07.488 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52922.log.gz 2024-05-09T00:22:07.488 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41831.log.gz 2024-05-09T00:22:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50711.log 2024-05-09T00:22:07.489 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49748.log.gz 2024-05-09T00:22:07.489 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-05-09T00:22:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50837.log 2024-05-09T00:22:07.490 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9%/var/log/ceph/ceph-client.admin.50711.log: -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-05-09T00:22:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2024-05-09T00:22:07.491 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50711.log.gz 2024-05-09T00:22:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50837.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.43468.log -- replaced with /var/log/ceph/ceph-client.admin.50837.log.gz 2024-05-09T00:22:07.492 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-09T00:22:07.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2024-05-09T00:22:07.493 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-05-09T00:22:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43468.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T00:22:07.494 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-05-09T00:22:07.495 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2024-05-09T00:22:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45463.log 2024-05-09T00:22:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-05-09T00:22:07.497 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49354.log 2024-05-09T00:22:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2024-05-09T00:22:07.498 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-05-09T00:22:07.499 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-05-09T00:22:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48287.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49354.log.gz 2024-05-09T00:22:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 88.1% --verbose -- /var/log/ceph/ceph-client.admin.40637.log -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-05-09T00:22:07.500 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-09T00:22:07.500 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2024-05-09T00:22:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54164.log 2024-05-09T00:22:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52694.log 2024-05-09T00:22:07.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54164.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43174.log.gz 2024-05-09T00:22:07.503 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-05-09T00:22:07.503 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54164.log.gz 2024-05-09T00:22:07.503 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-05-09T00:22:07.504 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-05-09T00:22:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41019.log 2024-05-09T00:22:07.504 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52694.log.gz 2024-05-09T00:22:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51210.log 2024-05-09T00:22:07.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50609.log 2024-05-09T00:22:07.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2024-05-09T00:22:07.506 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51210.log.gz 2024-05-09T00:22:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52778.log 2024-05-09T00:22:07.507 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50609.log.gz 2024-05-09T00:22:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43258.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-09T00:22:07.508 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz/var/log/ceph/ceph-client.admin.52778.log: 2024-05-09T00:22:07.508 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44017.log 2024-05-09T00:22:07.509 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2024-05-09T00:22:07.509 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52778.log.gz 2024-05-09T00:22:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44796.log 2024-05-09T00:22:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49396.log 2024-05-09T00:22:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50408.log 2024-05-09T00:22:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49927.log 2024-05-09T00:22:07.512 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49396.log.gz 2024-05-09T00:22:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51459.log 2024-05-09T00:22:07.513 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50408.log.gz 2024-05-09T00:22:07.513 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40637.log.gz 2024-05-09T00:22:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39825.log 2024-05-09T00:22:07.514 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41019.log.gz 2024-05-09T00:22:07.515 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44017.log.gz 2024-05-09T00:22:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51459.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44796.log.gz 2024-05-09T00:22:07.515 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49927.log.gz 2024-05-09T00:22:07.515 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51459.log.gz 2024-05-09T00:22:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2024-05-09T00:22:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54889.log 2024-05-09T00:22:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53503.log 2024-05-09T00:22:07.517 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2024-05-09T00:22:07.517 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39825.log.gz 2024-05-09T00:22:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54889.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54889.log.gz 2024-05-09T00:22:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T00:22:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53503.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 88.5% 2024-05-09T00:22:07.522 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53503.log.gz 2024-05-09T00:22:07.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28937.log 2024-05-09T00:22:07.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48203.log 2024-05-09T00:22:07.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.tmp-client.admin.28937.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28937.log.gz 2024-05-09T00:22:07.524 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51969.log 2024-05-09T00:22:07.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50651.log 2024-05-09T00:22:07.524 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48203.log.gz 2024-05-09T00:22:07.525 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45463.log.gz 2024-05-09T00:22:07.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2024-05-09T00:22:07.525 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51969.log.gz 2024-05-09T00:22:07.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2024-05-09T00:22:07.526 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50651.log.gz 2024-05-09T00:22:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48245.log 2024-05-09T00:22:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52377.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T00:22:07.526 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2024-05-09T00:22:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50879.log 2024-05-09T00:22:07.527 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48245.log.gz 2024-05-09T00:22:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48965.log 2024-05-09T00:22:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49790.log 2024-05-09T00:22:07.529 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50879.log.gz 2024-05-09T00:22:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50753.log 2024-05-09T00:22:07.529 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48965.log.gz 2024-05-09T00:22:07.530 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53010.log 2024-05-09T00:22:07.530 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49790.log.gz 2024-05-09T00:22:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2024-05-09T00:22:07.531 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50753.log.gz 2024-05-09T00:22:07.532 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-05-09T00:22:07.532 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53010.log.gz 2024-05-09T00:22:07.533 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2024-05-09T00:22:07.533 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43384.log 2024-05-09T00:22:07.534 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-05-09T00:22:07.534 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41145.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-05-09T00:22:07.534 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42237.log 2024-05-09T00:22:07.535 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52011.log 2024-05-09T00:22:07.536 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42237.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2024-05-09T00:22:07.536 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44530.log 2024-05-09T00:22:07.536 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2024-05-09T00:22:07.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41829.log 2024-05-09T00:22:07.537 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52011.log.gz 2024-05-09T00:22:07.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54206.log 2024-05-09T00:22:07.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2024-05-09T00:22:07.539 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-05-09T00:22:07.539 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54206.log.gz 2024-05-09T00:22:07.540 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2024-05-09T00:22:07.541 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41829.log.gz 2024-05-09T00:22:07.541 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53425.log 2024-05-09T00:22:07.541 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55225.log 2024-05-09T00:22:07.542 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2024-05-09T00:22:07.542 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42321.log 2024-05-09T00:22:07.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55225.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53425.log.gz 2024-05-09T00:22:07.544 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52964.log 2024-05-09T00:22:07.544 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55225.log.gz 2024-05-09T00:22:07.546 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2024-05-09T00:22:07.546 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52820.log 2024-05-09T00:22:07.547 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52964.log.gz 2024-05-09T00:22:07.547 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2024-05-09T00:22:07.547 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2024-05-09T00:22:07.547 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2024-05-09T00:22:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-05-09T00:22:07.548 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52820.log.gz 2024-05-09T00:22:07.548 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-05-09T00:22:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44222.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44530.log.gz 2024-05-09T00:22:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2024-05-09T00:22:07.549 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44572.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2024-05-09T00:22:07.549 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2024-05-09T00:22:07.549 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-05-09T00:22:07.550 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-05-09T00:22:07.551 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-05-09T00:22:07.552 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2024-05-09T00:22:07.552 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2024-05-09T00:22:07.552 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44079.log 2024-05-09T00:22:07.553 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43594.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T00:22:07.553 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-05-09T00:22:07.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48923.log 2024-05-09T00:22:07.554 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gz 2024-05-09T00:22:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44918.log 2024-05-09T00:22:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48923.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44079.log.gz 2024-05-09T00:22:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41495.log 2024-05-09T00:22:07.556 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48923.log.gz 2024-05-09T00:22:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48035.log 2024-05-09T00:22:07.558 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-05-09T00:22:07.558 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41493.log 2024-05-09T00:22:07.559 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44918.log.gz 2024-05-09T00:22:07.559 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48035.log.gz 2024-05-09T00:22:07.559 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55015.log 2024-05-09T00:22:07.560 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41493.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41495.log.gz 2024-05-09T00:22:07.560 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49540.log 2024-05-09T00:22:07.561 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2024-05-09T00:22:07.561 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55015.log.gz 2024-05-09T00:22:07.562 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54744.log 2024-05-09T00:22:07.562 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49540.log.gz 2024-05-09T00:22:07.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53954.log 2024-05-09T00:22:07.563 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-05-09T00:22:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2024-05-09T00:22:07.564 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54744.log.gz 2024-05-09T00:22:07.565 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41493.log.gz 2024-05-09T00:22:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-05-09T00:22:07.566 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53954.log.gz 2024-05-09T00:22:07.566 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51357.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2024-05-09T00:22:07.566 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2024-05-09T00:22:07.567 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52461.log 2024-05-09T00:22:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51909.log 2024-05-09T00:22:07.568 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2024-05-09T00:22:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51554.log 2024-05-09T00:22:07.569 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52461.log.gz 2024-05-09T00:22:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54660.log 2024-05-09T00:22:07.570 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51909.log.gz 2024-05-09T00:22:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40553.log 2024-05-09T00:22:07.571 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51554.log.gz 2024-05-09T00:22:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2024-05-09T00:22:07.572 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54660.log.gz 2024-05-09T00:22:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40553.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-05-09T00:22:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-05-09T00:22:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50282.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40553.log.gz 2024-05-09T00:22:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54122.log 2024-05-09T00:22:07.574 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2024-05-09T00:22:07.574 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40385.log 2024-05-09T00:22:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40108.log 2024-05-09T00:22:07.575 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54122.log.gz 2024-05-09T00:22:07.576 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42279.log 2024-05-09T00:22:07.576 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39921.log 2024-05-09T00:22:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2024-05-09T00:22:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48618.log 2024-05-09T00:22:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40809.log 2024-05-09T00:22:07.579 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2024-05-09T00:22:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43132.log 2024-05-09T00:22:07.580 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48618.log.gz 2024-05-09T00:22:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49007.log 2024-05-09T00:22:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52651.log 2024-05-09T00:22:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44718.log 2024-05-09T00:22:07.583 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49007.log.gz 2024-05-09T00:22:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49480.log 2024-05-09T00:22:07.583 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52651.log.gz 2024-05-09T00:22:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-05-09T00:22:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53912.log 2024-05-09T00:22:07.585 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40385.log.gz 2024-05-09T00:22:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51005.log 2024-05-09T00:22:07.585 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49480.log.gz 2024-05-09T00:22:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53912.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40108.log.gz 2024-05-09T00:22:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52137.log 2024-05-09T00:22:07.587 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53912.log.gz 2024-05-09T00:22:07.587 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2024-05-09T00:22:07.587 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51005.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43132.log.gz 2024-05-09T00:22:07.587 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39921.log.gz 2024-05-09T00:22:07.587 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40809.log.gz 2024-05-09T00:22:07.588 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44718.log.gz 2024-05-09T00:22:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40246.log 2024-05-09T00:22:07.588 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51005.log.gz 2024-05-09T00:22:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52291.log 2024-05-09T00:22:07.588 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52137.log.gz 2024-05-09T00:22:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52373.log 2024-05-09T00:22:07.590 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2024-05-09T00:22:07.590 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40246.log.gz 2024-05-09T00:22:07.590 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52291.log.gz 2024-05-09T00:22:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54374.log 2024-05-09T00:22:07.591 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52373.log.gz 2024-05-09T00:22:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54458.log 2024-05-09T00:22:07.592 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2024-05-09T00:22:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51089.log 2024-05-09T00:22:07.593 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54374.log.gz 2024-05-09T00:22:07.593 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53733.log 2024-05-09T00:22:07.593 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54458.log.gz 2024-05-09T00:22:07.594 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49706.log 2024-05-09T00:22:07.594 INFO:teuthology.orchestra.run.smithi114.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51089.log.gz 2024-05-09T00:22:07.595 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52231.log 2024-05-09T00:22:07.595 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53733.log.gz 2024-05-09T00:22:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54578.log 2024-05-09T00:22:07.596 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49706.log.gz 2024-05-09T00:22:07.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-05-09T00:22:07.597 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52231.log.gz 2024-05-09T00:22:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50921.log 2024-05-09T00:22:07.598 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54578.log.gz 2024-05-09T00:22:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50479.log 2024-05-09T00:22:07.600 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52539.log 2024-05-09T00:22:07.600 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50921.log.gz 2024-05-09T00:22:07.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35331.log 2024-05-09T00:22:07.601 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50479.log.gz 2024-05-09T00:22:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54248.log 2024-05-09T00:22:07.602 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52539.log.gz 2024-05-09T00:22:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52736.log 2024-05-09T00:22:07.603 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35331.log.gz 2024-05-09T00:22:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49049.log 2024-05-09T00:22:07.604 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54248.log.gz 2024-05-09T00:22:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53136.log 2024-05-09T00:22:07.605 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52736.log.gz 2024-05-09T00:22:07.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50366.log 2024-05-09T00:22:07.606 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49049.log.gz 2024-05-09T00:22:07.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41479.log 2024-05-09T00:22:07.607 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53136.log.gz 2024-05-09T00:22:07.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48161.log 2024-05-09T00:22:07.607 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50366.log.gz 2024-05-09T00:22:07.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54973.log 2024-05-09T00:22:07.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52179.log 2024-05-09T00:22:07.609 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48161.log.gz 2024-05-09T00:22:07.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42980.log 2024-05-09T00:22:07.610 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54973.log.gz 2024-05-09T00:22:07.610 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41479.log.gz 2024-05-09T00:22:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-05-09T00:22:07.611 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52179.log.gz 2024-05-09T00:22:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42980.log.gz 2024-05-09T00:22:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2024-05-09T00:22:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40679.log 2024-05-09T00:22:07.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55267.log 2024-05-09T00:22:07.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41817.log 2024-05-09T00:22:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49438.log 2024-05-09T00:22:07.615 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55267.log.gz 2024-05-09T00:22:07.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40851.log 2024-05-09T00:22:07.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52031.log 2024-05-09T00:22:07.617 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49438.log.gz 2024-05-09T00:22:07.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49091.log 2024-05-09T00:22:07.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52031.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-05-09T00:22:07.619 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41483.log 2024-05-09T00:22:07.619 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52031.log.gz 2024-05-09T00:22:07.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52880.log 2024-05-09T00:22:07.620 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49091.log.gz 2024-05-09T00:22:07.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41483.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2024-05-09T00:22:07.621 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-05-09T00:22:07.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-05-09T00:22:07.622 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52880.log.gz 2024-05-09T00:22:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51787.log 2024-05-09T00:22:07.622 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-05-09T00:22:07.623 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44059.log 2024-05-09T00:22:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51787.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40679.log.gz 2024-05-09T00:22:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49208.log 2024-05-09T00:22:07.624 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51787.log.gz 2024-05-09T00:22:07.625 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44059.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41817.log.gz 2024-05-09T00:22:07.625 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48881.log 2024-05-09T00:22:07.626 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44962.log 2024-05-09T00:22:07.626 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49208.log.gz 2024-05-09T00:22:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53606.log 2024-05-09T00:22:07.627 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48881.log.gz 2024-05-09T00:22:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49622.log 2024-05-09T00:22:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53606.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53606.log.gz 2024-05-09T00:22:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53691.log 2024-05-09T00:22:07.629 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40851.log.gz 2024-05-09T00:22:07.630 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2024-05-09T00:22:07.630 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49622.log.gz 2024-05-09T00:22:07.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50963.log 2024-05-09T00:22:07.631 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53691.log.gz 2024-05-09T00:22:07.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51047.log 2024-05-09T00:22:07.633 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50963.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50963.log.gz 2024-05-09T00:22:07.633 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42153.log 2024-05-09T00:22:07.633 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41483.log.gz 2024-05-09T00:22:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53648.log 2024-05-09T00:22:07.634 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-05-09T00:22:07.634 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51047.log.gz 2024-05-09T00:22:07.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2024-05-09T00:22:07.636 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53648.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.53648.log.gz 2024-05-09T00:22:07.636 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2024-05-09T00:22:07.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50324.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44059.log.gz 2024-05-09T00:22:07.637 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40202.log 2024-05-09T00:22:07.637 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2024-05-09T00:22:07.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40427.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44962.log.gz 2024-05-09T00:22:07.638 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34883.log 2024-05-09T00:22:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40511.log 2024-05-09T00:22:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50198.log 2024-05-09T00:22:07.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40511.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T00:22:07.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48733.log 2024-05-09T00:22:07.641 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50198.log.gz 2024-05-09T00:22:07.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54518.log 2024-05-09T00:22:07.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52293.log 2024-05-09T00:22:07.643 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48733.log.gz 2024-05-09T00:22:07.643 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz 2024-05-09T00:22:07.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54618.log 2024-05-09T00:22:07.644 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54518.log.gz 2024-05-09T00:22:07.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44466.log 2024-05-09T00:22:07.645 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52293.log.gz 2024-05-09T00:22:07.646 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40202.log.gz 2024-05-09T00:22:07.646 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55057.log 2024-05-09T00:22:07.646 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54618.log.gz 2024-05-09T00:22:07.647 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44466.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40511.log.gz 2024-05-09T00:22:07.647 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52545.log 2024-05-09T00:22:07.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53828.log 2024-05-09T00:22:07.648 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55057.log.gz 2024-05-09T00:22:07.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44656.log 2024-05-09T00:22:07.649 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52545.log.gz 2024-05-09T00:22:07.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2024-05-09T00:22:07.650 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53828.log.gz 2024-05-09T00:22:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40977.log 2024-05-09T00:22:07.651 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48413.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2024-05-09T00:22:07.651 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41313.log 2024-05-09T00:22:07.652 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40595.log 2024-05-09T00:22:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50033.log 2024-05-09T00:22:07.654 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40595.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44466.log.gz 2024-05-09T00:22:07.654 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44656.log.gz 2024-05-09T00:22:07.654 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40977.log.gz 2024-05-09T00:22:07.655 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.41313.log.gz -5 2024-05-09T00:22:07.655 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40339.log 2024-05-09T00:22:07.655 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50033.log: gzip -5 --verbose 87.2% -- /var/log/ceph/ceph-client.admin.54931.log -- replaced with /var/log/ceph/ceph-client.admin.50033.log.gz 2024-05-09T00:22:07.655 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-09T00:22:07.656 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40595.log.gz 2024-05-09T00:22:07.656 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-05-09T00:22:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48622.log 2024-05-09T00:22:07.657 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2024-05-09T00:22:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log 2024-05-09T00:22:07.659 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43933.log: /var/log/ceph/ceph-client.admin.48622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54080.log 2024-05-09T00:22:07.659 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48622.log.gz 2024-05-09T00:22:07.660 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49832.log 2024-05-09T00:22:07.661 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54080.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.40339.log.gz --verbose 2024-05-09T00:22:07.661 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.40297.log 2024-05-09T00:22:07.661 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54080.log.gz 2024-05-09T00:22:07.662 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51596.log 2024-05-09T00:22:07.662 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49832.log.gz 2024-05-09T00:22:07.662 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-05-09T00:22:07.664 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51596.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-05-09T00:22:07.664 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54702.log 2024-05-09T00:22:07.664 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51596.log.gz 2024-05-09T00:22:07.665 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42633.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2024-05-09T00:22:07.665 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53052.log 2024-05-09T00:22:07.665 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40297.log.gz 2024-05-09T00:22:07.666 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-05-09T00:22:07.666 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-05-09T00:22:07.667 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54702.log.gz 2024-05-09T00:22:07.667 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55183.log 2024-05-09T00:22:07.667 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53052.log.gz 2024-05-09T00:22:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-05-09T00:22:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40765.log 2024-05-09T00:22:07.669 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55183.log.gz 2024-05-09T00:22:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42069.log 2024-05-09T00:22:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2024-05-09T00:22:07.671 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-05-09T00:22:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41061.log 2024-05-09T00:22:07.672 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2024-05-09T00:22:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41061.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40765.log.gz 2024-05-09T00:22:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42531.log 2024-05-09T00:22:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54038.log 2024-05-09T00:22:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42531.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41061.log.gz 2024-05-09T00:22:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54038.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54038.log.gz 2024-05-09T00:22:07.677 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2024-05-09T00:22:07.680 INFO:teuthology.orchestra.run.smithi114.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42531.log.gz 2024-05-09T00:22:07.700 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2024-05-09T00:22:07.701 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42153.log.gz 2024-05-09T00:22:07.701 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2024-05-09T00:22:07.701 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42237.log.gz 2024-05-09T00:22:07.701 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42279.log.gz 2024-05-09T00:22:07.701 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gz 2024-05-09T00:22:07.702 INFO:teuthology.orchestra.run.smithi114.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42321.log.gz 2024-05-09T00:22:07.702 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-05-09T00:22:07.703 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-05-09T00:22:07.706 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2024-05-09T00:22:07.742 INFO:teuthology.orchestra.run.smithi153.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T00:22:07.790 INFO:teuthology.orchestra.run.smithi153.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T00:22:07.860 INFO:teuthology.orchestra.run.smithi114.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34883.log.gz 2024-05-09T00:22:07.950 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T00:22:08.000 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42069.log.gz 2024-05-09T00:22:09.332 INFO:teuthology.orchestra.run.smithi114.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T00:22:13.583 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T00:22:17.131 INFO:teuthology.orchestra.run.smithi114.stderr: 96.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-09T00:22:20.277 INFO:teuthology.orchestra.run.smithi153.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-09T00:22:22.976 INFO:teuthology.orchestra.run.smithi114.stderr: 95.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T00:22:26.807 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T00:22:31.717 INFO:teuthology.orchestra.run.smithi114.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T00:22:31.806 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T00:22:37.965 INFO:teuthology.orchestra.run.smithi153.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T00:22:40.268 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T00:22:40.272 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-05-09T00:22:40.272 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m32.901s 2024-05-09T00:22:40.273 INFO:teuthology.orchestra.run.smithi153.stderr:user 1m57.322s 2024-05-09T00:22:40.273 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m9.095s 2024-05-09T00:22:40.718 INFO:teuthology.orchestra.run.smithi114.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T00:22:41.408 INFO:teuthology.orchestra.run.smithi114.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T00:22:41.912 INFO:teuthology.orchestra.run.smithi114.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T00:22:41.915 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-09T00:22:41.916 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m34.549s 2024-05-09T00:22:41.916 INFO:teuthology.orchestra.run.smithi114.stderr:user 2m15.892s 2024-05-09T00:22:41.916 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m11.727s 2024-05-09T00:22:41.917 INFO:tasks.ceph:Archiving logs... 2024-05-09T00:22:41.918 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/remote/smithi114/log 2024-05-09T00:22:41.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:23:01.009 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/remote/smithi153/log 2024-05-09T00:23:01.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:23:17.518 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T00:23:17.530 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T00:23:17.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:23:17.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:23:17.687 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T00:23:17.705 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T00:23:17.705 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:23:17.713 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:23:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:23:17.768 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:23:17.778 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:23:17.779 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-05-09T00:23:17.779 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +834us[ +837us] +/- 44ms 2024-05-09T00:23:17.779 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 91 -1000us[ -996us] +/- 66ms 2024-05-09T00:23:17.779 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -181us[ -181us] +/- 67ms 2024-05-09T00:23:17.779 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:23:17.782 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:23:17.782 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-05-09T00:23:17.782 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +804us[ +804us] +/- 44ms 2024-05-09T00:23:17.782 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -975us[ -975us] +/- 50ms 2024-05-09T00:23:17.782 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -191us[ -191us] +/- 67ms 2024-05-09T00:23:17.782 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:23:17.784 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T00:23:17.799 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T00:23:17.800 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T00:23:17.815 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:23:18.033 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:23:18.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T00:23:18.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:23:18.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T00:23:18.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:23:18.396 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T00:23:18.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T00:23:18.546 INFO:teuthology.task.internal:Duration was 1407.906692 seconds 2024-05-09T00:23:18.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T00:23:18.602 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T00:23:18.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:23:18.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:23:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:23:18.783 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:23:19.211 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T00:23:19.211 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-05-09T00:23:19.211 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:23:19.282 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-05-09T00:23:19.283 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:23:19.355 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T00:23:19.355 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:23:19.363 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:23:19.445 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T00:23:19.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:23:19.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:23:19.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T00:23:19.661 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T00:23:19.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:23:19.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:23:19.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T00:23:19.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:23:19.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:23:19.956 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-05-09T00:23:19.969 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-05-09T00:23:20.021 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:23:20.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:23:20.070 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:23:20.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:23:20.126 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T00:23:20.140 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T00:23:20.141 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/remote/smithi114 2024-05-09T00:23:20.141 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:23:20.239 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698867/remote/smithi153 2024-05-09T00:23:20.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:23:20.334 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T00:23:20.334 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:23:20.342 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:23:20.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T00:23:20.408 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T00:23:20.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T00:23:20.493 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T00:23:20.494 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:23:20.502 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:23:20.553 INFO:teuthology.orchestra.run.smithi114.stdout: 393908 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:23 /home/ubuntu/cephtest 2024-05-09T00:23:20.559 INFO:teuthology.orchestra.run.smithi153.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:23 /home/ubuntu/cephtest 2024-05-09T00:23:20.562 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T00:23:20.572 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T00:23:20.659 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} duration: 1407.9066920280457 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T00:23:20.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T00:23:20.743 INFO:teuthology.run:pass